Oct 30 21:51:26.370043 ip-10-0-135-200 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Oct 30 21:51:26.370056 ip-10-0-135-200 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Oct 30 21:51:26.370066 ip-10-0-135-200 systemd[1]: kubelet.service: Failed with result 'resources'. Oct 30 21:51:26.370395 ip-10-0-135-200 systemd[1]: Failed to start Kubernetes Kubelet. Oct 30 21:51:36.408118 ip-10-0-135-200 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Oct 30 21:51:36.408134 ip-10-0-135-200 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 759ddd8f86ce4f1a83870a211c6e1969 -- Oct 30 21:53:35.613092 ip-10-0-135-200 systemd[1]: Starting Kubernetes Kubelet... Oct 30 21:53:36.004198 ip-10-0-135-200 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:53:36.004198 ip-10-0-135-200 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 21:53:36.004198 ip-10-0-135-200 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:53:36.004198 ip-10-0-135-200 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:53:36.008570 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008491 2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:36.008570 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008569 2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:36.008570 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008573 2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008576 2582 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008580 2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008584 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008586 2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008589 2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008592 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008595 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008599 2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008604 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008608 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008611 2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008615 2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008617 2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008620 2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008623 2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008626 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008629 2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008632 2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:36.008655 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008639 2582 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008642 2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008645 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008648 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008651 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008654 2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008657 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008659 2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008662 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008665 2582 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008668 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008672 2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008674 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008677 2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008680 2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008683 2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008685 2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008688 2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008691 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008693 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:36.009147 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008696 2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008698 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008701 2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008703 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008706 2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008708 2582 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008711 2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008714 2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008717 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008719 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008722 2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008725 2582 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008728 2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008731 2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008735 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008737 2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008741 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008743 2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008746 2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008749 2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:36.009615 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008751 2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008754 2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008757 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008759 2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008762 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008764 2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008767 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008770 2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008773 2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008775 2582 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008778 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008781 2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008784 2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008786 2582 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008789 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008792 2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008795 2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008797 2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008800 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008803 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:36.010092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008805 2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008808 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008811 2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008825 2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008828 2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008831 2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008835 2582 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008838 2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008841 2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008843 2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008846 2582 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008849 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008851 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008857 2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008860 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008863 2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008866 2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008868 2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008871 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:36.010568 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008874 2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008876 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008879 2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008882 2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008884 2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.008888 2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009673 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009682 2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009685 2582 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009689 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009692 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009695 2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009698 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009700 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009703 2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009706 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009709 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009711 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009714 2582 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009718 2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:36.011064 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009720 2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009723 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009726 2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009729 2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009732 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009735 2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009737 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009740 2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009743 2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009747 2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009751 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009755 2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009758 2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009760 2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009764 2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009766 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009769 2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009772 2582 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009775 2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:36.011579 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009777 2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009780 2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009783 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009787 2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009791 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009794 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009798 2582 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009801 2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009805 2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009808 2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009810 2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009827 2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009830 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009833 2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009836 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009838 2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009841 2582 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009844 2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009847 2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:36.012043 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009849 2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009852 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009855 2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009857 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009860 2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009862 2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009865 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009867 2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009870 2582 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009873 2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009876 2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009878 2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009881 2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009884 2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009887 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009890 2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009892 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009897 2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009899 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009902 2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:36.012492 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009905 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009908 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009911 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009913 2582 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009916 2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009919 2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009922 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009924 2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009927 2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009930 2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009933 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009936 2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009939 2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009942 2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009944 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009947 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009950 2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009952 2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009955 2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:36.013008 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009957 2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009960 2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009963 2582 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009965 2582 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009968 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009970 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009973 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009976 2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009979 2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009982 2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009985 2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009989 2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009991 2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009994 2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.009997 2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010476 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010481 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010485 2582 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010488 2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:36.013469 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010490 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010493 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010496 2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010499 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010502 2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010504 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010507 2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010510 2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010513 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010515 2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010518 2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010521 2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010524 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010526 2582 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010529 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010532 2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010535 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010537 2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010540 2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:36.013937 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010543 2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010551 2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010555 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010558 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010561 2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010563 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010566 2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010569 2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010572 2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010575 2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010578 2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010581 2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010583 2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010586 2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010589 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010591 2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010594 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010596 2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:36.014384 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010599 2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010601 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010604 2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010607 2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010609 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010612 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010615 2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010618 2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010621 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010623 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010626 2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010628 2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010631 2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010634 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010636 2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010638 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010641 2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010644 2582 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010647 2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:36.014807 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010649 2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010652 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010655 2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010662 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010667 2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010671 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010674 2582 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010677 2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010680 2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010683 2582 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010685 2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010688 2582 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010691 2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010693 2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010696 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010699 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010701 2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010704 2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010707 2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:36.015286 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010710 2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010712 2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010715 2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010717 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010720 2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010723 2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010725 2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010728 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010731 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010733 2582 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010736 2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010740 2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010743 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010745 2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010748 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010751 2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010755 2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010758 2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010761 2582 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010763 2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:36.015725 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010766 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010769 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010771 2582 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010774 2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010778 2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010780 2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.010783 2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010890 2582 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010898 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010905 2582 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010909 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010913 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010917 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010924 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010928 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010931 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010934 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010939 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010943 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010946 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010949 2582 flags.go:64] FLAG: --cgroup-root="" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010952 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010955 2582 flags.go:64] FLAG: --client-ca-file="" Oct 30 21:53:36.016224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010958 2582 flags.go:64] FLAG: --cloud-provider="external" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010962 2582 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010966 2582 flags.go:64] FLAG: --cluster-domain="" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010969 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010973 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010977 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010981 2582 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010985 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010988 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010991 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010994 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.010997 2582 flags.go:64] FLAG: --contention-profiling="false" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011001 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011004 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011007 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011010 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011015 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011018 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011021 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011024 2582 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011027 2582 flags.go:64] FLAG: --enable-server="true" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011030 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011035 2582 flags.go:64] FLAG: --event-burst="100" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011038 2582 flags.go:64] FLAG: --event-qps="50" Oct 30 21:53:36.016805 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011041 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011045 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011049 2582 flags.go:64] FLAG: --eviction-hard="" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011054 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011057 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011060 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011063 2582 flags.go:64] FLAG: --eviction-soft="" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011067 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011070 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011073 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011077 2582 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011080 2582 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011083 2582 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011087 2582 flags.go:64] FLAG: --feature-gates="" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011091 2582 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011094 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011098 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011101 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011104 2582 flags.go:64] FLAG: --healthz-port="10248" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011108 2582 flags.go:64] FLAG: --help="false" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011111 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011114 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011117 2582 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 21:53:36.017434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011120 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011123 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011127 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011130 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011133 2582 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011136 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011139 2582 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011142 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011145 2582 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011148 2582 flags.go:64] FLAG: --kube-reserved="" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011151 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011155 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011159 2582 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011162 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011165 2582 flags.go:64] FLAG: --lock-file="" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011168 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011171 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011174 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011179 2582 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011182 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011186 2582 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011189 2582 flags.go:64] FLAG: --logging-format="text" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011192 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011196 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 21:53:36.018007 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011199 2582 flags.go:64] FLAG: --manifest-url="" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011202 2582 flags.go:64] FLAG: --manifest-url-header="" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011207 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011210 2582 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011214 2582 flags.go:64] FLAG: --max-pods="110" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011217 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011221 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011224 2582 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011227 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011230 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011233 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011236 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011243 2582 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011247 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011250 2582 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011253 2582 flags.go:64] FLAG: --pod-cidr="" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011256 2582 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011259 2582 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011262 2582 flags.go:64] FLAG: --pods-per-core="0" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011266 2582 flags.go:64] FLAG: --port="10250" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011269 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011272 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01db40fc46ebdffcb" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011276 2582 flags.go:64] FLAG: --qos-reserved="" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011279 2582 flags.go:64] FLAG: --read-only-port="10255" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011282 2582 flags.go:64] FLAG: --register-node="true" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011285 2582 flags.go:64] FLAG: --register-with-taints="" Oct 30 21:53:36.018656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011289 2582 flags.go:64] FLAG: --registry-burst="10" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011292 2582 flags.go:64] FLAG: --registry-qps="5" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011295 2582 flags.go:64] FLAG: --reserved-cpus="" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011299 2582 flags.go:64] FLAG: --reserved-memory="" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011303 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011306 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011310 2582 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011313 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011316 2582 flags.go:64] FLAG: --runonce="false" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011319 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011322 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011325 2582 flags.go:64] FLAG: --seccomp-default="false" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011328 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011331 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011335 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011338 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011341 2582 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011344 2582 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011347 2582 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011350 2582 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011353 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011356 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011360 2582 flags.go:64] FLAG: --system-cgroups="" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011363 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011368 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 21:53:36.019585 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011373 2582 flags.go:64] FLAG: --tls-cert-file="" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011376 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011380 2582 flags.go:64] FLAG: --tls-min-version="" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011383 2582 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011386 2582 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011389 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011392 2582 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011395 2582 flags.go:64] FLAG: --v="2" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011399 2582 flags.go:64] FLAG: --version="false" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011403 2582 flags.go:64] FLAG: --vmodule="" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011407 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011411 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011557 2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011561 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011564 2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011567 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011570 2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011573 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011575 2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011578 2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011583 2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:36.020201 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011587 2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011591 2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011594 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011597 2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011600 2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011602 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011605 2582 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011608 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011611 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011613 2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011616 2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011620 2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011623 2582 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011626 2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011629 2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011633 2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011637 2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011640 2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011643 2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:36.020731 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011647 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011650 2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011652 2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011657 2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011662 2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011665 2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011668 2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011671 2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011674 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011676 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011679 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011682 2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011685 2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011687 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011690 2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011693 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011696 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011698 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011701 2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:36.021209 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011703 2582 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011706 2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011709 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011712 2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011714 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011719 2582 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011722 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011724 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011727 2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011730 2582 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011732 2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011735 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011738 2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011741 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011743 2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011746 2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011750 2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011753 2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011756 2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011759 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:36.021657 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011761 2582 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011764 2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011767 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011769 2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011772 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011775 2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011778 2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011780 2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011783 2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011786 2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011788 2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011791 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011794 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011796 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011799 2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011802 2582 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011805 2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011808 2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011811 2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:36.022153 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011827 2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011830 2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011832 2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011835 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011838 2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011841 2582 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011844 2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011846 2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011849 2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011854 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011857 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011859 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011863 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011865 2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011868 2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011871 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011874 2582 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011877 2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011879 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:36.022628 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011882 2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.011908 2582 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011942 2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011947 2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011950 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011953 2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011955 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011958 2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011961 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011963 2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011967 2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011971 2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011977 2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011980 2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011983 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:36.023095 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.011985 2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012000 2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012005 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012008 2582 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012011 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012013 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012016 2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012020 2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012023 2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012026 2582 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012029 2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012032 2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012036 2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012040 2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012043 2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012046 2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012049 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012052 2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012055 2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:36.023447 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012058 2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012061 2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012063 2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012066 2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012069 2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012072 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012074 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012077 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012080 2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012082 2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012086 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012088 2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012091 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012094 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012097 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012100 2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012102 2582 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012105 2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012107 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:36.023911 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012110 2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012114 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012117 2582 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012119 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012122 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012124 2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012127 2582 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012130 2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012133 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012135 2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012138 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012141 2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012143 2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012146 2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012148 2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012151 2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012154 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012156 2582 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012159 2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012162 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:36.024429 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012164 2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012168 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012171 2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012174 2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012177 2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012179 2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012182 2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012185 2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012187 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012190 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012192 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012195 2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012197 2582 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012202 2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012204 2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012207 2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012209 2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012212 2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012215 2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:36.024924 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012218 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012220 2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012223 2582 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012226 2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012228 2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012231 2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012233 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012236 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012239 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012241 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012244 2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012247 2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012249 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012252 2582 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012255 2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.012258 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.019221 2582 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.019397 2582 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.019417 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.019422 2582 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 21:53:36.025366 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019687 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019694 2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019699 2582 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019702 2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019705 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019708 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019712 2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019715 2582 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019719 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019722 2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019725 2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019728 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019731 2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019734 2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019737 2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019739 2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019742 2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019745 2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019748 2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:36.025845 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019751 2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019755 2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019759 2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019762 2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019765 2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019768 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019771 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019774 2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019777 2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019780 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019784 2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019788 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019790 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019793 2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019796 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019799 2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019801 2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019804 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:36.026335 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019807 2582 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019809 2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019824 2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019829 2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019832 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019834 2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019837 2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019839 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019842 2582 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019845 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019848 2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019850 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019853 2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019856 2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019859 2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019861 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019864 2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019867 2582 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019869 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019872 2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:36.026764 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019875 2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019878 2582 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019881 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019885 2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019887 2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019891 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019894 2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019897 2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019899 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019902 2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019905 2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019907 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019910 2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019913 2582 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019915 2582 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019918 2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019920 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019923 2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019926 2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019928 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:36.027304 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019931 2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019934 2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019937 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019940 2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019942 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019947 2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019950 2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019953 2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019956 2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019959 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019961 2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019964 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019966 2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019969 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019972 2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019974 2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019977 2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019980 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019983 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019986 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:36.027773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019988 2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019991 2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019993 2582 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019996 2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.019999 2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020002 2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020004 2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020007 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020009 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.020039 2582 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020200 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020206 2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020210 2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020212 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020216 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:36.028235 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020218 2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020221 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020224 2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020226 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020229 2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020232 2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020234 2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020237 2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020240 2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020243 2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020246 2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020249 2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020251 2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020254 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020257 2582 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020259 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020262 2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020265 2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020267 2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020270 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:36.028583 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020273 2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020275 2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020278 2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020281 2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020283 2582 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020286 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020289 2582 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020292 2582 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020294 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020297 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020300 2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020302 2582 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020305 2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020308 2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020311 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020314 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020317 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020319 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020322 2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020324 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:36.029067 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020327 2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020330 2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020334 2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020338 2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020341 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020344 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020347 2582 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020349 2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020352 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020354 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020357 2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020360 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020362 2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020365 2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020368 2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020370 2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020373 2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020376 2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020378 2582 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020381 2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:36.029567 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020384 2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020386 2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020389 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020392 2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020394 2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020397 2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020400 2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020403 2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020406 2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020408 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020411 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020414 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020416 2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020419 2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020422 2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020424 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020427 2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020430 2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020432 2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020435 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:36.030148 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020437 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020440 2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020443 2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020445 2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020448 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020451 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020453 2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020457 2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020462 2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020465 2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020469 2582 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020472 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020475 2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020477 2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020480 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020482 2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020485 2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020488 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020490 2582 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:36.030689 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020493 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020496 2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.020521 2582 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020552 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020556 2582 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020559 2582 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020562 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020564 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020567 2582 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020570 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020573 2582 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020575 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020578 2582 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020580 2582 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020583 2582 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020586 2582 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:53:36.031199 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020588 2582 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020591 2582 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020594 2582 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020597 2582 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020599 2582 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020602 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020608 2582 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020611 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020613 2582 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020616 2582 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020619 2582 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020621 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020624 2582 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020626 2582 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020631 2582 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020634 2582 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020636 2582 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020639 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020642 2582 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020645 2582 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:53:36.031582 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020647 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020650 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020653 2582 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020656 2582 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020658 2582 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020661 2582 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020664 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020667 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020669 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020672 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020675 2582 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020678 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020680 2582 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020683 2582 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020687 2582 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020691 2582 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020693 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020696 2582 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020700 2582 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:53:36.032076 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020703 2582 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020706 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020708 2582 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020711 2582 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020714 2582 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020717 2582 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020720 2582 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020724 2582 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020726 2582 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020729 2582 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020732 2582 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020736 2582 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020739 2582 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020742 2582 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020745 2582 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020748 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020751 2582 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020754 2582 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020757 2582 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020759 2582 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:53:36.032637 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020762 2582 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020765 2582 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020768 2582 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020770 2582 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020773 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020776 2582 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020778 2582 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020781 2582 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020784 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020787 2582 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020789 2582 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020793 2582 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020796 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020799 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020802 2582 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020804 2582 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020807 2582 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020809 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020827 2582 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:53:36.033323 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020833 2582 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020838 2582 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020842 2582 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020846 2582 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020850 2582 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020854 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020858 2582 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020861 2582 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020864 2582 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020867 2582 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020869 2582 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020872 2582 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020875 2582 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020878 2582 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:36.020881 2582 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.020933 2582 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.024507 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.025298 2582 server.go:1014] "Starting client certificate rotation" Oct 30 21:53:36.033773 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.025395 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 21:53:36.034237 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.025427 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 21:53:36.034237 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.027209 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:53:36.034237 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.029709 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:53:36.038201 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.038188 2582 log.go:25] "Validated CRI v1 runtime API" Oct 30 21:53:36.041218 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.041202 2582 log.go:25] "Validated CRI v1 image API" Oct 30 21:53:36.042064 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.042043 2582 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 21:53:36.044445 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.044424 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ccc73da7-dd6c-4ab3-94c2-4f8006734b41:/dev/nvme0n1p3 edbbff69-02f5-49f8-9b9a-0a58c3718a52:/dev/nvme0n1p4] Oct 30 21:53:36.044525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.044443 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 21:53:36.049573 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.049461 2582 manager.go:217] Machine: {Timestamp:2026-10-30 21:53:36.04807348 +0000 UTC m=+0.314383092 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090448 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2183ba6136f54bd8fea572536f9ab5 SystemUUID:ec2183ba-6136-f54b-d8fe-a572536f9ab5 BootID:759ddd8f-86ce-4f1a-8387-0a211c6e1969 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d2:68:7d:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d2:68:7d:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:bb:d4:4b:0a:9c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 21:53:36.049573 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.049566 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 21:53:36.049721 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.049660 2582 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 21:53:36.050665 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.050643 2582 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 21:53:36.050850 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.050669 2582 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 21:53:36.050902 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.050855 2582 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 21:53:36.050902 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.050866 2582 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 21:53:36.050952 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.050920 2582 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:53:36.050952 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.050944 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:53:36.051798 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.051787 2582 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 21:53:36.055309 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.055297 2582 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 21:53:36.055422 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.055413 2582 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 21:53:36.056050 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.056040 2582 kubelet.go:493] "Attempting to sync node with API server" Oct 30 21:53:36.056084 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.056056 2582 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 21:53:36.056084 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.056075 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 21:53:36.056137 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.056088 2582 kubelet.go:405] "Adding apiserver pod source" Oct 30 21:53:36.056137 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.056099 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 21:53:36.056416 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.056398 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:53:36.058954 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.058933 2582 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 21:53:36.063640 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.063627 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:53:36.064357 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.064345 2582 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 21:53:36.064393 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.064376 2582 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 21:53:36.064533 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.064523 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 21:53:36.064561 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.064540 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 21:53:36.064561 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.064546 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 21:53:36.064561 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.064553 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 21:53:36.064561 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.064561 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 21:53:36.064671 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.064570 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 21:53:36.065174 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.065165 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 21:53:36.065204 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.065176 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 21:53:36.065204 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.065182 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 21:53:36.065204 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.065188 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 21:53:36.065204 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.065196 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 21:53:36.065204 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.065205 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 21:53:36.066002 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.065993 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 21:53:36.066038 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.066004 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 21:53:36.069671 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.069659 2582 server.go:1263] "Started kubelet" Oct 30 21:53:36.069783 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.069743 2582 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 21:53:36.069852 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.069755 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 21:53:36.069852 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.069840 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 21:53:36.070529 ip-10-0-135-200 systemd[1]: Started Kubernetes Kubelet. Oct 30 21:53:36.070928 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.070907 2582 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 21:53:36.072106 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.072090 2582 server.go:317] "Adding debug handlers to kubelet server" Oct 30 21:53:36.075807 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.075788 2582 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 21:53:36.076247 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.076229 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 21:53:36.077403 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.077386 2582 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 21:53:36.077532 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.077513 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:36.078045 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078019 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 21:53:36.078045 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078022 2582 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 21:53:36.078045 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078046 2582 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 21:53:36.078240 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078105 2582 reconstruct.go:97] "Volume reconstruction finished" Oct 30 21:53:36.078240 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078112 2582 reconciler.go:29] "Reconciler: start to sync state" Oct 30 21:53:36.078240 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078165 2582 factory.go:55] Registering systemd factory Oct 30 21:53:36.078240 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078177 2582 factory.go:223] Registration of the systemd container factory successfully Oct 30 21:53:36.078363 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078357 2582 factory.go:153] Registering CRI-O factory Oct 30 21:53:36.078393 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078367 2582 factory.go:223] Registration of the crio container factory successfully Oct 30 21:53:36.078436 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078419 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 21:53:36.078515 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078440 2582 factory.go:103] Registering Raw factory Oct 30 21:53:36.078515 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.078454 2582 manager.go:1199] Started watching for new ooms in manager Oct 30 21:53:36.079192 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.079179 2582 manager.go:319] Starting recovery of all containers Oct 30 21:53:36.085632 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.085540 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 21:53:36.090636 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.090615 2582 manager.go:324] Recovery completed Oct 30 21:53:36.098107 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.098094 2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:53:36.100293 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.100263 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Oct 30 21:53:36.100356 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.100306 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 21:53:36.100356 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.100317 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Oct 30 21:53:36.100802 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.100790 2582 cpu_manager.go:226] "Starting" policy="none" Oct 30 21:53:36.100802 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.100799 2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:53:36.100882 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.100802 2582 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 21:53:36.100882 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.100836 2582 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 21:53:36.101445 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.101432 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Oct 30 21:53:36.101496 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.101456 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 21:53:36.101496 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.101469 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Oct 30 21:53:36.112828 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.112791 2582 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 21:53:36.113751 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.112793 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-200.ec2.internal.18e36d4425013604 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-200.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-200.ec2.internal,},FirstTimestamp:2026-10-30 21:53:36.069629444 +0000 UTC m=+0.335939058,LastTimestamp:2026-10-30 21:53:36.069629444 +0000 UTC m=+0.335939058,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-200.ec2.internal,}" Oct 30 21:53:36.124533 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.124511 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 21:53:36.129949 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.129931 2582 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 21:53:36.136624 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.136606 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-khc6l" Oct 30 21:53:36.138822 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.138786 2582 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 21:53:36.138887 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.138787 2582 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 21:53:36.138887 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.138789 2582 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 21:53:36.144895 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.144879 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-khc6l" Oct 30 21:53:36.151774 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.151706 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-200.ec2.internal.18e36d4426d515bb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-200.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-200.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-200.ec2.internal,},FirstTimestamp:2026-10-30 21:53:36.100292027 +0000 UTC m=+0.366601638,LastTimestamp:2026-10-30 21:53:36.100292027 +0000 UTC m=+0.366601638,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-200.ec2.internal,}" Oct 30 21:53:36.162934 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.162867 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-200.ec2.internal.18e36d4426d56014 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-200.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-200.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-200.ec2.internal,},FirstTimestamp:2026-10-30 21:53:36.10031106 +0000 UTC m=+0.366620672,LastTimestamp:2026-10-30 21:53:36.10031106 +0000 UTC m=+0.366620672,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-200.ec2.internal,}" Oct 30 21:53:36.178511 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.178486 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:36.210599 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.210527 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-200.ec2.internal.18e36d4426d58ecc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-200.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-200.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-200.ec2.internal,},FirstTimestamp:2026-10-30 21:53:36.10032302 +0000 UTC m=+0.366632634,LastTimestamp:2026-10-30 21:53:36.10032302 +0000 UTC m=+0.366632634,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-200.ec2.internal,}" Oct 30 21:53:36.256225 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.256072 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-200.ec2.internal.18e36d4426d515bb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-200.ec2.internal.18e36d4426d515bb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-200.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-200.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-200.ec2.internal,},FirstTimestamp:2026-10-30 21:53:36.100292027 +0000 UTC m=+0.366601638,LastTimestamp:2026-10-30 21:53:36.101443954 +0000 UTC m=+0.367753566,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-200.ec2.internal,}" Oct 30 21:53:36.271893 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.271870 2582 policy_none.go:50] "Start" Oct 30 21:53:36.271997 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.271906 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 21:53:36.271997 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.271936 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 21:53:36.273977 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.273963 2582 policy_none.go:44] "Start" Oct 30 21:53:36.297571 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.278564 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:36.310403 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.310381 2582 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 21:53:36.312769 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.312758 2582 manager.go:341] "Starting Device Plugin manager" Oct 30 21:53:36.312832 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.312783 2582 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 21:53:36.312832 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.312793 2582 server.go:87] "Starting device plugin registration server" Oct 30 21:53:36.313133 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.313118 2582 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 21:53:36.313237 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.313134 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 21:53:36.313237 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.313191 2582 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 21:53:36.313336 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.313261 2582 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 21:53:36.313336 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.313268 2582 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 21:53:36.313780 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.313762 2582 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 21:53:36.313854 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.313808 2582 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:36.328790 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.328766 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 21:53:36.328790 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.328787 2582 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 21:53:36.328907 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.328808 2582 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 21:53:36.328907 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.328856 2582 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 21:53:36.340432 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.340411 2582 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-200.ec2.internal\" not found" node="ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.343720 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.343708 2582 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:53:36.413935 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.413918 2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:53:36.415005 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.414988 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Oct 30 21:53:36.415061 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.415012 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 21:53:36.415061 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.415022 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Oct 30 21:53:36.415061 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.415044 2582 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.429081 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.429064 2582 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal"] Oct 30 21:53:36.429135 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.429126 2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:53:36.429845 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.429833 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Oct 30 21:53:36.429902 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.429859 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 21:53:36.429902 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.429874 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Oct 30 21:53:36.431926 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.431914 2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:53:36.432066 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.432052 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.432103 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.432090 2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:53:36.432519 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.432504 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Oct 30 21:53:36.432587 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.432529 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 21:53:36.432587 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.432544 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Oct 30 21:53:36.432587 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.432550 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Oct 30 21:53:36.432587 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.432565 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 21:53:36.432587 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.432576 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Oct 30 21:53:36.434641 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.434625 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.434685 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.434659 2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:53:36.435315 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.435294 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Oct 30 21:53:36.435364 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.435324 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 21:53:36.435364 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.435337 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Oct 30 21:53:36.437242 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.437227 2582 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.437291 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.437254 2582 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-200.ec2.internal\": node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:36.463161 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.463139 2582 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-200.ec2.internal\" not found" node="ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.465868 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.465851 2582 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-200.ec2.internal\" not found" node="ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.479037 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.479019 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.479181 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.479054 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.479181 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.479078 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e328aa15a0f90aee4513670f92d54212-config\") pod \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" (UID: \"e328aa15a0f90aee4513670f92d54212\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.498869 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.498853 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:36.579258 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.579184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.579258 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.579215 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.579258 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.579244 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e328aa15a0f90aee4513670f92d54212-config\") pod \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" (UID: \"e328aa15a0f90aee4513670f92d54212\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.579440 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.579291 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.579440 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.579291 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.579440 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.579291 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e328aa15a0f90aee4513670f92d54212-config\") pod \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" (UID: \"e328aa15a0f90aee4513670f92d54212\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.599292 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.599270 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:36.699581 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.699552 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:36.766504 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.766474 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.769653 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:36.769636 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:53:36.800542 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.800510 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:36.901155 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:36.901070 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:37.001565 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:37.001530 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:37.025678 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.025662 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 21:53:37.026075 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.025779 2582 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 21:53:37.102226 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:37.102199 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:37.203131 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:37.202952 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:37.258039 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.258011 2582 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:53:37.260121 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.260096 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Oct 30 21:53:37.260263 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.260138 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 21:53:37.260263 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.260154 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Oct 30 21:53:37.271075 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.271050 2582 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:53:37.271197 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.271171 2582 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:53:37.275155 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.275103 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:48:36 +0000 UTC" deadline="2028-04-10 06:02:10.362279807 +0000 UTC" Oct 30 21:53:37.275155 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.275154 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12656h8m33.087130159s" Oct 30 21:53:37.304195 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:37.304171 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:37.352711 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:37.352682 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode328aa15a0f90aee4513670f92d54212.slice/crio-a594d750c7b9c30f0261589d87b933d8e86209f2f59105f5088d66748ac3fe9d WatchSource:0}: Error finding container a594d750c7b9c30f0261589d87b933d8e86209f2f59105f5088d66748ac3fe9d: Status 404 returned error can't find the container with id a594d750c7b9c30f0261589d87b933d8e86209f2f59105f5088d66748ac3fe9d Oct 30 21:53:37.359619 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.359602 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 21:53:37.363736 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:37.363712 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18effbb0686f87752ee78c9d500f5e9.slice/crio-cd46fecc1af62a7c464bbc942fa5ef088e0003c2c9fa523acff9dd9837da973d WatchSource:0}: Error finding container cd46fecc1af62a7c464bbc942fa5ef088e0003c2c9fa523acff9dd9837da973d: Status 404 returned error can't find the container with id cd46fecc1af62a7c464bbc942fa5ef088e0003c2c9fa523acff9dd9837da973d Oct 30 21:53:37.404461 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:37.404435 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:37.505517 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:37.505452 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:37.606687 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:37.606656 2582 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:53:37.671998 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.671975 2582 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:53:37.678368 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.678346 2582 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:53:37.705859 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.705839 2582 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:53:37.707026 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.707000 2582 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:53:37.730317 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.730298 2582 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:53:37.959104 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:37.959019 2582 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:53:38.058010 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.057977 2582 apiserver.go:52] "Watching apiserver" Oct 30 21:53:38.077756 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.077717 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 21:53:38.091424 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.091402 2582 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 21:53:38.091717 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.091698 2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-q9b4k","openshift-dns/node-resolver-ksczz","openshift-network-operator/iptables-alerter-bff8j","openshift-ovn-kubernetes/ovnkube-node-x949s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29","openshift-cluster-node-tuning-operator/tuned-glhwd","openshift-multus/multus-additional-cni-plugins-4tmvv","kube-system/global-pull-secret-syncer-p9l8h","kube-system/konnectivity-agent-s5hdv","openshift-image-registry/node-ca-5gsg6","kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal","openshift-multus/multus-bjm7d","openshift-multus/network-metrics-daemon-hzlsq"] Oct 30 21:53:38.094742 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.094308 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.097107 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.096658 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.099429 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.099401 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.102535 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.102514 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.104946 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.104925 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.107806 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.107783 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.110431 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.109884 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:38.113743 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.113726 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 21:53:38.113846 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.113832 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 21:53:38.113945 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.113930 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8hlnq\"" Oct 30 21:53:38.114023 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.114012 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 21:53:38.114059 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.114018 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 21:53:38.114098 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.114088 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 21:53:38.114150 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.114097 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 21:53:38.114224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.114211 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-h8qq9\"" Oct 30 21:53:38.114730 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.114711 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:38.114811 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.114790 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:38.117235 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.117202 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.120319 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.119970 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.122131 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.121555 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 21:53:38.122131 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.121565 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 21:53:38.122131 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.121577 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nhqdj\"" Oct 30 21:53:38.122312 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.122198 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 21:53:38.122648 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.122619 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 21:53:38.124503 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.123041 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 21:53:38.124503 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.123283 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 21:53:38.124503 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.123474 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 21:53:38.124503 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.123501 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:38.124503 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.123670 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:38.125318 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.125298 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 21:53:38.125426 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.125379 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:38.125985 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.125959 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 21:53:38.126174 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.126157 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:38.126251 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.126223 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:38.126596 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.126415 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vv6qp\"" Oct 30 21:53:38.126596 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.126423 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-28tsh\"" Oct 30 21:53:38.126596 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.126465 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 21:53:38.126596 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.126490 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 21:53:38.126596 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.126540 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:53:38.126596 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.126565 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hxntv\"" Oct 30 21:53:38.126596 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.126571 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 21:53:38.127129 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.127084 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 21:53:38.127464 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.127447 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 21:53:38.128774 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.128724 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-gzm2w\"" Oct 30 21:53:38.140068 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.140045 2582 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 21:53:38.140171 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.140112 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q6s8b" Oct 30 21:53:38.149275 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.149172 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q6s8b" Oct 30 21:53:38.179424 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.179408 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 21:53:38.190004 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.189985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.190099 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190012 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-cnibin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.190099 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190032 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-hostroot\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.190218 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190100 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-netd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.190218 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190133 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:38.190218 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190159 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-system-cni-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.190218 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190208 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cnibin\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.190421 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190238 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-run\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.190421 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-etc-tuned\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.190421 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190302 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/770590b4-fbb4-4f6d-9187-09ceb5ba873b-agent-certs\") pod \"konnectivity-agent-s5hdv\" (UID: \"770590b4-fbb4-4f6d-9187-09ceb5ba873b\") " pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:38.190421 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190342 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-netns\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.190421 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190380 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-bin\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.190421 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190404 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f49231a6-2242-467f-85c2-c526cafef9cb-serviceca\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.190724 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190435 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdzfk\" (UniqueName: \"kubernetes.io/projected/7ee54e3e-efb7-461c-9973-90d768900251-kube-api-access-cdzfk\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.190724 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190462 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-multus\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.190724 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190502 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.190724 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190533 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-env-overrides\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.190724 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8567\" (UniqueName: \"kubernetes.io/projected/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-kube-api-access-d8567\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:38.190724 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190595 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-kubelet-config\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:38.190724 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-socket-dir-parent\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.190724 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-bin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.190724 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190684 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-multus-certs\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.190724 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190724 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl84k\" (UniqueName: \"kubernetes.io/projected/7edf8063-b8bf-429f-90aa-aeed3a525670-kube-api-access-pl84k\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190756 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-kubernetes\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190810 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khnfl\" (UniqueName: \"kubernetes.io/projected/d0eae92f-5b3d-408a-9049-39e00d341085-kube-api-access-khnfl\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190859 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-kubelet\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190905 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-slash\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190938 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-device-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190958 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-conf-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-etc-kubernetes\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.190992 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-ovn\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191009 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191041 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysconfig\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191057 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-lib-modules\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191072 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-systemd-units\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191086 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmk62\" (UniqueName: \"kubernetes.io/projected/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-kube-api-access-kmk62\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191108 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-socket-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.191187 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191123 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-systemd\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191138 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0eae92f-5b3d-408a-9049-39e00d341085-tmp-dir\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191153 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-netns\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191203 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-log-socket\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191219 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191236 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25s8p\" (UniqueName: \"kubernetes.io/projected/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-kube-api-access-25s8p\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191254 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7sb4\" (UniqueName: \"kubernetes.io/projected/9a12383c-22ae-47a8-b17a-0bcb91c998f6-kube-api-access-f7sb4\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191277 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-cni-binary-copy\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191293 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-etc-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191309 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw722\" (UniqueName: \"kubernetes.io/projected/f49231a6-2242-467f-85c2-c526cafef9cb-kube-api-access-sw722\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191335 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191355 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-sys\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191382 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191401 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a12383c-22ae-47a8-b17a-0bcb91c998f6-host-slash\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191422 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-var-lib-kubelet\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191440 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-k8s-cni-cncf-io\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.191657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191460 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-kubelet\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-systemd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191503 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovn-node-metrics-cert\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191579 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49231a6-2242-467f-85c2-c526cafef9cb-host\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191599 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnvxz\" (UniqueName: \"kubernetes.io/projected/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kube-api-access-vnvxz\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/770590b4-fbb4-4f6d-9187-09ceb5ba873b-konnectivity-ca\") pod \"konnectivity-agent-s5hdv\" (UID: \"770590b4-fbb4-4f6d-9187-09ceb5ba873b\") " pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-dbus\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191652 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191670 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-modprobe-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191708 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191727 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-conf\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191742 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-tmp\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191757 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-system-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191772 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-daemon-config\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191794 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.192301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191811 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-host\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.193120 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191826 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0eae92f-5b3d-408a-9049-39e00d341085-hosts-file\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.193120 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191841 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-var-lib-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.193120 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-node-log\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.193120 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191878 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-config\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.193120 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191915 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-script-lib\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.193120 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191961 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a12383c-22ae-47a8-b17a-0bcb91c998f6-iptables-alerter-script\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.193120 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.191993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-sys-fs\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.193120 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.192056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:38.193120 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.192075 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-registration-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.193120 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.192125 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.221490 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.221443 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 21:53:38.221600 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.221495 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 21:53:38.221600 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.221543 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 21:53:38.221728 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.221601 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-htkkz\"" Oct 30 21:53:38.221728 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.221622 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 21:53:38.221728 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.221643 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 21:53:38.221728 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.221697 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cn5n2\"" Oct 30 21:53:38.293155 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysconfig\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.293155 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-lib-modules\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-systemd-units\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293210 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmk62\" (UniqueName: \"kubernetes.io/projected/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-kube-api-access-kmk62\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293234 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-socket-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293260 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-systemd\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293275 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysconfig\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293284 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0eae92f-5b3d-408a-9049-39e00d341085-tmp-dir\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293295 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-systemd-units\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293310 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-netns\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293337 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-log-socket\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293347 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-lib-modules\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.293381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293362 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293406 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293405 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25s8p\" (UniqueName: \"kubernetes.io/projected/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-kube-api-access-25s8p\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293433 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-socket-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293472 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-systemd\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293484 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-netns\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293520 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-log-socket\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293582 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7sb4\" (UniqueName: \"kubernetes.io/projected/9a12383c-22ae-47a8-b17a-0bcb91c998f6-kube-api-access-f7sb4\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293619 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-cni-binary-copy\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-etc-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw722\" (UniqueName: \"kubernetes.io/projected/f49231a6-2242-467f-85c2-c526cafef9cb-kube-api-access-sw722\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293675 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293691 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-sys\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293707 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293722 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a12383c-22ae-47a8-b17a-0bcb91c998f6-host-slash\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293737 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-var-lib-kubelet\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293750 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0eae92f-5b3d-408a-9049-39e00d341085-tmp-dir\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.293972 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293781 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-k8s-cni-cncf-io\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-k8s-cni-cncf-io\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293811 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-etc-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293815 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-kubelet\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293841 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-systemd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293888 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovn-node-metrics-cert\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293915 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49231a6-2242-467f-85c2-c526cafef9cb-host\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293943 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvxz\" (UniqueName: \"kubernetes.io/projected/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kube-api-access-vnvxz\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293967 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/770590b4-fbb4-4f6d-9187-09ceb5ba873b-konnectivity-ca\") pod \"konnectivity-agent-s5hdv\" (UID: \"770590b4-fbb4-4f6d-9187-09ceb5ba873b\") " pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.293995 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-dbus\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294011 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a12383c-22ae-47a8-b17a-0bcb91c998f6-host-slash\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294021 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294053 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-var-lib-kubelet\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294051 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294083 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-modprobe-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294093 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294100 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.294831 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294137 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-conf\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294162 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-tmp\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294170 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-modprobe-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-system-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294214 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-daemon-config\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294231 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294239 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-host\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294290 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0eae92f-5b3d-408a-9049-39e00d341085-hosts-file\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294296 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-cni-binary-copy\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294315 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-var-lib-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294344 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-node-log\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-config\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294395 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-kubelet\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294399 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-script-lib\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294439 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a12383c-22ae-47a8-b17a-0bcb91c998f6-iptables-alerter-script\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294465 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.295781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294469 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-sys-fs\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294512 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-sys-fs\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294516 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294547 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-registration-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.294588 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-cnibin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294643 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/770590b4-fbb4-4f6d-9187-09ceb5ba873b-konnectivity-ca\") pod \"konnectivity-agent-s5hdv\" (UID: \"770590b4-fbb4-4f6d-9187-09ceb5ba873b\") " pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.294649 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs podName:2b0d4d6c-d8f6-4ea5-930c-d97120dd189e nodeName:}" failed. No retries permitted until 2026-10-30 21:53:38.794629292 +0000 UTC m=+3.060938919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs") pod "network-metrics-daemon-hzlsq" (UID: "2b0d4d6c-d8f6-4ea5-930c-d97120dd189e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-hostroot\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294681 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-cnibin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-netd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294703 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-sys\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294711 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294724 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-systemd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294743 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-system-cni-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.294757 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:38.296659 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294774 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cnibin\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294838 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cnibin\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.294975 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-script-lib\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295051 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-system-cni-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295113 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-dbus\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.295235 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret podName:c97dc8b9-40b5-4277-93b5-2c31bad3c352 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:38.794789035 +0000 UTC m=+3.061098635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret") pod "global-pull-secret-syncer-p9l8h" (UID: "c97dc8b9-40b5-4277-93b5-2c31bad3c352") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295264 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-hostroot\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295268 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295279 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a12383c-22ae-47a8-b17a-0bcb91c998f6-iptables-alerter-script\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295295 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-netd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-run\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295348 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-etc-tuned\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295349 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-registration-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295365 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/770590b4-fbb4-4f6d-9187-09ceb5ba873b-agent-certs\") pod \"konnectivity-agent-s5hdv\" (UID: \"770590b4-fbb4-4f6d-9187-09ceb5ba873b\") " pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295385 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-netns\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295399 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-conf\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295404 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-bin\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.297525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295422 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-bin\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295446 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f49231a6-2242-467f-85c2-c526cafef9cb-serviceca\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295490 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdzfk\" (UniqueName: \"kubernetes.io/projected/7ee54e3e-efb7-461c-9973-90d768900251-kube-api-access-cdzfk\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295520 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-multus\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295572 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-env-overrides\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295596 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-netns\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295601 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8567\" (UniqueName: \"kubernetes.io/projected/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-kube-api-access-d8567\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295595 2582 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295636 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-kubelet-config\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295652 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295663 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-socket-dir-parent\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-bin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295711 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-multus-certs\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295719 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-socket-dir-parent\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295727 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl84k\" (UniqueName: \"kubernetes.io/projected/7edf8063-b8bf-429f-90aa-aeed3a525670-kube-api-access-pl84k\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295747 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.298230 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295764 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-kubernetes\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295781 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khnfl\" (UniqueName: \"kubernetes.io/projected/d0eae92f-5b3d-408a-9049-39e00d341085-kube-api-access-khnfl\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295797 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-kubelet\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295814 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-slash\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295830 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-device-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295855 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295858 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-conf-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295889 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-host\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295918 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-conf-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295921 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-node-log\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295926 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-etc-kubernetes\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295957 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-ovn\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295999 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-etc-kubernetes\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295828 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f49231a6-2242-467f-85c2-c526cafef9cb-serviceca\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295620 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0eae92f-5b3d-408a-9049-39e00d341085-hosts-file\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.295870 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-var-lib-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296167 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-multus-certs\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296174 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-kubelet-config\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296235 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-bin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296282 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-kubelet\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296402 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-system-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296410 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-kubernetes\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296443 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-slash\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296470 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-device-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296612 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-multus\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296658 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-run\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296695 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-daemon-config\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296777 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-ovn\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296816 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49231a6-2242-467f-85c2-c526cafef9cb-host\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.296851 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.297081 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.297101 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-config\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.297571 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.299820 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.298433 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-env-overrides\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.300550 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.300528 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-etc-tuned\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.300733 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.300709 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-tmp\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.300966 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.300940 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/770590b4-fbb4-4f6d-9187-09ceb5ba873b-agent-certs\") pod \"konnectivity-agent-s5hdv\" (UID: \"770590b4-fbb4-4f6d-9187-09ceb5ba873b\") " pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:38.306318 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.306295 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovn-node-metrics-cert\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.318513 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.318451 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:53:38.318513 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.318481 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:53:38.318513 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.318495 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqqdg for pod openshift-network-diagnostics/network-check-target-q9b4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:38.318729 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.318521 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw722\" (UniqueName: \"kubernetes.io/projected/f49231a6-2242-467f-85c2-c526cafef9cb-kube-api-access-sw722\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.318729 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.318541 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmk62\" (UniqueName: \"kubernetes.io/projected/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-kube-api-access-kmk62\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.318729 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.318550 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg podName:87f0bae4-f0d6-49ac-80f4-2e31394c0764 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:38.818533028 +0000 UTC m=+3.084842664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqdg" (UniqueName: "kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg") pod "network-check-target-q9b4k" (UID: "87f0bae4-f0d6-49ac-80f4-2e31394c0764") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:38.319522 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.319465 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7sb4\" (UniqueName: \"kubernetes.io/projected/9a12383c-22ae-47a8-b17a-0bcb91c998f6-kube-api-access-f7sb4\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.320884 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.320857 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl84k\" (UniqueName: \"kubernetes.io/projected/7edf8063-b8bf-429f-90aa-aeed3a525670-kube-api-access-pl84k\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.321756 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.321732 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khnfl\" (UniqueName: \"kubernetes.io/projected/d0eae92f-5b3d-408a-9049-39e00d341085-kube-api-access-khnfl\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.322595 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.322531 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdzfk\" (UniqueName: \"kubernetes.io/projected/7ee54e3e-efb7-461c-9973-90d768900251-kube-api-access-cdzfk\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.322595 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.322552 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25s8p\" (UniqueName: \"kubernetes.io/projected/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-kube-api-access-25s8p\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.323651 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.323625 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnvxz\" (UniqueName: \"kubernetes.io/projected/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kube-api-access-vnvxz\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.324254 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.324228 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8567\" (UniqueName: \"kubernetes.io/projected/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-kube-api-access-d8567\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:38.336682 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.336629 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" event={"ID":"e328aa15a0f90aee4513670f92d54212","Type":"ContainerStarted","Data":"a594d750c7b9c30f0261589d87b933d8e86209f2f59105f5088d66748ac3fe9d"} Oct 30 21:53:38.338355 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.338331 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" event={"ID":"b18effbb0686f87752ee78c9d500f5e9","Type":"ContainerStarted","Data":"cd46fecc1af62a7c464bbc942fa5ef088e0003c2c9fa523acff9dd9837da973d"} Oct 30 21:53:38.428907 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.428876 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bjm7d" Oct 30 21:53:38.431509 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.431379 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:53:38.438226 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.438199 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:53:38.441646 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:38.440473 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7edf8063_b8bf_429f_90aa_aeed3a525670.slice/crio-38eb4b0469652750fbd165ee615b1c0ea6604c4410a54e305106a3ab185acc66 WatchSource:0}: Error finding container 38eb4b0469652750fbd165ee615b1c0ea6604c4410a54e305106a3ab185acc66: Status 404 returned error can't find the container with id 38eb4b0469652750fbd165ee615b1c0ea6604c4410a54e305106a3ab185acc66 Oct 30 21:53:38.441646 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:38.441134 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a12383c_22ae_47a8_b17a_0bcb91c998f6.slice/crio-c617c861bf98a1700479fb88ee901c3af21d5a47977e102ffa14f76a9cd68b79 WatchSource:0}: Error finding container c617c861bf98a1700479fb88ee901c3af21d5a47977e102ffa14f76a9cd68b79: Status 404 returned error can't find the container with id c617c861bf98a1700479fb88ee901c3af21d5a47977e102ffa14f76a9cd68b79 Oct 30 21:53:38.448430 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:38.448406 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda650fa9d_f3d0_40b4_8c37_b6faaa2da3f8.slice/crio-211da46cd89d8a2683a380aafd9b1470e9d711a1cf5fb98a2c650fd4c854d846 WatchSource:0}: Error finding container 211da46cd89d8a2683a380aafd9b1470e9d711a1cf5fb98a2c650fd4c854d846: Status 404 returned error can't find the container with id 211da46cd89d8a2683a380aafd9b1470e9d711a1cf5fb98a2c650fd4c854d846 Oct 30 21:53:38.459678 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.459654 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:38.461779 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.461760 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:53:38.464852 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.464834 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:53:38.467650 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.467630 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:38.470674 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:38.470644 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc3c0a2_4c96_4df3_8bdc_f32eb10c2410.slice/crio-589b2e5248fc104a4c97a90fdad9233e13a54df7cb324476a8a2b3919d7ae50d WatchSource:0}: Error finding container 589b2e5248fc104a4c97a90fdad9233e13a54df7cb324476a8a2b3919d7ae50d: Status 404 returned error can't find the container with id 589b2e5248fc104a4c97a90fdad9233e13a54df7cb324476a8a2b3919d7ae50d Oct 30 21:53:38.474676 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:38.474653 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee54e3e_efb7_461c_9973_90d768900251.slice/crio-69206116993fe4081ddc271b49357e2158c7f572f120611fd56abf6ce9d5f63e WatchSource:0}: Error finding container 69206116993fe4081ddc271b49357e2158c7f572f120611fd56abf6ce9d5f63e: Status 404 returned error can't find the container with id 69206116993fe4081ddc271b49357e2158c7f572f120611fd56abf6ce9d5f63e Oct 30 21:53:38.475554 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.475423 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ksczz" Oct 30 21:53:38.478791 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:38.478614 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55631fc0_8b3a_40ac_96a0_786f08ed12ca.slice/crio-67bd0f441956947338a01e9c55ddea4e594772978a787fbd1393aa4fb9dd24ac WatchSource:0}: Error finding container 67bd0f441956947338a01e9c55ddea4e594772978a787fbd1393aa4fb9dd24ac: Status 404 returned error can't find the container with id 67bd0f441956947338a01e9c55ddea4e594772978a787fbd1393aa4fb9dd24ac Oct 30 21:53:38.482092 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:38.482071 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod770590b4_fbb4_4f6d_9187_09ceb5ba873b.slice/crio-e7caac8dee3bbf54acbd122c78992e4df661f493904c8ef6d1c4a6b0df473005 WatchSource:0}: Error finding container e7caac8dee3bbf54acbd122c78992e4df661f493904c8ef6d1c4a6b0df473005: Status 404 returned error can't find the container with id e7caac8dee3bbf54acbd122c78992e4df661f493904c8ef6d1c4a6b0df473005 Oct 30 21:53:38.482199 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.482125 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:53:38.487856 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:38.487829 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0eae92f_5b3d_408a_9049_39e00d341085.slice/crio-1f838f1b4c8bb735b6376906bc641c5637cdd8a34f7377a9129af7a42584a93a WatchSource:0}: Error finding container 1f838f1b4c8bb735b6376906bc641c5637cdd8a34f7377a9129af7a42584a93a: Status 404 returned error can't find the container with id 1f838f1b4c8bb735b6376906bc641c5637cdd8a34f7377a9129af7a42584a93a Oct 30 21:53:38.494515 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:53:38.494491 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49231a6_2242_467f_85c2_c526cafef9cb.slice/crio-505c5178fac15656557970f29fd3c53cadb91477f59d4a5aea8b85ae026660bc WatchSource:0}: Error finding container 505c5178fac15656557970f29fd3c53cadb91477f59d4a5aea8b85ae026660bc: Status 404 returned error can't find the container with id 505c5178fac15656557970f29fd3c53cadb91477f59d4a5aea8b85ae026660bc Oct 30 21:53:38.799895 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.799869 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:38.799976 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.799918 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:38.800036 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.800016 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:38.800098 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.800039 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:38.800098 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.800092 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret podName:c97dc8b9-40b5-4277-93b5-2c31bad3c352 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:39.800074907 +0000 UTC m=+4.066384510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret") pod "global-pull-secret-syncer-p9l8h" (UID: "c97dc8b9-40b5-4277-93b5-2c31bad3c352") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:38.800196 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.800109 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs podName:2b0d4d6c-d8f6-4ea5-930c-d97120dd189e nodeName:}" failed. No retries permitted until 2026-10-30 21:53:39.800100393 +0000 UTC m=+4.066409998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs") pod "network-metrics-daemon-hzlsq" (UID: "2b0d4d6c-d8f6-4ea5-930c-d97120dd189e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:38.900668 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:38.900628 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:38.900829 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.900801 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:53:38.900899 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.900838 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:53:38.900899 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.900852 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqqdg for pod openshift-network-diagnostics/network-check-target-q9b4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:38.901000 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:38.900912 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg podName:87f0bae4-f0d6-49ac-80f4-2e31394c0764 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:39.900893315 +0000 UTC m=+4.167202915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqdg" (UniqueName: "kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg") pod "network-check-target-q9b4k" (UID: "87f0bae4-f0d6-49ac-80f4-2e31394c0764") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:39.152976 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.152874 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:48:38 +0000 UTC" deadline="2028-04-12 10:19:46.358208811 +0000 UTC" Oct 30 21:53:39.152976 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.152932 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12708h26m7.205280776s" Oct 30 21:53:39.329853 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.329651 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:39.329853 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:39.329783 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:39.351211 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.349000 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5gsg6" event={"ID":"f49231a6-2242-467f-85c2-c526cafef9cb","Type":"ContainerStarted","Data":"505c5178fac15656557970f29fd3c53cadb91477f59d4a5aea8b85ae026660bc"} Oct 30 21:53:39.355533 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.355468 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s5hdv" event={"ID":"770590b4-fbb4-4f6d-9187-09ceb5ba873b","Type":"ContainerStarted","Data":"e7caac8dee3bbf54acbd122c78992e4df661f493904c8ef6d1c4a6b0df473005"} Oct 30 21:53:39.360489 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.359801 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" event={"ID":"e328aa15a0f90aee4513670f92d54212","Type":"ContainerStarted","Data":"1653422355e2e1d25005bcdb16cb760b76ce15e6e91b7e9e51dd10f0b031fb36"} Oct 30 21:53:39.369286 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.369220 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ksczz" event={"ID":"d0eae92f-5b3d-408a-9049-39e00d341085","Type":"ContainerStarted","Data":"1f838f1b4c8bb735b6376906bc641c5637cdd8a34f7377a9129af7a42584a93a"} Oct 30 21:53:39.371913 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.371841 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" event={"ID":"55631fc0-8b3a-40ac-96a0-786f08ed12ca","Type":"ContainerStarted","Data":"67bd0f441956947338a01e9c55ddea4e594772978a787fbd1393aa4fb9dd24ac"} Oct 30 21:53:39.377985 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.377931 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-glhwd" event={"ID":"7ee54e3e-efb7-461c-9973-90d768900251","Type":"ContainerStarted","Data":"69206116993fe4081ddc271b49357e2158c7f572f120611fd56abf6ce9d5f63e"} Oct 30 21:53:39.383586 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.383481 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" event={"ID":"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410","Type":"ContainerStarted","Data":"589b2e5248fc104a4c97a90fdad9233e13a54df7cb324476a8a2b3919d7ae50d"} Oct 30 21:53:39.385944 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.385919 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" event={"ID":"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8","Type":"ContainerStarted","Data":"211da46cd89d8a2683a380aafd9b1470e9d711a1cf5fb98a2c650fd4c854d846"} Oct 30 21:53:39.397553 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.397527 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bff8j" event={"ID":"9a12383c-22ae-47a8-b17a-0bcb91c998f6","Type":"ContainerStarted","Data":"c617c861bf98a1700479fb88ee901c3af21d5a47977e102ffa14f76a9cd68b79"} Oct 30 21:53:39.403477 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.403427 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bjm7d" event={"ID":"7edf8063-b8bf-429f-90aa-aeed3a525670","Type":"ContainerStarted","Data":"38eb4b0469652750fbd165ee615b1c0ea6604c4410a54e305106a3ab185acc66"} Oct 30 21:53:39.813588 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.813508 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:39.813588 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.813562 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:39.813838 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:39.813728 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:39.813838 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:39.813793 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret podName:c97dc8b9-40b5-4277-93b5-2c31bad3c352 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:41.813775115 +0000 UTC m=+6.080084717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret") pod "global-pull-secret-syncer-p9l8h" (UID: "c97dc8b9-40b5-4277-93b5-2c31bad3c352") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:39.814205 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:39.814186 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:39.814286 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:39.814238 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs podName:2b0d4d6c-d8f6-4ea5-930c-d97120dd189e nodeName:}" failed. No retries permitted until 2026-10-30 21:53:41.814223032 +0000 UTC m=+6.080532635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs") pod "network-metrics-daemon-hzlsq" (UID: "2b0d4d6c-d8f6-4ea5-930c-d97120dd189e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:39.914132 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:39.914097 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:39.914281 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:39.914247 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:53:39.914281 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:39.914264 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:53:39.914281 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:39.914276 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqqdg for pod openshift-network-diagnostics/network-check-target-q9b4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:39.914388 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:39.914329 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg podName:87f0bae4-f0d6-49ac-80f4-2e31394c0764 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:41.914311492 +0000 UTC m=+6.180621105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqdg" (UniqueName: "kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg") pod "network-check-target-q9b4k" (UID: "87f0bae4-f0d6-49ac-80f4-2e31394c0764") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:40.154035 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:40.153389 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:48:38 +0000 UTC" deadline="2028-07-13 17:03:32.362074888 +0000 UTC" Oct 30 21:53:40.154035 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:40.153429 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14923h9m52.20865075s" Oct 30 21:53:40.330619 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:40.329964 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:40.330619 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:40.330087 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:40.330619 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:40.330470 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:40.330619 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:40.330576 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:40.410956 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:40.410646 2582 generic.go:356] "Generic (PLEG): container finished" podID="b18effbb0686f87752ee78c9d500f5e9" containerID="9e06df71f1a1b67a6846e6253fce25bdcebdbc0c285e105d7d46994aef180d4a" exitCode=0 Oct 30 21:53:40.410956 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:40.410708 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" event={"ID":"b18effbb0686f87752ee78c9d500f5e9","Type":"ContainerDied","Data":"9e06df71f1a1b67a6846e6253fce25bdcebdbc0c285e105d7d46994aef180d4a"} Oct 30 21:53:40.452634 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:40.451891 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" podStartSLOduration=3.45187299 podStartE2EDuration="3.45187299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:39.400433493 +0000 UTC m=+3.666743114" watchObservedRunningTime="2026-10-30 21:53:40.45187299 +0000 UTC m=+4.718182612" Oct 30 21:53:41.333653 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:41.329833 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:41.333653 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:41.330086 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:41.432268 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:41.432231 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" event={"ID":"b18effbb0686f87752ee78c9d500f5e9","Type":"ContainerStarted","Data":"7c39e1af876e71f210367eb5e0cec51c751b7c0bf3515f4272cef1622cf58a11"} Oct 30 21:53:41.831610 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:41.831529 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:41.831610 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:41.831588 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:41.831809 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:41.831728 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:41.831809 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:41.831794 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret podName:c97dc8b9-40b5-4277-93b5-2c31bad3c352 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:45.831774951 +0000 UTC m=+10.098084574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret") pod "global-pull-secret-syncer-p9l8h" (UID: "c97dc8b9-40b5-4277-93b5-2c31bad3c352") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:41.832241 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:41.832193 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:41.832305 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:41.832247 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs podName:2b0d4d6c-d8f6-4ea5-930c-d97120dd189e nodeName:}" failed. No retries permitted until 2026-10-30 21:53:45.832232502 +0000 UTC m=+10.098542104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs") pod "network-metrics-daemon-hzlsq" (UID: "2b0d4d6c-d8f6-4ea5-930c-d97120dd189e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:41.932792 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:41.932749 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:41.932968 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:41.932912 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:53:41.932968 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:41.932933 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:53:41.932968 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:41.932945 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqqdg for pod openshift-network-diagnostics/network-check-target-q9b4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:41.933127 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:41.933002 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg podName:87f0bae4-f0d6-49ac-80f4-2e31394c0764 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:45.932985625 +0000 UTC m=+10.199295229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqdg" (UniqueName: "kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg") pod "network-check-target-q9b4k" (UID: "87f0bae4-f0d6-49ac-80f4-2e31394c0764") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:42.332252 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:42.331917 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:42.332252 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:42.332017 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:42.332252 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:42.332072 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:42.332252 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:42.332169 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:42.439426 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:42.439350 2582 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="7a477681649bd06cbe3a8a6d91c84bede908d40eaee50ca83d94063b74fedd74" exitCode=0 Oct 30 21:53:42.439426 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:42.439401 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" event={"ID":"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8","Type":"ContainerDied","Data":"7a477681649bd06cbe3a8a6d91c84bede908d40eaee50ca83d94063b74fedd74"} Oct 30 21:53:42.446372 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:42.446350 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s5hdv" event={"ID":"770590b4-fbb4-4f6d-9187-09ceb5ba873b","Type":"ContainerStarted","Data":"2b8e2f100e72290a9f35108b1a76d4528cb1be68d7aa289ee80c3b363814b28c"} Oct 30 21:53:42.511257 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:42.511204 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" podStartSLOduration=5.51118665 podStartE2EDuration="5.51118665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:41.479560301 +0000 UTC m=+5.745869921" watchObservedRunningTime="2026-10-30 21:53:42.51118665 +0000 UTC m=+6.777496274" Oct 30 21:53:43.329412 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:43.329382 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:43.329534 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:43.329501 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:43.454911 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:43.454786 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5gsg6" event={"ID":"f49231a6-2242-467f-85c2-c526cafef9cb","Type":"ContainerStarted","Data":"8dca7bd7f730d90b01cd12b97f477c20522eed1750d744162953079a1de42aeb"} Oct 30 21:53:43.509558 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:43.508657 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s5hdv" podStartSLOduration=3.860300095 podStartE2EDuration="7.50863575s" totalImagesPullingTime="3.648335655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:42.541365423 +0000 UTC m=+6.807675045" watchObservedRunningTime="2026-10-30 21:53:43.50863575 +0000 UTC m=+7.774945374" Oct 30 21:53:43.509558 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:43.508766 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5gsg6" podStartSLOduration=2.856044311 podStartE2EDuration="7.508757535s" totalImagesPullingTime="4.652713224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:43.508506735 +0000 UTC m=+7.774816358" watchObservedRunningTime="2026-10-30 21:53:43.508757535 +0000 UTC m=+7.775067157" Oct 30 21:53:43.952739 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:43.952666 2582 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:43.953239 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:43.953214 2582 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:44.329766 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:44.329448 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:44.329766 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:44.329581 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:44.329766 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:44.329654 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:44.329766 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:44.329732 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:44.460123 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:44.459882 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" event={"ID":"55631fc0-8b3a-40ac-96a0-786f08ed12ca","Type":"ContainerStarted","Data":"8f60d8ddf438c179f463e62aeb4517288ceb5725a816e90fc72d1a2fd7f218ed"} Oct 30 21:53:45.329157 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:45.329116 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:45.329327 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:45.329262 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:45.461603 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:45.461531 2582 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 21:53:45.780895 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:45.780870 2582 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 21:53:45.863883 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:45.863001 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:45.863883 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:45.863042 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:45.863883 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:45.863158 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:45.863883 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:45.863213 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret podName:c97dc8b9-40b5-4277-93b5-2c31bad3c352 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:53.863196463 +0000 UTC m=+18.129506074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret") pod "global-pull-secret-syncer-p9l8h" (UID: "c97dc8b9-40b5-4277-93b5-2c31bad3c352") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:45.863883 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:45.863570 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:45.863883 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:45.863616 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs podName:2b0d4d6c-d8f6-4ea5-930c-d97120dd189e nodeName:}" failed. No retries permitted until 2026-10-30 21:53:53.863602818 +0000 UTC m=+18.129912432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs") pod "network-metrics-daemon-hzlsq" (UID: "2b0d4d6c-d8f6-4ea5-930c-d97120dd189e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:45.964621 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:45.964586 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:45.964777 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:45.964750 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:53:45.964777 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:45.964769 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:53:45.964949 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:45.964781 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqqdg for pod openshift-network-diagnostics/network-check-target-q9b4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:45.964949 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:45.964857 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg podName:87f0bae4-f0d6-49ac-80f4-2e31394c0764 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:53.96483701 +0000 UTC m=+18.231146610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqdg" (UniqueName: "kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg") pod "network-check-target-q9b4k" (UID: "87f0bae4-f0d6-49ac-80f4-2e31394c0764") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:46.317732 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:46.317583 2582 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:53:45.780892568Z","UUID":"adf18d7c-274f-41ef-a223-258a680b4b72","Handler":null,"Name":"","Endpoint":""} Oct 30 21:53:46.324591 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:46.324573 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 21:53:46.324661 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:46.324605 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 21:53:46.333314 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:46.331265 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:46.333314 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:46.331534 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:46.333314 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:46.331796 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:46.333314 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:46.331940 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:46.466228 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:46.466191 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" event={"ID":"55631fc0-8b3a-40ac-96a0-786f08ed12ca","Type":"ContainerStarted","Data":"3cc310833d1ed79df5c90e4e03bcd450efa676b7ca068c8dd94bf0c96272602f"} Oct 30 21:53:46.469711 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:46.469671 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bjm7d" event={"ID":"7edf8063-b8bf-429f-90aa-aeed3a525670","Type":"ContainerStarted","Data":"89822a44db568a1701ead08c6449c5023741ac865d2060220fd25da733c397c2"} Oct 30 21:53:46.514738 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:46.514688 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-bjm7d" podStartSLOduration=3.141194909 podStartE2EDuration="10.514669635s" totalImagesPullingTime="7.373474726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:46.513523612 +0000 UTC m=+10.779833224" watchObservedRunningTime="2026-10-30 21:53:46.514669635 +0000 UTC m=+10.780979277" Oct 30 21:53:47.329982 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.329748 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:47.330155 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:47.330072 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:47.473539 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.473502 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ksczz" event={"ID":"d0eae92f-5b3d-408a-9049-39e00d341085","Type":"ContainerStarted","Data":"26dc9bc8c913b65806a8ece19171e13dbbec555ef61ad285f7567cd033f7a030"} Oct 30 21:53:47.475914 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.475882 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" event={"ID":"55631fc0-8b3a-40ac-96a0-786f08ed12ca","Type":"ContainerStarted","Data":"5eff7354259d7f0cfcad9c4cd3554d4f8ebf46a218bee333446cea9cf97e5c69"} Oct 30 21:53:47.478121 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.478081 2582 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="857c37390d1800ad384c78f7e07022b8142b31138ab8cff7fd522a70dc00dd0f" exitCode=0 Oct 30 21:53:47.478221 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.478163 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" event={"ID":"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8","Type":"ContainerDied","Data":"857c37390d1800ad384c78f7e07022b8142b31138ab8cff7fd522a70dc00dd0f"} Oct 30 21:53:47.481305 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.480866 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bff8j" event={"ID":"9a12383c-22ae-47a8-b17a-0bcb91c998f6","Type":"ContainerStarted","Data":"8e3ee554e6040635b34cf851cf11388b2ab669c048ec0add7ae3991333222d47"} Oct 30 21:53:47.517385 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.517335 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-ksczz" podStartSLOduration=3.679218835 podStartE2EDuration="11.517320539s" totalImagesPullingTime="7.838101704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:47.517125353 +0000 UTC m=+11.783434975" watchObservedRunningTime="2026-10-30 21:53:47.517320539 +0000 UTC m=+11.783630161" Oct 30 21:53:47.607743 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.607636 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" podStartSLOduration=3.608079294 podStartE2EDuration="11.607617618s" totalImagesPullingTime="7.999538324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:47.607416584 +0000 UTC m=+11.873726221" watchObservedRunningTime="2026-10-30 21:53:47.607617618 +0000 UTC m=+11.873927253" Oct 30 21:53:47.649896 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.649849 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bff8j" podStartSLOduration=4.099982402 podStartE2EDuration="11.649831614s" totalImagesPullingTime="7.549849212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:47.649468195 +0000 UTC m=+11.915777831" watchObservedRunningTime="2026-10-30 21:53:47.649831614 +0000 UTC m=+11.916141228" Oct 30 21:53:47.756716 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.756681 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:47.756897 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.756796 2582 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 21:53:47.757834 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:47.757602 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:53:48.330090 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:48.330062 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:48.330229 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:48.330191 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:48.330278 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:48.330244 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:48.330372 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:48.330347 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:48.485787 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:48.485703 2582 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="d8e8e18e278ae3df49a0413cca8179c0105fab231ad0f901a5077598a214dc2f" exitCode=0 Oct 30 21:53:48.486356 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:48.485801 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" event={"ID":"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8","Type":"ContainerDied","Data":"d8e8e18e278ae3df49a0413cca8179c0105fab231ad0f901a5077598a214dc2f"} Oct 30 21:53:48.487919 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:48.487687 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-glhwd" event={"ID":"7ee54e3e-efb7-461c-9973-90d768900251","Type":"ContainerStarted","Data":"383a3cef14f9a14c941e38a7fcde710d7f2dbe6884f7f12d18c2f39781729c25"} Oct 30 21:53:49.328994 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:49.328963 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:49.329144 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:49.329073 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:50.329521 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:50.329489 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:50.330163 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:50.329619 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:50.330163 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:50.329660 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:50.330163 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:50.329793 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:50.494847 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:50.494801 2582 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="e41a3428e4a8c43adcc3f673e1538e164aff03c8ceba9b0cfaf459caccc35952" exitCode=0 Oct 30 21:53:50.495021 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:50.494845 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" event={"ID":"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8","Type":"ContainerDied","Data":"e41a3428e4a8c43adcc3f673e1538e164aff03c8ceba9b0cfaf459caccc35952"} Oct 30 21:53:50.574875 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:50.574804 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-glhwd" podStartSLOduration=4.939275734 podStartE2EDuration="14.574788449s" totalImagesPullingTime="9.635512715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:48.583262958 +0000 UTC m=+12.849572583" watchObservedRunningTime="2026-10-30 21:53:50.574788449 +0000 UTC m=+14.841098071" Oct 30 21:53:51.329381 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:51.329335 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:51.329555 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:51.329444 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:52.329166 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:52.329138 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:52.329321 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:52.329140 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:52.329321 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:52.329266 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:52.329321 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:52.329298 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:52.500675 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:52.500424 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" event={"ID":"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410","Type":"ContainerStarted","Data":"9add2bcba410de2f77e2cd24fb5c5b25676b235e325b3982e15dd74995eb5d62"} Oct 30 21:53:52.503096 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:52.503071 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" event={"ID":"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8","Type":"ContainerStarted","Data":"61cee8ff7e385a9b8f0168693adf867b61e02d3a50ff7610da369621c02efb25"} Oct 30 21:53:53.329968 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.329803 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:53.330180 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:53.330031 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:53.507876 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.507851 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 21:53:53.508295 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.508183 2582 generic.go:356] "Generic (PLEG): container finished" podID="8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410" containerID="603219f6997b236fbec928515821715b331a579c318a196a6393b0e2c21bf659" exitCode=1 Oct 30 21:53:53.508295 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.508253 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" event={"ID":"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410","Type":"ContainerStarted","Data":"fa1df887e779422ea86e6f224f3c6cacf44f7fe0618e445aef67579bc11fcb29"} Oct 30 21:53:53.508391 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.508323 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" event={"ID":"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410","Type":"ContainerStarted","Data":"72faa89660d6f4d8fe8a3cbb3724adf66feff667a72b033b9d36c1125ed05c21"} Oct 30 21:53:53.508391 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.508355 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" event={"ID":"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410","Type":"ContainerStarted","Data":"839215559d4856aedf3e3e5e5ef179724c711384270516365402b6d6ecc84e92"} Oct 30 21:53:53.508391 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.508388 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" event={"ID":"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410","Type":"ContainerStarted","Data":"fc02f63b560e9c8a82228740cccdf865f55871d00023137d0dd0fb803913c5a1"} Oct 30 21:53:53.508508 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.508418 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" event={"ID":"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410","Type":"ContainerDied","Data":"603219f6997b236fbec928515821715b331a579c318a196a6393b0e2c21bf659"} Oct 30 21:53:53.510640 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.510615 2582 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="61cee8ff7e385a9b8f0168693adf867b61e02d3a50ff7610da369621c02efb25" exitCode=0 Oct 30 21:53:53.510750 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.510642 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" event={"ID":"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8","Type":"ContainerDied","Data":"61cee8ff7e385a9b8f0168693adf867b61e02d3a50ff7610da369621c02efb25"} Oct 30 21:53:53.921932 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.921848 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:53.921932 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:53.921889 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:53.922141 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:53.921984 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:53.922141 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:53.922018 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:53.922141 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:53.922042 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs podName:2b0d4d6c-d8f6-4ea5-930c-d97120dd189e nodeName:}" failed. No retries permitted until 2026-10-30 21:54:09.922026507 +0000 UTC m=+34.188336111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs") pod "network-metrics-daemon-hzlsq" (UID: "2b0d4d6c-d8f6-4ea5-930c-d97120dd189e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:53.922141 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:53.922063 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret podName:c97dc8b9-40b5-4277-93b5-2c31bad3c352 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:09.92204915 +0000 UTC m=+34.188358752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret") pod "global-pull-secret-syncer-p9l8h" (UID: "c97dc8b9-40b5-4277-93b5-2c31bad3c352") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:54.023078 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:54.023034 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:54.023206 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:54.023181 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:53:54.023206 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:54.023200 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:53:54.023285 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:54.023209 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqqdg for pod openshift-network-diagnostics/network-check-target-q9b4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:54.023285 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:54.023256 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg podName:87f0bae4-f0d6-49ac-80f4-2e31394c0764 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:10.023240266 +0000 UTC m=+34.289549876 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqdg" (UniqueName: "kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg") pod "network-check-target-q9b4k" (UID: "87f0bae4-f0d6-49ac-80f4-2e31394c0764") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:54.329657 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:54.329586 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:54.329799 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:54.329721 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:54.329799 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:54.329770 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:54.329914 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:54.329866 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:54.470964 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:54.470937 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ksczz_d0eae92f-5b3d-408a-9049-39e00d341085/dns-node-resolver/0.log" Oct 30 21:53:54.515490 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:54.515459 2582 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="80198ad85351b29611b7477ec785de95ef5b549097c49eb0f8ee0ae961824c6f" exitCode=0 Oct 30 21:53:54.515947 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:54.515511 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" event={"ID":"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8","Type":"ContainerDied","Data":"80198ad85351b29611b7477ec785de95ef5b549097c49eb0f8ee0ae961824c6f"} Oct 30 21:53:55.329275 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:55.329195 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:55.329423 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:55.329293 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:55.408049 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:55.408022 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5gsg6_f49231a6-2242-467f-85c2-c526cafef9cb/node-ca/0.log" Oct 30 21:53:55.520848 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:55.520804 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 21:53:55.521301 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:55.521181 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" event={"ID":"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410","Type":"ContainerStarted","Data":"ca34f0634611257e5ed8563b493fbc087ced8db5d9c8b2a071d20d1e021e0286"} Oct 30 21:53:55.524303 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:55.524280 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" event={"ID":"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8","Type":"ContainerStarted","Data":"226e8236881190a278ac8c7d6ec85c1e625510d0053900b96428991c3eb0c2eb"} Oct 30 21:53:55.603676 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:55.603598 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4tmvv" podStartSLOduration=9.226187279 podStartE2EDuration="19.603587928s" totalImagesPullingTime="10.377400649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:55.590405716 +0000 UTC m=+19.856715338" watchObservedRunningTime="2026-10-30 21:53:55.603587928 +0000 UTC m=+19.869897549" Oct 30 21:53:56.104761 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:56.104737 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s5hdv_770590b4-fbb4-4f6d-9187-09ceb5ba873b/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:56.330425 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:56.330388 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:56.330598 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:56.330523 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:56.330598 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:56.330572 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:56.330706 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:56.330637 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:56.398214 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:56.398142 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s5hdv_770590b4-fbb4-4f6d-9187-09ceb5ba873b/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:56.953472 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:56.953448 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s5hdv_770590b4-fbb4-4f6d-9187-09ceb5ba873b/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:57.330064 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:57.329785 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:57.330210 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:57.330064 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:53:57.530162 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:57.530136 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 21:53:57.530502 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:57.530481 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" event={"ID":"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410","Type":"ContainerStarted","Data":"72ce20a9c2aed9cb364989cbb65440bb6b869ebe963852eafa08020d8c25528c"} Oct 30 21:53:57.530761 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:57.530739 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:57.530911 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:57.530794 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:57.530968 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:57.530953 2582 scope.go:122] "RemoveContainer" containerID="603219f6997b236fbec928515821715b331a579c318a196a6393b0e2c21bf659" Oct 30 21:53:57.546518 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:57.546497 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:58.329297 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:58.329270 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:53:58.329753 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:58.329302 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:53:58.329753 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:58.329364 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:53:58.329753 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:58.329512 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:53:58.535746 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:58.535722 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 21:53:58.536078 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:58.536055 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" event={"ID":"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410","Type":"ContainerStarted","Data":"7d17a89fb2bb42734a9ac2df8738c769a8c91761a69099a272021d58592176df"} Oct 30 21:53:58.536314 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:58.536297 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:58.550710 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:58.550689 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:53:58.609155 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:58.609062 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" podStartSLOduration=8.680435574 podStartE2EDuration="22.609049486s" totalImagesPullingTime="13.928613912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:58.60892373 +0000 UTC m=+22.875233350" watchObservedRunningTime="2026-10-30 21:53:58.609049486 +0000 UTC m=+22.875359106" Oct 30 21:53:59.329804 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:53:59.329775 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:53:59.330214 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:53:59.329899 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:00.329162 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:00.329132 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:00.329384 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:00.329239 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:00.329384 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:00.329295 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:00.329467 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:00.329392 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:01.329397 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:01.329364 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:01.329845 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:01.329472 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:02.330028 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:02.329991 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:02.330509 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:02.330124 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:02.330509 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:02.330174 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:02.330509 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:02.330251 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:03.329720 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:03.329692 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:03.329889 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:03.329778 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:04.329807 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:04.329766 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:04.330204 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:04.329923 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:04.330204 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:04.329966 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:04.330204 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:04.330044 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:05.329589 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:05.329565 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:05.329724 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:05.329648 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:06.332567 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:06.330953 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:06.332567 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:06.331114 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:06.332567 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:06.331573 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:06.332567 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:06.331702 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:07.329963 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:07.329925 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:07.330163 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:07.330032 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:08.329452 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:08.329418 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:08.329940 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:08.329551 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:08.329940 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:08.329602 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:08.329940 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:08.329679 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:09.329397 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:09.329369 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:09.329542 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:09.329457 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:09.939371 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:09.939347 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:09.939528 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:09.939378 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:09.939528 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:09.939475 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:54:09.939528 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:09.939480 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:54:09.939528 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:09.939520 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret podName:c97dc8b9-40b5-4277-93b5-2c31bad3c352 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:41.939508061 +0000 UTC m=+66.205817661 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret") pod "global-pull-secret-syncer-p9l8h" (UID: "c97dc8b9-40b5-4277-93b5-2c31bad3c352") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:54:09.939678 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:09.939532 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs podName:2b0d4d6c-d8f6-4ea5-930c-d97120dd189e nodeName:}" failed. No retries permitted until 2026-10-30 21:54:41.939526801 +0000 UTC m=+66.205836399 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs") pod "network-metrics-daemon-hzlsq" (UID: "2b0d4d6c-d8f6-4ea5-930c-d97120dd189e") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:54:10.040566 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:10.040529 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:10.040706 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:10.040675 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:54:10.040706 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:10.040693 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:54:10.040706 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:10.040703 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqqdg for pod openshift-network-diagnostics/network-check-target-q9b4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:54:10.040841 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:10.040752 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg podName:87f0bae4-f0d6-49ac-80f4-2e31394c0764 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:42.040740456 +0000 UTC m=+66.307050068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqqdg" (UniqueName: "kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg") pod "network-check-target-q9b4k" (UID: "87f0bae4-f0d6-49ac-80f4-2e31394c0764") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:54:10.330081 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:10.330017 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:10.330413 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:10.330130 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:10.330413 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:10.330219 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:10.330413 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:10.330352 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:11.329950 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:11.329922 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:11.330111 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:11.330011 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:12.329098 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:12.329068 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:12.329098 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:12.329091 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:12.329286 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:12.329177 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:12.329335 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:12.329311 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:13.329072 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:13.329046 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:13.329441 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:13.329135 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:14.329710 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:14.329679 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:14.330112 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:14.329790 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:14.330112 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:14.329850 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:14.330112 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:14.329935 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:15.329175 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:15.329143 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:15.329341 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:15.329234 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:16.330827 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:16.330793 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:16.331507 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:16.330926 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:16.331507 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:16.330984 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:16.331507 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:16.331072 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:17.124970 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:17.124722 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q9b4k"] Oct 30 21:54:17.125140 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:17.125126 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:17.125274 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:17.125242 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:17.129190 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:17.129165 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hzlsq"] Oct 30 21:54:17.129302 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:17.129286 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:17.129421 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:17.129401 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:17.129996 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:17.129976 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p9l8h"] Oct 30 21:54:17.130081 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:17.130069 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:17.130181 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:17.130164 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:17.909988 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:17.909963 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ksczz_d0eae92f-5b3d-408a-9049-39e00d341085/dns-node-resolver/0.log" Oct 30 21:54:18.329376 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:18.329314 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:18.329376 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:18.329339 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:18.329536 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:18.329406 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:18.329578 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:18.329546 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:19.106172 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:19.106149 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5gsg6_f49231a6-2242-467f-85c2-c526cafef9cb/node-ca/0.log" Oct 30 21:54:19.329609 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:19.329586 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:19.329857 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:19.329685 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:20.329391 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:20.329360 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:20.329768 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:20.329463 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9b4k" podUID="87f0bae4-f0d6-49ac-80f4-2e31394c0764" Oct 30 21:54:20.329768 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:20.329535 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:20.329768 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:20.329624 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzlsq" podUID="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" Oct 30 21:54:21.329743 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.329716 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:21.330155 ip-10-0-135-200 kubenswrapper[2582]: E1030 21:54:21.329835 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p9l8h" podUID="c97dc8b9-40b5-4277-93b5-2c31bad3c352" Oct 30 21:54:21.614651 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.614584 2582 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeReady" Oct 30 21:54:21.614782 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.614697 2582 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 21:54:21.704880 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.704850 2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2mffv"] Oct 30 21:54:21.728085 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.728055 2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ttjm8"] Oct 30 21:54:21.728215 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.728181 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.745236 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.744463 2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-89856"] Oct 30 21:54:21.745236 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.744643 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.745236 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.744760 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 21:54:21.746853 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.746830 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bv47g\"" Oct 30 21:54:21.746945 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.746862 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 21:54:21.758206 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.758188 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2mffv"] Oct 30 21:54:21.758295 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.758221 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ttjm8"] Oct 30 21:54:21.758335 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.758302 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:21.761672 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.761646 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-89856"] Oct 30 21:54:21.831483 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.831455 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d07c193-84b5-44e2-bf42-fb645c2f0f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.831483 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.831488 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d07c193-84b5-44e2-bf42-fb645c2f0f35-data-volume\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.831688 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.831510 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a9e9bc-0057-4e34-9bf2-396832ce4e76-metrics-tls\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.831688 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.831590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.831688 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.831625 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2r76\" (UniqueName: \"kubernetes.io/projected/70a9e9bc-0057-4e34-9bf2-396832ce4e76-kube-api-access-v2r76\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.831688 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.831647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxft2\" (UniqueName: \"kubernetes.io/projected/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-api-access-kxft2\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.831846 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.831695 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a9e9bc-0057-4e34-9bf2-396832ce4e76-tmp-dir\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.831846 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.831758 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a9e9bc-0057-4e34-9bf2-396832ce4e76-config-volume\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.831846 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.831784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d07c193-84b5-44e2-bf42-fb645c2f0f35-crio-socket\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.846224 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.846206 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v8mh7\"" Oct 30 21:54:21.846280 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.846234 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 21:54:21.856751 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.856721 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 21:54:21.856934 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.856908 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 21:54:21.856934 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.856922 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-5mpht\"" Oct 30 21:54:21.857067 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.856911 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 21:54:21.857067 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.856987 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 21:54:21.857067 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.857030 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 21:54:21.857169 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.857078 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 21:54:21.932429 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.932397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a9e9bc-0057-4e34-9bf2-396832ce4e76-metrics-tls\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.932635 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.932445 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.932855 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.932833 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f92ch\" (UniqueName: \"kubernetes.io/projected/2801dd83-9869-447f-8e3f-6e70d12b7d21-kube-api-access-f92ch\") pod \"ingress-canary-89856\" (UID: \"2801dd83-9869-447f-8e3f-6e70d12b7d21\") " pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:21.932942 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.932889 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2801dd83-9869-447f-8e3f-6e70d12b7d21-cert\") pod \"ingress-canary-89856\" (UID: \"2801dd83-9869-447f-8e3f-6e70d12b7d21\") " pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:21.932942 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.932934 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2r76\" (UniqueName: \"kubernetes.io/projected/70a9e9bc-0057-4e34-9bf2-396832ce4e76-kube-api-access-v2r76\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.933038 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.933022 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxft2\" (UniqueName: \"kubernetes.io/projected/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-api-access-kxft2\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.933134 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.933118 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a9e9bc-0057-4e34-9bf2-396832ce4e76-tmp-dir\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.933209 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.933187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a9e9bc-0057-4e34-9bf2-396832ce4e76-config-volume\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.933263 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.933226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d07c193-84b5-44e2-bf42-fb645c2f0f35-crio-socket\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.933314 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.933263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d07c193-84b5-44e2-bf42-fb645c2f0f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.933314 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.933304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d07c193-84b5-44e2-bf42-fb645c2f0f35-data-volume\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.933672 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.933634 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.933672 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.933649 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a9e9bc-0057-4e34-9bf2-396832ce4e76-tmp-dir\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.933844 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.933637 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d07c193-84b5-44e2-bf42-fb645c2f0f35-data-volume\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.933844 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.933832 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d07c193-84b5-44e2-bf42-fb645c2f0f35-crio-socket\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.934348 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.934329 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a9e9bc-0057-4e34-9bf2-396832ce4e76-config-volume\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.937986 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.937959 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d07c193-84b5-44e2-bf42-fb645c2f0f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:21.938226 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.938209 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a9e9bc-0057-4e34-9bf2-396832ce4e76-metrics-tls\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.954865 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.954835 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2r76\" (UniqueName: \"kubernetes.io/projected/70a9e9bc-0057-4e34-9bf2-396832ce4e76-kube-api-access-v2r76\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:21.955026 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:21.955009 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxft2\" (UniqueName: \"kubernetes.io/projected/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-api-access-kxft2\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:22.034279 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.034238 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f92ch\" (UniqueName: \"kubernetes.io/projected/2801dd83-9869-447f-8e3f-6e70d12b7d21-kube-api-access-f92ch\") pod \"ingress-canary-89856\" (UID: \"2801dd83-9869-447f-8e3f-6e70d12b7d21\") " pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:22.034279 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.034271 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2801dd83-9869-447f-8e3f-6e70d12b7d21-cert\") pod \"ingress-canary-89856\" (UID: \"2801dd83-9869-447f-8e3f-6e70d12b7d21\") " pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:22.036573 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.036548 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2801dd83-9869-447f-8e3f-6e70d12b7d21-cert\") pod \"ingress-canary-89856\" (UID: \"2801dd83-9869-447f-8e3f-6e70d12b7d21\") " pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:22.056138 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.056109 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92ch\" (UniqueName: \"kubernetes.io/projected/2801dd83-9869-447f-8e3f-6e70d12b7d21-kube-api-access-f92ch\") pod \"ingress-canary-89856\" (UID: \"2801dd83-9869-447f-8e3f-6e70d12b7d21\") " pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:22.064934 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.064909 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:22.116024 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.115995 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:22.130148 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.130121 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:22.330075 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.330042 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:22.330665 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.330244 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:22.346948 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.346928 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 21:54:22.347055 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.346967 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 21:54:22.347055 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.346999 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 21:54:22.347155 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.347059 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2n5cw\"" Oct 30 21:54:22.347155 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.347097 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-vwffm\"" Oct 30 21:54:22.418057 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.418033 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2mffv"] Oct 30 21:54:22.425109 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:54:22.425083 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a9e9bc_0057_4e34_9bf2_396832ce4e76.slice/crio-97311951b7be4912c1d3fa9db163adb2684e0b06e013b1b8ba47f88e4cf8228c WatchSource:0}: Error finding container 97311951b7be4912c1d3fa9db163adb2684e0b06e013b1b8ba47f88e4cf8228c: Status 404 returned error can't find the container with id 97311951b7be4912c1d3fa9db163adb2684e0b06e013b1b8ba47f88e4cf8228c Oct 30 21:54:22.446909 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.446857 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ttjm8"] Oct 30 21:54:22.449716 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:54:22.449693 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d07c193_84b5_44e2_bf42_fb645c2f0f35.slice/crio-be9e1e1fc891df849ed2501b8a0c4623802f9bf445a5c29e2c48b377b38b283e WatchSource:0}: Error finding container be9e1e1fc891df849ed2501b8a0c4623802f9bf445a5c29e2c48b377b38b283e: Status 404 returned error can't find the container with id be9e1e1fc891df849ed2501b8a0c4623802f9bf445a5c29e2c48b377b38b283e Oct 30 21:54:22.465014 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.464992 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-89856"] Oct 30 21:54:22.481758 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:54:22.481730 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2801dd83_9869_447f_8e3f_6e70d12b7d21.slice/crio-69cd1a6863098e9b176057168ccad4415b5042fc046884436d36260dbb307ad0 WatchSource:0}: Error finding container 69cd1a6863098e9b176057168ccad4415b5042fc046884436d36260dbb307ad0: Status 404 returned error can't find the container with id 69cd1a6863098e9b176057168ccad4415b5042fc046884436d36260dbb307ad0 Oct 30 21:54:22.590030 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.589998 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttjm8" event={"ID":"7d07c193-84b5-44e2-bf42-fb645c2f0f35","Type":"ContainerStarted","Data":"411d9fd1200333b00197b4107cd0ac6da22813348f9c745f4c2bd4c934b85e69"} Oct 30 21:54:22.590178 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.590054 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttjm8" event={"ID":"7d07c193-84b5-44e2-bf42-fb645c2f0f35","Type":"ContainerStarted","Data":"be9e1e1fc891df849ed2501b8a0c4623802f9bf445a5c29e2c48b377b38b283e"} Oct 30 21:54:22.591149 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.591128 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mffv" event={"ID":"70a9e9bc-0057-4e34-9bf2-396832ce4e76","Type":"ContainerStarted","Data":"97311951b7be4912c1d3fa9db163adb2684e0b06e013b1b8ba47f88e4cf8228c"} Oct 30 21:54:22.592117 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:22.592100 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-89856" event={"ID":"2801dd83-9869-447f-8e3f-6e70d12b7d21","Type":"ContainerStarted","Data":"69cd1a6863098e9b176057168ccad4415b5042fc046884436d36260dbb307ad0"} Oct 30 21:54:23.330128 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:23.330051 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:23.347067 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:23.347042 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-cggx8\"" Oct 30 21:54:23.347533 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:23.347512 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 21:54:23.597851 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:23.597752 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttjm8" event={"ID":"7d07c193-84b5-44e2-bf42-fb645c2f0f35","Type":"ContainerStarted","Data":"dfef295b5005347c64c9b6b0e2440c805f54c6a1a9dd6effd9218d1fb6b77089"} Oct 30 21:54:24.602024 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.601998 2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8b4rc"] Oct 30 21:54:24.604449 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.604428 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mffv" event={"ID":"70a9e9bc-0057-4e34-9bf2-396832ce4e76","Type":"ContainerStarted","Data":"3cc77cb0a899fc67e263b4d62585335a9f515153998dc425e76f7445f9bce9d0"} Oct 30 21:54:24.604560 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.604462 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:24.604560 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.604530 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.604633 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.604560 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mffv" event={"ID":"70a9e9bc-0057-4e34-9bf2-396832ce4e76","Type":"ContainerStarted","Data":"a9ff46abd762d8d40962249981de36c8bf09e46a3cde6fbd42d0095de15ad72e"} Oct 30 21:54:24.659246 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.659217 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 21:54:24.659698 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.659676 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5kd5n\"" Oct 30 21:54:24.659886 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.659872 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 21:54:24.672221 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.672201 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 21:54:24.672319 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.672217 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 21:54:24.672319 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.672222 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 21:54:24.672319 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.672259 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 21:54:24.675175 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.675132 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-2mffv" podStartSLOduration=1.971252169 podStartE2EDuration="3.675120357s" totalImagesPullingTime="1.703868188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:24.674346146 +0000 UTC m=+48.940655766" watchObservedRunningTime="2026-10-30 21:54:24.675120357 +0000 UTC m=+48.941430027" Oct 30 21:54:24.754569 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.754532 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-tls\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.754727 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.754667 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-root\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.754727 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.754699 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-wtmp\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.754811 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.754737 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-sys\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.754811 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.754783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-metrics-client-ca\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.755022 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.754977 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.755155 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.755063 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2djr\" (UniqueName: \"kubernetes.io/projected/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-kube-api-access-c2djr\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.755155 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.755139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.755267 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.755171 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-textfile\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856006 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.855928 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-tls\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856006 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-root\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856214 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856028 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-wtmp\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856214 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-sys\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856214 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856072 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-metrics-client-ca\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856214 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856103 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856214 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856136 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2djr\" (UniqueName: \"kubernetes.io/projected/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-kube-api-access-c2djr\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856214 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856176 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856214 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856209 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-textfile\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856524 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856496 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-root\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856575 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856528 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-textfile\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856575 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856543 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-wtmp\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856656 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856605 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-sys\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.856941 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.856919 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-metrics-client-ca\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.857090 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.857049 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.858829 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.858799 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.859015 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.858999 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-tls\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.880678 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.880645 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2djr\" (UniqueName: \"kubernetes.io/projected/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-kube-api-access-c2djr\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.946596 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:24.946565 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:24.957474 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:54:24.957448 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87fb0a2b_cee5_4133_b84f_b7c9b22f6aa1.slice/crio-5c4ddeea7ae954369478c5cbe80e112a606ad07ebd8fc232bdbe2429ebabad7c WatchSource:0}: Error finding container 5c4ddeea7ae954369478c5cbe80e112a606ad07ebd8fc232bdbe2429ebabad7c: Status 404 returned error can't find the container with id 5c4ddeea7ae954369478c5cbe80e112a606ad07ebd8fc232bdbe2429ebabad7c Oct 30 21:54:25.609061 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:25.608500 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttjm8" event={"ID":"7d07c193-84b5-44e2-bf42-fb645c2f0f35","Type":"ContainerStarted","Data":"99ef1b0038eb20c5f41375fdcac4146c2974cc90d1d22e688a555659f15605fe"} Oct 30 21:54:25.610143 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:25.610109 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-89856" event={"ID":"2801dd83-9869-447f-8e3f-6e70d12b7d21","Type":"ContainerStarted","Data":"a497927005cfcde5775868f9797e209699842f3a0becc330d8ec8e4669587dfe"} Oct 30 21:54:25.611219 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:25.611198 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8b4rc" event={"ID":"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1","Type":"ContainerStarted","Data":"5c4ddeea7ae954369478c5cbe80e112a606ad07ebd8fc232bdbe2429ebabad7c"} Oct 30 21:54:25.719830 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:25.718963 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ttjm8" podStartSLOduration=2.707004416 podStartE2EDuration="4.718944304s" totalImagesPullingTime="2.011939888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:54:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:25.668511386 +0000 UTC m=+49.934821026" watchObservedRunningTime="2026-10-30 21:54:25.718944304 +0000 UTC m=+49.985253926" Oct 30 21:54:25.719830 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:25.719562 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-89856" podStartSLOduration=2.145247274 podStartE2EDuration="4.719553737s" totalImagesPullingTime="2.574306463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:25.71905207 +0000 UTC m=+49.985361693" watchObservedRunningTime="2026-10-30 21:54:25.719553737 +0000 UTC m=+49.985863359" Oct 30 21:54:25.975482 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:25.975455 2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:54:25.977452 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:25.977437 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.024481 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.024224 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 21:54:26.024481 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.024233 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 21:54:26.024481 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.024286 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gsmcv\"" Oct 30 21:54:26.024481 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.024306 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 21:54:26.024481 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.024349 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 21:54:26.024481 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.024375 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 21:54:26.024481 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.024437 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 21:54:26.024481 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.024439 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 21:54:26.024481 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.024450 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 21:54:26.024947 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.024897 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 21:54:26.026227 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.026208 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:54:26.166942 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.166895 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167112 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.166952 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167112 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167058 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167112 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167092 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqk7s\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-kube-api-access-lqk7s\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167112 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167111 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167227 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167126 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167227 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167288 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167237 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167288 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167253 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-web-config\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167288 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167272 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167370 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167341 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167403 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167387 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-config-out\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.167434 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.167404 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.268642 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.268599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.268642 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.268660 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.268877 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.268771 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqk7s\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-kube-api-access-lqk7s\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.268877 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.268850 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.268877 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.268867 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.269015 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.268894 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.269015 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.268910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.269015 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.268927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-web-config\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.269015 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.268958 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.269267 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.269157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.269267 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.269199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-config-out\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.269267 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.269226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.269416 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.269293 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.269677 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.269644 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.269835 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.269797 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.270774 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.270743 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.271973 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.271804 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.271973 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.271905 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.271973 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.271918 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.271973 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.271930 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.272143 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.272069 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-config-out\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.272191 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.272169 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.272504 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.272484 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-web-config\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.273001 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.272979 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.273845 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.273807 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.317494 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.317469 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqk7s\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-kube-api-access-lqk7s\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.321334 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.321314 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:26.616456 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.616428 2582 generic.go:356] "Generic (PLEG): container finished" podID="87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1" containerID="47f02eae5e54a955d460cb741adcff9fe49b3edde269790235e529c2d5a72cc6" exitCode=0 Oct 30 21:54:26.616883 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.616534 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8b4rc" event={"ID":"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1","Type":"ContainerDied","Data":"47f02eae5e54a955d460cb741adcff9fe49b3edde269790235e529c2d5a72cc6"} Oct 30 21:54:26.674676 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:26.674648 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:54:26.685210 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:54:26.685182 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6ffc6b_7858_438b_a24f_94a882233c63.slice/crio-c0fd027d85db47015b0e3ddae316fdbabbf26a350e41e91cd84cdb5c8aa33f9c WatchSource:0}: Error finding container c0fd027d85db47015b0e3ddae316fdbabbf26a350e41e91cd84cdb5c8aa33f9c: Status 404 returned error can't find the container with id c0fd027d85db47015b0e3ddae316fdbabbf26a350e41e91cd84cdb5c8aa33f9c Oct 30 21:54:27.625082 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:27.625046 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8b4rc" event={"ID":"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1","Type":"ContainerStarted","Data":"5ccafec00d065cd7371a4c4e04494ed8b9b052706cc2998f878bfa2f5f6a61ca"} Oct 30 21:54:27.625408 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:27.625135 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8b4rc" event={"ID":"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1","Type":"ContainerStarted","Data":"295bd12ea220ad60e0b7fdd600e6e9a10b9259b956a64e02c44926b72270524c"} Oct 30 21:54:27.626227 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:27.626198 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerStarted","Data":"c0fd027d85db47015b0e3ddae316fdbabbf26a350e41e91cd84cdb5c8aa33f9c"} Oct 30 21:54:28.630156 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:28.630123 2582 generic.go:356] "Generic (PLEG): container finished" podID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerID="987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26" exitCode=0 Oct 30 21:54:28.630525 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:28.630210 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerDied","Data":"987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26"} Oct 30 21:54:28.723715 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:28.723663 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8b4rc" podStartSLOduration=3.78188914 podStartE2EDuration="4.723649651s" totalImagesPullingTime="876.152744ms" totalInitContainerRuntime="65.607767ms" isStatefulPod=true podCreationTimestamp="2026-10-30 21:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:27.718793233 +0000 UTC m=+51.985102854" watchObservedRunningTime="2026-10-30 21:54:28.723649651 +0000 UTC m=+52.989959300" Oct 30 21:54:29.543456 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.543425 2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86bf5f57db-g2647"] Oct 30 21:54:29.545509 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.545490 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.569915 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.569891 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 30 21:54:29.570157 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.570129 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 30 21:54:29.582013 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.581987 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 30 21:54:29.582144 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.582037 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 30 21:54:29.582144 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.582067 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rp7c8\"" Oct 30 21:54:29.582909 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.582891 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c9uib9u4aivsb\"" Oct 30 21:54:29.587442 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.587425 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86bf5f57db-g2647"] Oct 30 21:54:29.697492 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.697457 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.698085 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.697516 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-client-ca-bundle\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.698085 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.697671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-tls\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.698085 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.697716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lstz5\" (UniqueName: \"kubernetes.io/projected/8883c3b4-99a3-4933-942c-e8e7fc999348-kube-api-access-lstz5\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.698085 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.697808 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-client-certs\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.698085 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.697897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8883c3b4-99a3-4933-942c-e8e7fc999348-audit-log\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.698085 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.697938 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-metrics-server-audit-profiles\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.798543 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.798467 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.798543 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.798517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-client-ca-bundle\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.798748 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.798587 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-tls\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.798748 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.798617 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lstz5\" (UniqueName: \"kubernetes.io/projected/8883c3b4-99a3-4933-942c-e8e7fc999348-kube-api-access-lstz5\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.798748 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.798645 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-client-certs\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.798748 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.798668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8883c3b4-99a3-4933-942c-e8e7fc999348-audit-log\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.798748 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.798691 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-metrics-server-audit-profiles\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.799086 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.799036 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8883c3b4-99a3-4933-942c-e8e7fc999348-audit-log\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.799314 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.799293 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.799721 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.799700 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-metrics-server-audit-profiles\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.801181 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.801160 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-client-ca-bundle\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.801289 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.801233 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-client-certs\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.801716 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.801682 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-tls\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.828274 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.828249 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lstz5\" (UniqueName: \"kubernetes.io/projected/8883c3b4-99a3-4933-942c-e8e7fc999348-kube-api-access-lstz5\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.856228 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.856207 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:29.986879 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.986854 2582 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f49cd584c-q44h7"] Oct 30 21:54:29.989479 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:29.989461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.028978 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.024848 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Oct 30 21:54:30.028978 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.026117 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Oct 30 21:54:30.028978 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.027334 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Oct 30 21:54:30.028978 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.027440 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Oct 30 21:54:30.028978 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.027488 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Oct 30 21:54:30.028978 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.027556 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Oct 30 21:54:30.028978 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.027651 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-x4ghg\"" Oct 30 21:54:30.042352 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.042329 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f49cd584c-q44h7"] Oct 30 21:54:30.100800 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.100772 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-metrics-client-ca\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.100898 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.100861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-federate-client-tls\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.100939 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.100903 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-serving-certs-ca-bundle\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.101080 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.100988 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plhqb\" (UniqueName: \"kubernetes.io/projected/0d137e6f-4945-4476-8d93-feb093738387-kube-api-access-plhqb\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.101080 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.101022 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.101080 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.101038 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.101314 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.101173 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-telemeter-client-tls\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.101314 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.101208 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.173755 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.173666 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86bf5f57db-g2647"] Oct 30 21:54:30.176694 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:54:30.176674 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8883c3b4_99a3_4933_942c_e8e7fc999348.slice/crio-acd77983543b6a8f6402d2ccdbf4d51d3f7cd78afebe4ac7375fd107ed6a7722 WatchSource:0}: Error finding container acd77983543b6a8f6402d2ccdbf4d51d3f7cd78afebe4ac7375fd107ed6a7722: Status 404 returned error can't find the container with id acd77983543b6a8f6402d2ccdbf4d51d3f7cd78afebe4ac7375fd107ed6a7722 Oct 30 21:54:30.201848 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.201804 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhqb\" (UniqueName: \"kubernetes.io/projected/0d137e6f-4945-4476-8d93-feb093738387-kube-api-access-plhqb\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.201954 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.201874 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.201954 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.201903 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.201954 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.201939 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-telemeter-client-tls\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.202119 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.201964 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.202119 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.202030 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-metrics-client-ca\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.202119 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.202057 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-federate-client-tls\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.202119 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.202103 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-serving-certs-ca-bundle\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.202744 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.202693 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-serving-certs-ca-bundle\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.202927 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.202903 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.203161 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.203136 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-metrics-client-ca\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.204388 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.204360 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-telemeter-client-tls\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.204630 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.204613 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.204740 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.204727 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.205135 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.205117 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-federate-client-tls\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.224947 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.224930 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhqb\" (UniqueName: \"kubernetes.io/projected/0d137e6f-4945-4476-8d93-feb093738387-kube-api-access-plhqb\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.313104 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.313048 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:30.551099 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.551072 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:30.642710 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.642670 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerStarted","Data":"9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd"} Oct 30 21:54:30.642907 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.642739 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerStarted","Data":"09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd"} Oct 30 21:54:30.642907 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.642779 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerStarted","Data":"0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279"} Oct 30 21:54:30.642907 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.642804 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerStarted","Data":"9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356"} Oct 30 21:54:30.642907 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.642854 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerStarted","Data":"8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f"} Oct 30 21:54:30.644328 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.644301 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" event={"ID":"8883c3b4-99a3-4933-942c-e8e7fc999348","Type":"ContainerStarted","Data":"acd77983543b6a8f6402d2ccdbf4d51d3f7cd78afebe4ac7375fd107ed6a7722"} Oct 30 21:54:30.651637 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:30.651610 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f49cd584c-q44h7"] Oct 30 21:54:30.664205 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:54:30.664182 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d137e6f_4945_4476_8d93_feb093738387.slice/crio-886d486070bcfb8eea7b35339bcb889d5e282d3a7f94a980edd45d4eac524a96 WatchSource:0}: Error finding container 886d486070bcfb8eea7b35339bcb889d5e282d3a7f94a980edd45d4eac524a96: Status 404 returned error can't find the container with id 886d486070bcfb8eea7b35339bcb889d5e282d3a7f94a980edd45d4eac524a96 Oct 30 21:54:31.652545 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:31.652508 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerStarted","Data":"f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316"} Oct 30 21:54:31.654208 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:31.654181 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" event={"ID":"0d137e6f-4945-4476-8d93-feb093738387","Type":"ContainerStarted","Data":"886d486070bcfb8eea7b35339bcb889d5e282d3a7f94a980edd45d4eac524a96"} Oct 30 21:54:31.655734 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:31.655708 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" event={"ID":"8883c3b4-99a3-4933-942c-e8e7fc999348","Type":"ContainerStarted","Data":"652cb16e6279f43a2bd264215bd53db51392692868510aaf1bc807bfaee7fe39"} Oct 30 21:54:31.799185 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:31.799090 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.8959004630000003 podStartE2EDuration="6.799075684s" totalImagesPullingTime="2.885429075s" totalInitContainerRuntime="17.746146ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:31.74008785 +0000 UTC m=+56.006397504" watchObservedRunningTime="2026-10-30 21:54:31.799075684 +0000 UTC m=+56.065385313" Oct 30 21:54:31.799781 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:31.799742 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" podStartSLOduration=1.54265263 podStartE2EDuration="2.799730831s" totalImagesPullingTime="1.257078201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:31.797625712 +0000 UTC m=+56.063935334" watchObservedRunningTime="2026-10-30 21:54:31.799730831 +0000 UTC m=+56.066040454" Oct 30 21:54:32.660860 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:32.660808 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" event={"ID":"0d137e6f-4945-4476-8d93-feb093738387","Type":"ContainerStarted","Data":"9fa54e8a05ccb86f60be93cfe25945f87453cb379b12149f99769d1aa8682bfa"} Oct 30 21:54:32.661305 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:32.660886 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" event={"ID":"0d137e6f-4945-4476-8d93-feb093738387","Type":"ContainerStarted","Data":"27a47cad86ef0d7a74ad0cbcc3743c77fcaf13f9f70463f4a3e12636dc29bc95"} Oct 30 21:54:32.661305 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:32.660908 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" event={"ID":"0d137e6f-4945-4476-8d93-feb093738387","Type":"ContainerStarted","Data":"12e954aa0f3b9f9f4faa33b6b2da46b08d3d78c8676cdad34e9c4ce77492e854"} Oct 30 21:54:32.732990 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:32.732941 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" podStartSLOduration=2.115455247 podStartE2EDuration="3.732929213s" totalImagesPullingTime="1.617473966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:32.720124217 +0000 UTC m=+56.986433839" watchObservedRunningTime="2026-10-30 21:54:32.732929213 +0000 UTC m=+56.999238833" Oct 30 21:54:35.619688 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:35.619655 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:41.986257 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:41.986222 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:41.986663 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:41.986281 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:42.014115 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.014090 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 21:54:42.014115 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.014091 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 21:54:42.019300 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.019281 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:42.019412 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.019395 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:42.086514 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.086488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:42.101706 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.101688 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 21:54:42.121132 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.121110 2582 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 21:54:42.129337 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.129314 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:42.156218 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.156198 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-vwffm\"" Oct 30 21:54:42.159949 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.159936 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2n5cw\"" Oct 30 21:54:42.162034 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.162019 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:42.165931 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.165917 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:42.258035 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.258012 2582 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-cggx8\"" Oct 30 21:54:42.264124 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.264102 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:42.481284 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:54:42.481258 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0d4d6c_d8f6_4ea5_930c_d97120dd189e.slice/crio-3160aa5c6c364d13f474b1848d12e730e666b79fb6a6432b24efeca955104daf WatchSource:0}: Error finding container 3160aa5c6c364d13f474b1848d12e730e666b79fb6a6432b24efeca955104daf: Status 404 returned error can't find the container with id 3160aa5c6c364d13f474b1848d12e730e666b79fb6a6432b24efeca955104daf Oct 30 21:54:42.486108 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.486085 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hzlsq"] Oct 30 21:54:42.492878 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.492861 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q9b4k"] Oct 30 21:54:42.495113 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:54:42.495093 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f0bae4_f0d6_49ac_80f4_2e31394c0764.slice/crio-c78029618cd1d30ea6ca413aa5210ad39f516b5e0c8e966bedd8808efbd94d6d WatchSource:0}: Error finding container c78029618cd1d30ea6ca413aa5210ad39f516b5e0c8e966bedd8808efbd94d6d: Status 404 returned error can't find the container with id c78029618cd1d30ea6ca413aa5210ad39f516b5e0c8e966bedd8808efbd94d6d Oct 30 21:54:42.564040 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.564021 2582 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p9l8h"] Oct 30 21:54:42.566697 ip-10-0-135-200 kubenswrapper[2582]: W1030 21:54:42.566677 2582 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc97dc8b9_40b5_4277_93b5_2c31bad3c352.slice/crio-f15b6755d727ab1c0f81e3e3e091afc301d1b2e8a39e9b94505e9041d6d3e88f WatchSource:0}: Error finding container f15b6755d727ab1c0f81e3e3e091afc301d1b2e8a39e9b94505e9041d6d3e88f: Status 404 returned error can't find the container with id f15b6755d727ab1c0f81e3e3e091afc301d1b2e8a39e9b94505e9041d6d3e88f Oct 30 21:54:42.692450 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.692421 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzlsq" event={"ID":"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e","Type":"ContainerStarted","Data":"3160aa5c6c364d13f474b1848d12e730e666b79fb6a6432b24efeca955104daf"} Oct 30 21:54:42.693466 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.693441 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p9l8h" event={"ID":"c97dc8b9-40b5-4277-93b5-2c31bad3c352","Type":"ContainerStarted","Data":"f15b6755d727ab1c0f81e3e3e091afc301d1b2e8a39e9b94505e9041d6d3e88f"} Oct 30 21:54:42.694644 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:42.694623 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q9b4k" event={"ID":"87f0bae4-f0d6-49ac-80f4-2e31394c0764","Type":"ContainerStarted","Data":"c78029618cd1d30ea6ca413aa5210ad39f516b5e0c8e966bedd8808efbd94d6d"} Oct 30 21:54:43.700386 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:43.700359 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzlsq" event={"ID":"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e","Type":"ContainerStarted","Data":"546f43ee4bdff5569cb6523493d0c3299e45908c956a744e43532556cecba74a"} Oct 30 21:54:44.706641 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:44.706599 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzlsq" event={"ID":"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e","Type":"ContainerStarted","Data":"12e3979a6e1461525acdefc6e9b1c1adb41589b3685561a97dd6c351df38b053"} Oct 30 21:54:44.772129 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:44.772047 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hzlsq" podStartSLOduration=67.763884229 podStartE2EDuration="1m8.772029841s" totalImagesPullingTime="1.008145612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:44.770700289 +0000 UTC m=+69.037009911" watchObservedRunningTime="2026-10-30 21:54:44.772029841 +0000 UTC m=+69.038339462" Oct 30 21:54:45.713734 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:45.713705 2582 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q9b4k" event={"ID":"87f0bae4-f0d6-49ac-80f4-2e31394c0764","Type":"ContainerStarted","Data":"9626252d9da2598d3987cc088c8e65629120d4e5c2742efe13418ecd3e0bc356"} Oct 30 21:54:45.714167 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:45.713784 2582 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:45.757635 ip-10-0-135-200 kubenswrapper[2582]: I1030 21:54:45.757586 2582 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q9b4k" podStartSLOduration=66.664780986 podStartE2EDuration="1m9.757572491s" totalImagesPullingTime="3.092791505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:45.756615322 +0000 UTC m=+70.022924943" watchObservedRunningTime="2026-10-30 21:54:45.757572491 +0000 UTC m=+70.023882115" Oct 30 21:54:47.434649 ip-10-0-135-200 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 21:54:47.448287 ip-10-0-135-200 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 21:54:47.448458 ip-10-0-135-200 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 21:54:47.448528 ip-10-0-135-200 systemd[1]: kubelet.service: Consumed 3.689s CPU time. Oct 30 21:54:47.459342 ip-10-0-135-200 systemd[1]: Starting Kubernetes Kubelet... Oct 30 21:54:47.519150 ip-10-0-135-200 kubenswrapper[6162]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:54:47.519150 ip-10-0-135-200 kubenswrapper[6162]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 21:54:47.519150 ip-10-0-135-200 kubenswrapper[6162]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:54:47.519150 ip-10-0-135-200 kubenswrapper[6162]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:54:47.521082 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521010 6162 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:47.521082 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521082 6162 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:47.521082 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521085 6162 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521089 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521093 6162 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521097 6162 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521100 6162 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521106 6162 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521110 6162 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521114 6162 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521117 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521120 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521123 6162 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521126 6162 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521130 6162 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521133 6162 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521136 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521138 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521141 6162 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521147 6162 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521151 6162 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:47.521178 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521153 6162 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521156 6162 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521159 6162 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521163 6162 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521166 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521168 6162 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521171 6162 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521174 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521177 6162 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521180 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521183 6162 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521186 6162 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521189 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521192 6162 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521195 6162 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521197 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521200 6162 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521203 6162 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521206 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521210 6162 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:47.521638 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521212 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521215 6162 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521218 6162 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521221 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521224 6162 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521227 6162 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521230 6162 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521233 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521236 6162 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521239 6162 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521241 6162 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521244 6162 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521247 6162 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521250 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521253 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521256 6162 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521258 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521261 6162 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521264 6162 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521268 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:47.522174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521270 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521273 6162 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521276 6162 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521279 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521282 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521286 6162 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521290 6162 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521293 6162 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521297 6162 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521299 6162 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521302 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521305 6162 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521308 6162 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521311 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521314 6162 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521316 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521319 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521322 6162 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521325 6162 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:47.522688 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521328 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521331 6162 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521333 6162 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521337 6162 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521340 6162 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521343 6162 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521346 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521349 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521352 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521355 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521357 6162 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521360 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521363 6162 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521366 6162 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521368 6162 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521371 6162 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521374 6162 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521377 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521380 6162 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521383 6162 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:47.523179 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521386 6162 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521389 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521392 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521395 6162 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521397 6162 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.521401 6162 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522156 6162 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522164 6162 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522168 6162 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522171 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522174 6162 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522179 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522182 6162 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522185 6162 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522188 6162 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522200 6162 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522203 6162 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522206 6162 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522209 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522213 6162 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:47.523673 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522216 6162 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522219 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522222 6162 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522225 6162 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522228 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522230 6162 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522233 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522236 6162 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522239 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522242 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522244 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522247 6162 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522250 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522253 6162 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522256 6162 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522259 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522262 6162 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522264 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522268 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522271 6162 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:47.524174 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522274 6162 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522277 6162 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522279 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522283 6162 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522286 6162 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522290 6162 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522294 6162 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522298 6162 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522301 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522303 6162 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522306 6162 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522310 6162 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522312 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522316 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522319 6162 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522322 6162 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522324 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522327 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522330 6162 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:47.524652 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522333 6162 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522335 6162 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522338 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522341 6162 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522344 6162 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522347 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522350 6162 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522352 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522355 6162 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522358 6162 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522361 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522363 6162 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522367 6162 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522369 6162 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522372 6162 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522375 6162 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522378 6162 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522381 6162 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522384 6162 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522386 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:47.525134 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522389 6162 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522392 6162 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522394 6162 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522399 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522403 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522405 6162 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522408 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522411 6162 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522414 6162 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522417 6162 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522419 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522422 6162 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522425 6162 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522428 6162 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522431 6162 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522433 6162 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522436 6162 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522439 6162 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522442 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522444 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:47.525676 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522447 6162 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522450 6162 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522452 6162 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522455 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522458 6162 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522461 6162 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522464 6162 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522467 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522469 6162 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522472 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522475 6162 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522480 6162 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522484 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522962 6162 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522968 6162 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522973 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522977 6162 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522980 6162 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522983 6162 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:47.526195 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522986 6162 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522988 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522991 6162 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522994 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.522997 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523000 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523003 6162 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523006 6162 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523008 6162 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523011 6162 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523014 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523017 6162 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523019 6162 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523022 6162 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523025 6162 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523028 6162 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523030 6162 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523033 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523036 6162 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:47.526674 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523039 6162 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523042 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523045 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523047 6162 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523050 6162 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523053 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523056 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523060 6162 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523063 6162 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523066 6162 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523069 6162 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523072 6162 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523075 6162 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523078 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523080 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523084 6162 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523086 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523090 6162 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523092 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:47.527226 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523095 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523098 6162 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523100 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523103 6162 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523106 6162 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523109 6162 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523111 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523114 6162 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523117 6162 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523120 6162 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523122 6162 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523125 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523128 6162 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523131 6162 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523134 6162 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523137 6162 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523139 6162 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523142 6162 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523145 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523147 6162 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:47.527687 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523152 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523155 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523158 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523161 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523164 6162 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523167 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523169 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523173 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523176 6162 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523178 6162 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523181 6162 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523184 6162 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523187 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523190 6162 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523193 6162 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523195 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523198 6162 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523201 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523203 6162 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:47.528191 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523206 6162 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523209 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523211 6162 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523214 6162 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523217 6162 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523220 6162 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523222 6162 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523225 6162 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523228 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523231 6162 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523234 6162 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523236 6162 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523239 6162 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523242 6162 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523245 6162 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523249 6162 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523253 6162 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523257 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523262 6162 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:47.528683 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523266 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523269 6162 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523272 6162 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.523274 6162 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523368 6162 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523379 6162 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523386 6162 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523390 6162 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523395 6162 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523398 6162 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523403 6162 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523407 6162 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523410 6162 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523413 6162 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523417 6162 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523420 6162 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523424 6162 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523427 6162 flags.go:64] FLAG: --cgroup-root="" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523430 6162 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523433 6162 flags.go:64] FLAG: --client-ca-file="" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523436 6162 flags.go:64] FLAG: --cloud-provider="external" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523440 6162 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523444 6162 flags.go:64] FLAG: --cluster-domain="" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523447 6162 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 21:54:47.529204 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523450 6162 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523453 6162 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523457 6162 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523461 6162 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523466 6162 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523469 6162 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523472 6162 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523475 6162 flags.go:64] FLAG: --contention-profiling="false" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523479 6162 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523482 6162 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523485 6162 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523488 6162 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523493 6162 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523496 6162 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523499 6162 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523503 6162 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523506 6162 flags.go:64] FLAG: --enable-server="true" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523509 6162 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523514 6162 flags.go:64] FLAG: --event-burst="100" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523517 6162 flags.go:64] FLAG: --event-qps="50" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523521 6162 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523524 6162 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523527 6162 flags.go:64] FLAG: --eviction-hard="" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523531 6162 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 21:54:47.530184 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523534 6162 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523537 6162 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523540 6162 flags.go:64] FLAG: --eviction-soft="" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523544 6162 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523547 6162 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523550 6162 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523554 6162 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523557 6162 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523560 6162 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523563 6162 flags.go:64] FLAG: --feature-gates="" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523567 6162 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523570 6162 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523575 6162 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523578 6162 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523581 6162 flags.go:64] FLAG: --healthz-port="10248" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523585 6162 flags.go:64] FLAG: --help="false" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523588 6162 flags.go:64] FLAG: --hostname-override="ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523591 6162 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523594 6162 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523597 6162 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523601 6162 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523604 6162 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523608 6162 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 21:54:47.530830 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523611 6162 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523614 6162 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523617 6162 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523620 6162 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523623 6162 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523626 6162 flags.go:64] FLAG: --kube-reserved="" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523629 6162 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523632 6162 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523635 6162 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523638 6162 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523641 6162 flags.go:64] FLAG: --lock-file="" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523644 6162 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523648 6162 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523651 6162 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523657 6162 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523660 6162 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523664 6162 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523667 6162 flags.go:64] FLAG: --logging-format="text" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523670 6162 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523673 6162 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523677 6162 flags.go:64] FLAG: --manifest-url="" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523681 6162 flags.go:64] FLAG: --manifest-url-header="" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523686 6162 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523689 6162 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523693 6162 flags.go:64] FLAG: --max-pods="110" Oct 30 21:54:47.531396 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523697 6162 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523700 6162 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523703 6162 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523706 6162 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523709 6162 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523712 6162 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523715 6162 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523722 6162 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523725 6162 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523728 6162 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523732 6162 flags.go:64] FLAG: --pod-cidr="" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523735 6162 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523738 6162 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523742 6162 flags.go:64] FLAG: --pods-per-core="0" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523745 6162 flags.go:64] FLAG: --port="10250" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523749 6162 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523752 6162 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01db40fc46ebdffcb" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523755 6162 flags.go:64] FLAG: --qos-reserved="" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523758 6162 flags.go:64] FLAG: --read-only-port="10255" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523762 6162 flags.go:64] FLAG: --register-node="true" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523765 6162 flags.go:64] FLAG: --register-with-taints="" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523769 6162 flags.go:64] FLAG: --registry-burst="10" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523772 6162 flags.go:64] FLAG: --registry-qps="5" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523775 6162 flags.go:64] FLAG: --reserved-cpus="" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523778 6162 flags.go:64] FLAG: --reserved-memory="" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523782 6162 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 21:54:47.532030 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523786 6162 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523789 6162 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523793 6162 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523796 6162 flags.go:64] FLAG: --runonce="false" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523799 6162 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523802 6162 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523805 6162 flags.go:64] FLAG: --seccomp-default="false" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523808 6162 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523824 6162 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523828 6162 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523831 6162 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523834 6162 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523837 6162 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523840 6162 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523843 6162 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523846 6162 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523849 6162 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523852 6162 flags.go:64] FLAG: --system-cgroups="" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523855 6162 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523862 6162 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523865 6162 flags.go:64] FLAG: --tls-cert-file="" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523868 6162 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523872 6162 flags.go:64] FLAG: --tls-min-version="" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523874 6162 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523877 6162 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 21:54:47.532776 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523880 6162 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523883 6162 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523887 6162 flags.go:64] FLAG: --v="2" Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523895 6162 flags.go:64] FLAG: --version="false" Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523899 6162 flags.go:64] FLAG: --vmodule="" Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523903 6162 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.523907 6162 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524048 6162 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524053 6162 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524057 6162 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524060 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524063 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524066 6162 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524069 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524071 6162 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524074 6162 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524077 6162 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524080 6162 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524083 6162 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524085 6162 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524088 6162 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:47.533416 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524091 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524093 6162 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524096 6162 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524099 6162 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524102 6162 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524107 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524110 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524113 6162 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524115 6162 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524118 6162 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524121 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524124 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524126 6162 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524129 6162 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524132 6162 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524135 6162 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524137 6162 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524141 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524144 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524147 6162 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:47.534031 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524150 6162 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524153 6162 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524155 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524158 6162 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524161 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524163 6162 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524167 6162 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524169 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524172 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524176 6162 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524181 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524184 6162 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524187 6162 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524191 6162 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524195 6162 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524198 6162 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524201 6162 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524205 6162 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524208 6162 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:47.534597 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524211 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524214 6162 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524217 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524220 6162 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524223 6162 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524226 6162 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524229 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524231 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524234 6162 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524237 6162 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524240 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524243 6162 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524246 6162 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524249 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524252 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524255 6162 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524258 6162 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524260 6162 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524263 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:47.535318 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524266 6162 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524269 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524271 6162 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524274 6162 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524277 6162 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524281 6162 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524284 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524287 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524289 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524292 6162 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524295 6162 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524299 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524302 6162 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524305 6162 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524307 6162 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524310 6162 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524313 6162 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524316 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524319 6162 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524322 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:47.535886 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524325 6162 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524328 6162 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524331 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524334 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524336 6162 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524339 6162 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524342 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524345 6162 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524348 6162 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524350 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524353 6162 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524356 6162 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524359 6162 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524361 6162 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.524386 6162 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524420 6162 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:47.536387 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524424 6162 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524427 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524432 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524435 6162 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524437 6162 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524440 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524443 6162 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524447 6162 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524450 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524453 6162 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524455 6162 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524458 6162 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524461 6162 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524464 6162 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524466 6162 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524469 6162 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524472 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524475 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524478 6162 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:47.536942 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524480 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524483 6162 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524486 6162 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524488 6162 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524492 6162 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524495 6162 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524497 6162 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524500 6162 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524503 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524506 6162 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524508 6162 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524511 6162 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524514 6162 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524516 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524519 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524523 6162 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524526 6162 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524529 6162 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524532 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524534 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:47.537481 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524539 6162 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524542 6162 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524544 6162 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524547 6162 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524550 6162 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524553 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524556 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524558 6162 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524561 6162 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524564 6162 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524567 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524570 6162 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524572 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524575 6162 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524578 6162 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524581 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524584 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524588 6162 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524592 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:47.538032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524596 6162 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524598 6162 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524602 6162 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524606 6162 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524610 6162 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524613 6162 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524617 6162 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524620 6162 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524624 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524627 6162 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524630 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524633 6162 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524636 6162 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524640 6162 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524643 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524646 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524649 6162 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524651 6162 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524656 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524659 6162 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:47.538485 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524662 6162 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524665 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524668 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524670 6162 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524673 6162 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524676 6162 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524679 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524682 6162 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524684 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524687 6162 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524690 6162 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524693 6162 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524696 6162 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524698 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524701 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524704 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524707 6162 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524709 6162 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524712 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524715 6162 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:47.539032 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524719 6162 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524722 6162 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524725 6162 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524728 6162 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524731 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524735 6162 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.524739 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.528295 6162 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.528310 6162 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.528327 6162 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.528332 6162 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528407 6162 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528412 6162 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528416 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528419 6162 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528422 6162 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528425 6162 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528440 6162 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528445 6162 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:47.539519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528449 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528452 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528455 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528458 6162 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528467 6162 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528470 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528474 6162 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528477 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528479 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528482 6162 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528485 6162 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528488 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528491 6162 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528494 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528497 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528499 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528502 6162 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528505 6162 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528508 6162 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528510 6162 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:47.540038 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528514 6162 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528517 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528520 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528523 6162 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528527 6162 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528530 6162 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528533 6162 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528535 6162 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528538 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528541 6162 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528544 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528546 6162 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528549 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528552 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528555 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528558 6162 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528561 6162 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528569 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528572 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:47.540519 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528575 6162 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528578 6162 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528581 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528584 6162 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528587 6162 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528589 6162 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528592 6162 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528595 6162 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528598 6162 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528606 6162 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528610 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528612 6162 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528615 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528618 6162 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528621 6162 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528624 6162 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528626 6162 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528629 6162 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528632 6162 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528635 6162 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:47.541023 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528638 6162 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528641 6162 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528644 6162 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528647 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528649 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528652 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528655 6162 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528657 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528660 6162 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528663 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528666 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528678 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528681 6162 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528685 6162 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528688 6162 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528690 6162 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528693 6162 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528696 6162 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528700 6162 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:47.541497 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528703 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528706 6162 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528709 6162 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528712 6162 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528715 6162 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528718 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528723 6162 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528727 6162 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528730 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528733 6162 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528736 6162 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528740 6162 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528742 6162 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528745 6162 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528748 6162 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528751 6162 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528755 6162 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528759 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528762 6162 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:47.542020 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.528765 6162 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.528793 6162 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529763 6162 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529784 6162 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529789 6162 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529802 6162 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529807 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529826 6162 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529832 6162 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529837 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529842 6162 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529846 6162 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529851 6162 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529855 6162 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529860 6162 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529865 6162 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:47.542486 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529869 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529874 6162 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529883 6162 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529888 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529892 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529897 6162 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529901 6162 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529906 6162 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529910 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529915 6162 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529920 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529924 6162 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529928 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529950 6162 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529959 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529964 6162 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529968 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529973 6162 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529978 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:47.542953 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529983 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529988 6162 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529993 6162 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.529997 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530002 6162 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530006 6162 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530010 6162 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530014 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530024 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530028 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530032 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530037 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530041 6162 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530046 6162 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530050 6162 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530055 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530059 6162 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530063 6162 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530067 6162 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530072 6162 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:47.543559 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530095 6162 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530117 6162 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530125 6162 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530131 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530136 6162 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530143 6162 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530151 6162 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530156 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530161 6162 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530166 6162 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530173 6162 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530180 6162 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530192 6162 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530197 6162 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530202 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530207 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530212 6162 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530217 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530221 6162 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:47.544166 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530227 6162 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530247 6162 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530252 6162 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530256 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530261 6162 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530265 6162 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530275 6162 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530280 6162 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530284 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530304 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530325 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530411 6162 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530420 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530424 6162 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530429 6162 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530435 6162 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530439 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530444 6162 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530448 6162 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:47.544749 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530452 6162 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530456 6162 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530460 6162 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530464 6162 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530469 6162 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530473 6162 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530477 6162 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530481 6162 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530486 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530490 6162 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530496 6162 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530501 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530505 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530509 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530513 6162 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.530562 6162 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:54:47.545350 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530641 6162 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530647 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530652 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530656 6162 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530661 6162 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530666 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530670 6162 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530675 6162 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530679 6162 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530682 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530686 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530688 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530691 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530694 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530697 6162 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530700 6162 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530703 6162 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530705 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530708 6162 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:47.545878 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530711 6162 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530714 6162 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530716 6162 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530720 6162 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530723 6162 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530725 6162 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530728 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530731 6162 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530735 6162 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530739 6162 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530743 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530746 6162 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530750 6162 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530754 6162 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530758 6162 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530761 6162 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530764 6162 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530767 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530770 6162 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:47.546466 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530772 6162 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530775 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530778 6162 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530781 6162 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530791 6162 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530794 6162 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530797 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530799 6162 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530802 6162 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530805 6162 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530808 6162 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530810 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530832 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530835 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530839 6162 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530842 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530845 6162 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530848 6162 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530851 6162 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:47.547063 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530854 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530856 6162 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530859 6162 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530862 6162 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530864 6162 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530867 6162 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530870 6162 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530873 6162 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530875 6162 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530878 6162 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530881 6162 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530884 6162 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530887 6162 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530889 6162 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530892 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530895 6162 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530899 6162 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530901 6162 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530910 6162 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530913 6162 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:47.547513 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530916 6162 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530920 6162 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530923 6162 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530925 6162 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530928 6162 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530931 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530934 6162 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530937 6162 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530939 6162 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530942 6162 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530945 6162 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530947 6162 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530950 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530953 6162 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530956 6162 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530958 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530961 6162 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530964 6162 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530967 6162 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530969 6162 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:47.548067 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530972 6162 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530975 6162 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530980 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530983 6162 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530985 6162 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530988 6162 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530991 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530995 6162 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:54:47.530999 6162 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.531051 6162 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.531976 6162 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.532028 6162 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.532217 6162 server.go:1014] "Starting client certificate rotation" Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.532369 6162 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.532439 6162 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:48:36 +0000 UTC" deadline="2028-05-27 18:16:33.254630797 +0000 UTC" Oct 30 21:54:47.548552 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.532478 6162 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13796h21m45.722156119s" Oct 30 21:54:47.550809 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.532673 6162 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:54:47.550809 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.533721 6162 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:54:47.550809 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.534830 6162 log.go:25] "Validated CRI v1 runtime API" Oct 30 21:54:47.550809 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.536681 6162 log.go:25] "Validated CRI v1 image API" Oct 30 21:54:47.550809 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.537384 6162 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 21:54:47.550809 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.539210 6162 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ccc73da7-dd6c-4ab3-94c2-4f8006734b41:/dev/nvme0n1p3 edbbff69-02f5-49f8-9b9a-0a58c3718a52:/dev/nvme0n1p4] Oct 30 21:54:47.551026 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.539224 6162 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1f838f1b4c8bb735b6376906bc641c5637cdd8a34f7377a9129af7a42584a93a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1f838f1b4c8bb735b6376906bc641c5637cdd8a34f7377a9129af7a42584a93a/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/211da46cd89d8a2683a380aafd9b1470e9d711a1cf5fb98a2c650fd4c854d846/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/211da46cd89d8a2683a380aafd9b1470e9d711a1cf5fb98a2c650fd4c854d846/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3160aa5c6c364d13f474b1848d12e730e666b79fb6a6432b24efeca955104daf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3160aa5c6c364d13f474b1848d12e730e666b79fb6a6432b24efeca955104daf/userdata/shm major:0 minor:355 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/38eb4b0469652750fbd165ee615b1c0ea6604c4410a54e305106a3ab185acc66/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/38eb4b0469652750fbd165ee615b1c0ea6604c4410a54e305106a3ab185acc66/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/505c5178fac15656557970f29fd3c53cadb91477f59d4a5aea8b85ae026660bc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/505c5178fac15656557970f29fd3c53cadb91477f59d4a5aea8b85ae026660bc/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/589b2e5248fc104a4c97a90fdad9233e13a54df7cb324476a8a2b3919d7ae50d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/589b2e5248fc104a4c97a90fdad9233e13a54df7cb324476a8a2b3919d7ae50d/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5c4ddeea7ae954369478c5cbe80e112a606ad07ebd8fc232bdbe2429ebabad7c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5c4ddeea7ae954369478c5cbe80e112a606ad07ebd8fc232bdbe2429ebabad7c/userdata/shm major:0 minor:247 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/67bd0f441956947338a01e9c55ddea4e594772978a787fbd1393aa4fb9dd24ac/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/67bd0f441956947338a01e9c55ddea4e594772978a787fbd1393aa4fb9dd24ac/userdata/shm major:0 minor:85 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/69cd1a6863098e9b176057168ccad4415b5042fc046884436d36260dbb307ad0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/69cd1a6863098e9b176057168ccad4415b5042fc046884436d36260dbb307ad0/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/886d486070bcfb8eea7b35339bcb889d5e282d3a7f94a980edd45d4eac524a96/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/886d486070bcfb8eea7b35339bcb889d5e282d3a7f94a980edd45d4eac524a96/userdata/shm major:0 minor:320 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/97311951b7be4912c1d3fa9db163adb2684e0b06e013b1b8ba47f88e4cf8228c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/97311951b7be4912c1d3fa9db163adb2684e0b06e013b1b8ba47f88e4cf8228c/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a594d750c7b9c30f0261589d87b933d8e86209f2f59105f5088d66748ac3fe9d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a594d750c7b9c30f0261589d87b933d8e86209f2f59105f5088d66748ac3fe9d/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/acd77983543b6a8f6402d2ccdbf4d51d3f7cd78afebe4ac7375fd107ed6a7722/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/acd77983543b6a8f6402d2ccdbf4d51d3f7cd78afebe4ac7375fd107ed6a7722/userdata/shm major:0 minor:285 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/be9e1e1fc891df849ed2501b8a0c4623802f9bf445a5c29e2c48b377b38b283e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/be9e1e1fc891df849ed2501b8a0c4623802f9bf445a5c29e2c48b377b38b283e/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c0fd027d85db47015b0e3ddae316fdbabbf26a350e41e91cd84cdb5c8aa33f9c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c0fd027d85db47015b0e3ddae316fdbabbf26a350e41e91cd84cdb5c8aa33f9c/userdata/shm major:0 minor:267 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c617c861bf98a1700479fb88ee901c3af21d5a47977e102ffa14f76a9cd68b79/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c617c861bf98a1700479fb88ee901c3af21d5a47977e102ffa14f76a9cd68b79/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c78029618cd1d30ea6ca413aa5210ad39f516b5e0c8e966bedd8808efbd94d6d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c78029618cd1d30ea6ca413aa5210ad39f516b5e0c8e966bedd8808efbd94d6d/userdata/shm major:0 minor:354 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cd46fecc1af62a7c464bbc942fa5ef088e0003c2c9fa523acff9dd9837da973d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cd46fecc1af62a7c464bbc942fa5ef088e0003c2c9fa523acff9dd9837da973d/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e7caac8dee3bbf54acbd122c78992e4df661f493904c8ef6d1c4a6b0df473005/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e7caac8dee3bbf54acbd122c78992e4df661f493904c8ef6d1c4a6b0df473005/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f15b6755d727ab1c0f81e3e3e091afc301d1b2e8a39e9b94505e9041d6d3e88f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f15b6755d727ab1c0f81e3e3e091afc301d1b2e8a39e9b94505e9041d6d3e88f/userdata/shm major:0 minor:358 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~projected/kube-api-access-plhqb:{mountpoint:/var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~projected/kube-api-access-plhqb major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2801dd83-9869-447f-8e3f-6e70d12b7d21/volumes/kubernetes.io~projected/kube-api-access-f92ch:{mountpoint:/var/lib/kubelet/pods/2801dd83-9869-447f-8e3f-6e70d12b7d21/volumes/kubernetes.io~projected/kube-api-access-f92ch major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2801dd83-9869-447f-8e3f-6e70d12b7d21/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/2801dd83-9869-447f-8e3f-6e70d12b7d21/volumes/kubernetes.io~secret/cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e/volumes/kubernetes.io~projected/kube-api-access-d8567:{mountpoint:/var/lib/kubelet/pods/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e/volumes/kubernetes.io~projected/kube-api-access-d8567 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e/volumes/kubernetes.io~secret/metrics-certs major:0 minor:352 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:253 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/web-config/alertmanager/9 major:0 minor:258 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/web-config/config-reloader/6 major:0 minor:258 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:258 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~empty-dir/config-out major:0 minor:263 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~projected/kube-api-access-lqk7s:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~projected/kube-api-access-lqk7s major:0 minor:266 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~projected/tls-assets major:0 minor:261 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:253 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/config-volume major:0 minor:260 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:264 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:262 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/web-config major:0 minor:258 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55631fc0-8b3a-40ac-96a0-786f08ed12ca/volumes/kubernetes.io~projected/kube-api-access-vnvxz:{mountpoint:/var/lib/kubelet/pods/55631fc0-8b3a-40ac-96a0-786f08ed12ca/volumes/kubernetes.io~projected/kube-api-access-vnvxz major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/70a9e9bc-0057-4e34-9bf2-396832ce4e76/volumes/kubernetes.io~projected/kube-api-access-v2r76:{mountpoint:/var/lib/kubelet/pods/70a9e9bc-0057-4e34-9bf2-396832ce4e76/volumes/kubernetes.io~projected/kube-api-access-v2r76 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/70a9e9bc-0057-4e34-9bf2-396832ce4e76/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/70a9e9bc-0057-4e34-9bf2-396832ce4e76/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/770590b4-fbb4-4f6d-9187-09ceb5ba873b/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/770590b4-fbb4-4f6d-9187-09ceb5ba873b/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d07c193-84b5-44e2-bf42-fb645c2f0f35/volumes/kubernetes.io~projected/kube-api-access-kxft2:{mountpoint:/var/lib/kubelet/pods/7d07c193-84b5-44e2-bf42-fb645c2f0f35/volumes/kubernetes.io~projected/kube-api-access-kxft2 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d07c193-84b5-44e2-bf42-fb645c2f0f35/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/7d07c193-84b5-44e2-bf42-fb645c2f0f35/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7edf8063-b8bf-429f-90aa-aeed3a525670/volumes/kubernetes.io~projected/kube-api-access-pl84k:{mountpoint:/var/lib/kubelet/pods/7edf8063-b8bf-429f-90aa-aeed3a525670/volumes/kubernetes.io~projected/kube-api-access-pl84k major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ee54e3e-efb7-461c-9973-90d768900251/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/7ee54e3e-efb7-461c-9973-90d768900251/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ee54e3e-efb7-461c-9973-90d768900251/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/7ee54e3e-efb7-461c-9973-90d768900251/volumes/kubernetes.io~empty-dir/tmp major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ee54e3e-efb7-461c-9973-90d768900251/volumes/kubernetes.io~projected/kube-api-access-cdzfk:{mountpoint:/var/lib/kubelet/pods/7ee54e3e-efb7-461c-9973-90d768900251/volumes/kubernetes.io~projected/kube-api-access-cdzfk major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87f0bae4-f0d6-49ac-80f4-2e31394c0764/volumes/kubernetes.io~projected/kube-api-access-rqqdg:{mountpoint:/var/lib/kubelet/pods/87f0bae4-f0d6-49ac-80f4-2e31394c0764/volumes/kubernetes.io~projected/kube-api-access-rqqdg major:0 minor:353 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/volumes/kubernetes.io~projected/kube-api-access-c2djr:{mountpoint:/var/lib/kubelet/pods/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/volumes/kubernetes.io~projected/kube-api-access-c2djr major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:245 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~projected/kube-api-access-lstz5:{mountpoint:/var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~projected/kube-api-access-lstz5 major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:278 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/volumes/kubernetes.io~projected/kube-api-access-kmk62:{mountpoint:/var/lib/kubelet/pods/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/volumes/kubernetes.io~projected/kube-api-access-kmk62 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a12383c-22ae-47a8-b17a-0bcb91c998f6/volumes/kubernetes.io~projected/kube-api-access-f7sb4:{mountpoint:/var/lib/kubelet/pods/9a12383c-22ae-47a8-b17a-0bcb91c998f6/volumes/kubernetes.io~projected/kube-api-access-f7sb4 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8/volumes/kubernetes.io~projected/kube-api-access-25s8p:{mountpoint:/var/lib/kubelet/pods/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8/volumes/kubernetes.io~projected/kube-api-access-25s8p major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c97dc8b9-40b5-4277-93b5-2c31bad3c352/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/c97dc8b9-40b5-4277-93b5-2c31bad3c352/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:348 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d0eae92f-5b3d-408a-9049-39e00d341085/volumes/kubernetes.io~projected/kube-api-access-khnfl:{mountpoint:/var/lib/kubelet/pods/d0eae92f-5b3d-408a-9049-39e00d341085/volumes/kubernetes.io~projected/kube-api-access-khnfl major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f49231a6-2242-467f-85c2-c526cafef9cb/volumes/kubernetes.io~projected/kube-api-access-sw722:{mountpoint:/var/lib/kubelet/pods/f49231a6-2242-467f-85c2-c526cafef9cb/volumes/kubernetes.io~projected/kube-api-access-sw722 major:0 minor:60 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/9fd500895188d4b0dbf6948d902226c81cf703afad80088f88e8493d1f32413a/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/673cabbb4b0569043133791d311fbe40ee175272f8f47e787f18ff5b44ce6132/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/55ca3422aff1ad9a43350b36f9ec73d46176938ffccdc2dd7bc26a8b0c205ea3/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/957b178ed14b88298ae9f494310eb5a1db2b11cceb6217d212771480ad7a538a/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/2f80705788eef5b9d90dd2770518a2bf42484a3cd87183b7c722b4ce32a84e86/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/fc88493f2c076b59dc46520870027aef808008d9ffa5641cc63d450b56fa6cb6/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/42d0d2ab2810ffec7b0708a2e07136834d8ee29edf99bd5a07264942c5b54885/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/8c059e22ab5d0ef935be9520c2062458a3e9a2ce9bd097aadaf6646c5ea34218/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/65fb728f5bed9b0a09ece1d5d206bda25fdd057fbf2d23813e03174033eef87c/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/35fbac4a9ad3789ea2cef6584134c048963334e88b2faebc8bf44dc89db45e9d/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/df40b863bdf7cb1b8d97bb7fa2d3f8a846a64cfde39d037650f193b03e59e149/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-140:{mountpoint:/var/lib/containers/storage/overlay/db25e0fc825e17c6f1c3f75ac4aa26e53595d9102b19a42eb520f798b0f3362f/merged major:0 minor:140 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/485b90153dde59f48b4209fdec1ba994b11a3cd6642ab241b2e21188236d52f8/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/6c723a6a4d64cf2b51cd721f26a8648167213df3e377e157d4da846ec4ff252c/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-159:{mountpoint:/var/lib/containers/storage/overlay/65d99b7204534364c2ad81da8335b07d2dc8efb09e4982b7b6e632135d6dec37/merged major:0 minor:159 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/aef0b950c04cc568e141fd77dbb667acf5ab0c11a20e90c1e722b649fa4983b9/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/31d0be90071cea63f810b32fe3a1c8015d9bb409be1ab3b25236e428ad512ef9/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/5587b416aaac3bf09d04b0aeab74bb25e7381aee299874704c6a4b5034599b76/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/ea6128ea7cf42f8f82bef342017904d075f6d9553ecc89ed564a772a7900770a/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/d69ab2569cdf52af3217808c5ef68efeb765dee1cfd35432a525068106e68486/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/87e943dcb4c616ca3d0a106cab729ead1f6ee1fb4d1533e1376fe3dfdd748c39/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/e3ded04ddcd2176a3369c71989d30255e20e9653e4bb44633a741becb211fe5e/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/7cc70dfbd16d77e6d96fb20d9cbb3ee74de10568280a6b4c4ae12476f7d392fd/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/ec5e5aba44c768475f15f3522cecfcafbc9550e5ca11956c9d7ef44370f3fe9d/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/d33c491e183d65387a3418688b5d93bb02b05197e499a7bb2928a58ec800041e/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/ec117024fcf05f93bd4bd3c28efbd6426fe5803683f04b0da3bdffd7dc750ae6/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/59ff6deb39d67bb74f2c4c96b9d97b7e55beee68986f74b6d89e96b81b34e7aa/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/dadf08f0db146fee5a435afda5b94cc4862d279a20dcc43d9ca46c586832d5be/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/8c6690505492e933cbb3be3fe7262f374f6962a8af2ff3a544b51849f50f0465/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-249:{mountpoint:/var/lib/containers/storage/overlay/ad5b03a4309d25b7b88d39d2443bcdd8dc9f59bbc3aa53f880057d80da2d6655/merged major:0 minor:249 fsType:overlay blockSize:0} overlay_0-251:{mountpoint:/var/lib/containers/storage/overlay/ee11722f0f80a6f7006c214cde1b67f518ed4a42c7ea32fd80edb6e83f16696c/merged major:0 minor:251 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/b3aa8a6d877c0d1055a662ccd803da8e5000479574c2e518bdc1a427a1f961b2/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/8c0ef4b70d42a28e729789c229e9d8ec42d6f3f84f95e728c9e2ddae373879af/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/d83acb063b0186a8f8703fee706c7fd4ccf66b984f10717cddf3afc4bf72ccd1/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/a4a2ac6a94377d63fec7e904762d7f7711a549cc0142b480693eb0e881314bf1/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/06bd7cd4d8e0f383c64018b74617708c8374ef1029ee369b400ec7ccb9496971/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-295:{mountpoint:/var/lib/containers/storage/overlay/a262a2c4ba1726c00136dda508d3474deb14a3c6161591df482344277ba3d3a0/merged major:0 minor:295 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/28156e4b56605afd7cd370c2d6de6563000df99c20a168d4c983393c450b5d12/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/f31bd9e26d648276fc678ea819a5aa85e7ce14cce955237f6c17aeddf70f8ee5/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/e208ed2747f496a9ea98caa4c2806f581972c1382b210194a27056d65712a5f9/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/7a2022ef604c5027d7189be95e37c2f887ba3d4121442bb5f89479abee5fcd3c/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/fbf401694749fa77ff756c55a335e4a0c10218650c50736cf26f6919b17ca492/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/8c296c434d337b9add8d5d349d4d08fd0d7f5e972912b225ffb45e568f558358/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-331:{mountpoint:/var/lib/containers/storage/overlay/4dd883eb0472a3dcb3fcf24efcfbc2f37052404cce5607913334f7f6b734c73c/merged major:0 minor:331 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/15ac4ceaf59e7b3f8ce19ab69222685ab62ed1e013d6d528658289b4143aeebb/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-343:{mountpoint:/var/lib/containers/storage/overlay/6819ecacc68581635ac19d43113ad566b28e583f03d4111e8d78dc55a0b8f9ba/merged major:0 minor:343 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/376f274ba17271eaa1df6204e6d65c8eb3699d557b5f4e60a12cc64c1dd527fa/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/01e8503052ac7555bb9c6064565bc9bc86d85f72bfc31c1782fafedeccabca67/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/439437858cc89f4e4b825326ade73140d8b9c57dad66461cdd4ff0b939b63719/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/aa79fc0967fc05c2204ebcc798d27413b0b9e500e9822f5944cd7fe57cf56a86/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/b6014e7aeefc0f7397e13cb069a950d7549925c844106655590392cab7a0d964/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/72529e465b2ed10cfe7619d4809d57bdb8a0a83a8797624d89692c9989077427/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-379:{mountpoint:/var/lib/containers/storage/overlay/133e4c7caedffefd275b1cf203112545d4434d0a98f1f46902e4b6cd87109764/merged major:0 minor:379 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/41b80b73308e0ef1495bfa6de6e64d8b48155a3d3f03d3a9711eede591463966/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/f044f3e651887c9123243406ec4d48b986f074b4711f1b24c998228d779afb7d/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-71:{mountpoint:/var/lib/containers/storage/overlay/eaf7a7f52e8ea908012e39395c0dced9cea1617b5e1576bc030276041c509bc2/merged major:0 minor:71 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/31588daa544aa0a471b2993a65126bde81c69f99e10455f7af0ff6098bae69a0/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/34f2da63469af7dce616199fbc9912b6c440e05b8de2f682665dc2552bec3428/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/18a7ee2b49af6991b9f881023a9b3d5f10db053cb5f343c385d44e541a54e745/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/0d2401842bb4551a3c2760b131f03a35f57ad59b8e385a0a48c4b32668709ada/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/1c936d24555e1374b07b9163beb9eebe5bfedfb3e498abacf371ca9ed519b33d/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/c19d89a1476dcf1ecd52d998d6979bf3e3f8583114bd4a2a290eda741b50702c/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/cc2c7834cb8145c46d689240450de4e33c7c0ac568634efa96c237a7033cc173/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.547407 6162 manager.go:217] Machine: {Timestamp:2026-10-30 21:54:47.546949666 +0000 UTC m=+0.056821218 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100157 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2183ba6136f54bd8fea572536f9ab5 SystemUUID:ec2183ba-6136-f54b-d8fe-a572536f9ab5 BootID:759ddd8f-86ce-4f1a-8387-0a211c6e1969 Filesystems:[{Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:258 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:316 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3160aa5c6c364d13f474b1848d12e730e666b79fb6a6432b24efeca955104daf/userdata/shm DeviceMajor:0 DeviceMinor:355 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/volumes/kubernetes.io~projected/kube-api-access-kmk62 DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/67bd0f441956947338a01e9c55ddea4e594772978a787fbd1393aa4fb9dd24ac/userdata/shm DeviceMajor:0 DeviceMinor:85 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-343 DeviceMajor:0 DeviceMinor:343 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7edf8063-b8bf-429f-90aa-aeed3a525670/volumes/kubernetes.io~projected/kube-api-access-pl84k DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:263 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:278 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:352 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:260 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c97dc8b9-40b5-4277-93b5-2c31bad3c352/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:348 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-71 DeviceMajor:0 DeviceMinor:71 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2801dd83-9869-447f-8e3f-6e70d12b7d21/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:203 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:253 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:259 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-379 DeviceMajor:0 DeviceMinor:379 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/7ee54e3e-efb7-461c-9973-90d768900251/volumes/kubernetes.io~projected/kube-api-access-cdzfk DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5c4ddeea7ae954369478c5cbe80e112a606ad07ebd8fc232bdbe2429ebabad7c/userdata/shm DeviceMajor:0 DeviceMinor:247 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a594d750c7b9c30f0261589d87b933d8e86209f2f59105f5088d66748ac3fe9d/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d0eae92f-5b3d-408a-9049-39e00d341085/volumes/kubernetes.io~projected/kube-api-access-khnfl DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/55631fc0-8b3a-40ac-96a0-786f08ed12ca/volumes/kubernetes.io~projected/kube-api-access-vnvxz DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e/volumes/kubernetes.io~projected/kube-api-access-d8567 DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/70a9e9bc-0057-4e34-9bf2-396832ce4e76/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~projected/kube-api-access-plhqb DeviceMajor:0 DeviceMinor:319 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1f838f1b4c8bb735b6376906bc641c5637cdd8a34f7377a9129af7a42584a93a/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/70a9e9bc-0057-4e34-9bf2-396832ce4e76/volumes/kubernetes.io~projected/kube-api-access-v2r76 DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:315 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f15b6755d727ab1c0f81e3e3e091afc301d1b2e8a39e9b94505e9041d6d3e88f/userdata/shm DeviceMajor:0 DeviceMinor:358 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/589b2e5248fc104a4c97a90fdad9233e13a54df7cb324476a8a2b3919d7ae50d/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-159 DeviceMajor:0 DeviceMinor:159 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2801dd83-9869-447f-8e3f-6e70d12b7d21/volumes/kubernetes.io~projected/kube-api-access-f92ch DeviceMajor:0 DeviceMinor:204 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:261 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7d07c193-84b5-44e2-bf42-fb645c2f0f35/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:317 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-331 DeviceMajor:0 DeviceMinor:331 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/770590b4-fbb4-4f6d-9187-09ceb5ba873b/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/7ee54e3e-efb7-461c-9973-90d768900251/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f49231a6-2242-467f-85c2-c526cafef9cb/volumes/kubernetes.io~projected/kube-api-access-sw722 DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:245 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/38eb4b0469652750fbd165ee615b1c0ea6604c4410a54e305106a3ab185acc66/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:253 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cd46fecc1af62a7c464bbc942fa5ef088e0003c2c9fa523acff9dd9837da973d/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/69cd1a6863098e9b176057168ccad4415b5042fc046884436d36260dbb307ad0/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~projected/kube-api-access-lqk7s DeviceMajor:0 DeviceMinor:266 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9a12383c-22ae-47a8-b17a-0bcb91c998f6/volumes/kubernetes.io~projected/kube-api-access-f7sb4 DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7d07c193-84b5-44e2-bf42-fb645c2f0f35/volumes/kubernetes.io~projected/kube-api-access-kxft2 DeviceMajor:0 DeviceMinor:202 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/97311951b7be4912c1d3fa9db163adb2684e0b06e013b1b8ba47f88e4cf8228c/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/volumes/kubernetes.io~projected/kube-api-access-c2djr DeviceMajor:0 DeviceMinor:246 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c0fd027d85db47015b0e3ddae316fdbabbf26a350e41e91cd84cdb5c8aa33f9c/userdata/shm DeviceMajor:0 DeviceMinor:267 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/211da46cd89d8a2683a380aafd9b1470e9d711a1cf5fb98a2c650fd4c854d846/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-249 DeviceMajor:0 DeviceMinor:249 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/acd77983543b6a8f6402d2ccdbf4d51d3f7cd78afebe4ac7375fd107ed6a7722/userdata/shm DeviceMajor:0 DeviceMinor:285 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c78029618cd1d30ea6ca413aa5210ad39f516b5e0c8e966bedd8808efbd94d6d/userdata/shm DeviceMajor:0 DeviceMinor:354 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c617c861bf98a1700479fb88ee901c3af21d5a47977e102ffa14f76a9cd68b79/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e7caac8dee3bbf54acbd122c78992e4df661f493904c8ef6d1c4a6b0df473005/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/505c5178fac15656557970f29fd3c53cadb91477f59d4a5aea8b85ae026660bc/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/886d486070bcfb8eea7b35339bcb889d5e282d3a7f94a980edd45d4eac524a96/userdata/shm DeviceMajor:0 DeviceMinor:320 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:258 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/be9e1e1fc891df849ed2501b8a0c4623802f9bf445a5c29e2c48b377b38b283e/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:264 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:262 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:258 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:258 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8/volumes/kubernetes.io~projected/kube-api-access-25s8p DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:283 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:241 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-251 DeviceMajor:0 DeviceMinor:251 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-295 DeviceMajor:0 DeviceMinor:295 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-140 DeviceMajor:0 DeviceMinor:140 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:282 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:265 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8883c3b4-99a3-4933-942c-e8e7fc999348/volumes/kubernetes.io~projected/kube-api-access-lstz5 DeviceMajor:0 DeviceMinor:284 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0d137e6f-4945-4476-8d93-feb093738387/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:318 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/87f0bae4-f0d6-49ac-80f4-2e31394c0764/volumes/kubernetes.io~projected/kube-api-access-rqqdg DeviceMajor:0 DeviceMinor:353 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/7ee54e3e-efb7-461c-9973-90d768900251/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:3160aa5c6c364d1 MacAddress:86:28:f5:20:11:10 Speed:10000 Mtu:8901} {Name:69cd1a6863098e9 MacAddress:36:f4:f5:bc:09:50 Speed:10000 Mtu:8901} {Name:886d486070bcfb8 MacAddress:4a:0a:6b:b6:9a:e1 Speed:10000 Mtu:8901} {Name:97311951b7be491 MacAddress:9e:84:c4:21:a5:f0 Speed:10000 Mtu:8901} {Name:acd77983543b6a8 MacAddress:b2:f6:9d:40:5f:9b Speed:10000 Mtu:8901} {Name:be9e1e1fc891df8 MacAddress:2a:a8:ac:eb:c4:94 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d2:68:7d:e1 Speed:0 Mtu:9001} {Name:br-int MacAddress:7e:bb:f3:1a:b0:fb Speed:0 Mtu:8901} {Name:c0fd027d85db470 MacAddress:e2:a6:23:af:a0:54 Speed:10000 Mtu:8901} {Name:c78029618cd1d30 MacAddress:de:cc:86:f7:ab:31 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d2:68:7d:e1 Speed:0 Mtu:9001} {Name:f15b6755d727ab1 MacAddress:5e:81:1c:72:89:f4 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:a6:a2:c3:17:0b:30 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:2e:bb:d4:4b:0a:9c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.547767 6162 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.547805 6162 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548118 6162 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548139 6162 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548253 6162 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548262 6162 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548271 6162 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548284 6162 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548348 6162 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548486 6162 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548583 6162 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548614 6162 kubelet.go:493] "Attempting to sync node with API server" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548626 6162 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548635 6162 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548644 6162 kubelet.go:405] "Adding apiserver pod source" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.548651 6162 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.549970 6162 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.549989 6162 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:54:47.551272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.550940 6162 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 21:54:47.553383 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553369 6162 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 21:54:47.553383 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553383 6162 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:54:47.553499 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553489 6162 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 21:54:47.553674 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553663 6162 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 21:54:47.553708 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553693 6162 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 21:54:47.553787 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553778 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 21:54:47.553826 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553792 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 21:54:47.553826 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553799 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 21:54:47.553826 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553805 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 21:54:47.553826 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553810 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 21:54:47.553934 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553830 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 21:54:47.553934 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553837 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 21:54:47.553934 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553842 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 21:54:47.553934 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553849 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 21:54:47.553934 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553855 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 21:54:47.553934 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553863 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 21:54:47.553934 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553873 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 21:54:47.553934 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553895 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 21:54:47.553934 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.553901 6162 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 21:54:47.557051 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.557037 6162 server.go:1263] "Started kubelet" Oct 30 21:54:47.557157 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.557110 6162 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 21:54:47.558187 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.557140 6162 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 21:54:47.558187 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.557567 6162 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 21:54:47.557550 ip-10-0-135-200 systemd[1]: Started Kubernetes Kubelet. Oct 30 21:54:47.558468 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.558448 6162 server.go:317] "Adding debug handlers to kubelet server" Oct 30 21:54:47.558560 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.558466 6162 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 21:54:47.560924 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.560895 6162 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 21:54:47.561699 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.561159 6162 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 21:54:47.561699 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.561216 6162 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:48:38 +0000 UTC" deadline="2028-06-09 14:49:52.921286305 +0000 UTC" Oct 30 21:54:47.561699 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.561248 6162 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14104h55m5.360041762s" Oct 30 21:54:47.561699 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.561252 6162 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 21:54:47.561699 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.561264 6162 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 21:54:47.561699 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.561329 6162 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 21:54:47.561699 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:54:47.561582 6162 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Oct 30 21:54:47.564403 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564374 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d137e6f-4945-4476-8d93-feb093738387" volumeName="kubernetes.io/projected/0d137e6f-4945-4476-8d93-feb093738387-kube-api-access-plhqb" seLinuxMountContext="" Oct 30 21:54:47.564403 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564402 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-config-volume" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564422 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564431 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7edf8063-b8bf-429f-90aa-aeed3a525670" volumeName="kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-daemon-config" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564446 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7edf8063-b8bf-429f-90aa-aeed3a525670" volumeName="kubernetes.io/projected/7edf8063-b8bf-429f-90aa-aeed3a525670-kube-api-access-pl84k" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564457 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70a9e9bc-0057-4e34-9bf2-396832ce4e76" volumeName="kubernetes.io/projected/70a9e9bc-0057-4e34-9bf2-396832ce4e76-kube-api-access-v2r76" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564465 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1" volumeName="kubernetes.io/projected/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-kube-api-access-c2djr" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564476 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d0eae92f-5b3d-408a-9049-39e00d341085" volumeName="kubernetes.io/projected/d0eae92f-5b3d-408a-9049-39e00d341085-kube-api-access-khnfl" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564492 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-metrics-client-ca" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564503 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d137e6f-4945-4476-8d93-feb093738387" volumeName="kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-telemeter-trusted-ca-bundle" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564527 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2801dd83-9869-447f-8e3f-6e70d12b7d21" volumeName="kubernetes.io/projected/2801dd83-9869-447f-8e3f-6e70d12b7d21-kube-api-access-f92ch" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564535 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-config-out" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564553 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-web-config" seLinuxMountContext="" Oct 30 21:54:47.564572 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564561 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d07c193-84b5-44e2-bf42-fb645c2f0f35" volumeName="kubernetes.io/projected/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-api-access-kxft2" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564587 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d137e6f-4945-4476-8d93-feb093738387" volumeName="kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564601 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" volumeName="kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564617 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f49231a6-2242-467f-85c2-c526cafef9cb" volumeName="kubernetes.io/projected/f49231a6-2242-467f-85c2-c526cafef9cb-kube-api-access-sw722" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564625 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d137e6f-4945-4476-8d93-feb093738387" volumeName="kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-metrics-client-ca" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564633 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ee54e3e-efb7-461c-9973-90d768900251" volumeName="kubernetes.io/projected/7ee54e3e-efb7-461c-9973-90d768900251-kube-api-access-cdzfk" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564643 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410" volumeName="kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-script-lib" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564656 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a12383c-22ae-47a8-b17a-0bcb91c998f6" volumeName="kubernetes.io/projected/9a12383c-22ae-47a8-b17a-0bcb91c998f6-kube-api-access-f7sb4" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564666 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" volumeName="kubernetes.io/projected/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-kube-api-access-25s8p" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564679 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d137e6f-4945-4476-8d93-feb093738387" volumeName="kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564692 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70a9e9bc-0057-4e34-9bf2-396832ce4e76" volumeName="kubernetes.io/configmap/70a9e9bc-0057-4e34-9bf2-396832ce4e76-config-volume" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564703 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d07c193-84b5-44e2-bf42-fb645c2f0f35" volumeName="kubernetes.io/empty-dir/7d07c193-84b5-44e2-bf42-fb645c2f0f35-data-volume" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564720 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ee54e3e-efb7-461c-9973-90d768900251" volumeName="kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-tmp" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564735 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1" volumeName="kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-metrics-client-ca" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564744 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d137e6f-4945-4476-8d93-feb093738387" volumeName="kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-telemeter-client-tls" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564763 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2801dd83-9869-447f-8e3f-6e70d12b7d21" volumeName="kubernetes.io/secret/2801dd83-9869-447f-8e3f-6e70d12b7d21-cert" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564771 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-kube-api-access-lqk7s" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564787 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8883c3b4-99a3-4933-942c-e8e7fc999348" volumeName="kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-metrics-server-audit-profiles" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564831 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8883c3b4-99a3-4933-942c-e8e7fc999348" volumeName="kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-client-certs" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564850 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1" volumeName="kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-tls" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564859 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8883c3b4-99a3-4933-942c-e8e7fc999348" volumeName="kubernetes.io/projected/8883c3b4-99a3-4933-942c-e8e7fc999348-kube-api-access-lstz5" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564871 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8883c3b4-99a3-4933-942c-e8e7fc999348" volumeName="kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-client-ca-bundle" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564892 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410" volumeName="kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-config" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564900 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70a9e9bc-0057-4e34-9bf2-396832ce4e76" volumeName="kubernetes.io/empty-dir/70a9e9bc-0057-4e34-9bf2-396832ce4e76-tmp-dir" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564920 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" volumeName="kubernetes.io/projected/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-kube-api-access-d8567" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564932 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-main-db" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564948 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1" volumeName="kubernetes.io/empty-dir/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-textfile" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564961 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410" volumeName="kubernetes.io/secret/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564968 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-cluster-tls-config" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564981 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d07c193-84b5-44e2-bf42-fb645c2f0f35" volumeName="kubernetes.io/configmap/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564989 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.564999 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-tls-assets" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565008 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-main-tls" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565022 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70a9e9bc-0057-4e34-9bf2-396832ce4e76" volumeName="kubernetes.io/secret/70a9e9bc-0057-4e34-9bf2-396832ce4e76-metrics-tls" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565034 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="770590b4-fbb4-4f6d-9187-09ceb5ba873b" volumeName="kubernetes.io/configmap/770590b4-fbb4-4f6d-9187-09ceb5ba873b-konnectivity-ca" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565042 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="770590b4-fbb4-4f6d-9187-09ceb5ba873b" volumeName="kubernetes.io/secret/770590b4-fbb4-4f6d-9187-09ceb5ba873b-agent-certs" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565049 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1" volumeName="kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-accelerators-collector-config" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565062 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8883c3b4-99a3-4933-942c-e8e7fc999348" volumeName="kubernetes.io/empty-dir/8883c3b4-99a3-4933-942c-e8e7fc999348-audit-log" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565069 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7edf8063-b8bf-429f-90aa-aeed3a525670" volumeName="kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-cni-binary-copy" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565082 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87f0bae4-f0d6-49ac-80f4-2e31394c0764" volumeName="kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565095 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8883c3b4-99a3-4933-942c-e8e7fc999348" volumeName="kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-tls" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565101 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410" volumeName="kubernetes.io/projected/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-kube-api-access-kmk62" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565116 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" volumeName="kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-binary-copy" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565141 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c97dc8b9-40b5-4277-93b5-2c31bad3c352" volumeName="kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565150 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f49231a6-2242-467f-85c2-c526cafef9cb" volumeName="kubernetes.io/configmap/f49231a6-2242-467f-85c2-c526cafef9cb-serviceca" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565160 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d137e6f-4945-4476-8d93-feb093738387" volumeName="kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-federate-client-tls" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565173 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565182 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d0eae92f-5b3d-408a-9049-39e00d341085" volumeName="kubernetes.io/empty-dir/d0eae92f-5b3d-408a-9049-39e00d341085-tmp-dir" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565189 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d6ffc6b-7858-438b-a24f-94a882233c63" volumeName="kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565204 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55631fc0-8b3a-40ac-96a0-786f08ed12ca" volumeName="kubernetes.io/projected/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kube-api-access-vnvxz" seLinuxMountContext="" Oct 30 21:54:47.565181 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565219 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1" volumeName="kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565235 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b0d4d6c-d8f6-4ea5-930c-d97120dd189e" volumeName="kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs" seLinuxMountContext="" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565244 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d137e6f-4945-4476-8d93-feb093738387" volumeName="kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-serving-certs-ca-bundle" seLinuxMountContext="" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565251 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d07c193-84b5-44e2-bf42-fb645c2f0f35" volumeName="kubernetes.io/secret/7d07c193-84b5-44e2-bf42-fb645c2f0f35-insights-runtime-extractor-tls" seLinuxMountContext="" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565260 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ee54e3e-efb7-461c-9973-90d768900251" volumeName="kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-etc-tuned" seLinuxMountContext="" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565270 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8883c3b4-99a3-4933-942c-e8e7fc999348" volumeName="kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565277 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410" volumeName="kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-env-overrides" seLinuxMountContext="" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565289 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a12383c-22ae-47a8-b17a-0bcb91c998f6" volumeName="kubernetes.io/configmap/9a12383c-22ae-47a8-b17a-0bcb91c998f6-iptables-alerter-script" seLinuxMountContext="" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565298 6162 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" volumeName="kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565306 6162 reconstruct.go:97] "Volume reconstruction finished" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.565310 6162 reconciler.go:29] "Reconciler: start to sync state" Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.566198 6162 factory.go:55] Registering systemd factory Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.566217 6162 factory.go:223] Registration of the systemd container factory successfully Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.566725 6162 factory.go:153] Registering CRI-O factory Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.566744 6162 factory.go:223] Registration of the crio container factory successfully Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.566841 6162 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 21:54:47.567272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.566927 6162 factory.go:103] Registering Raw factory Oct 30 21:54:47.568004 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.567316 6162 manager.go:1199] Started watching for new ooms in manager Oct 30 21:54:47.568004 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.567668 6162 manager.go:319] Starting recovery of all containers Oct 30 21:54:47.587381 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.587353 6162 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 21:54:47.589123 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.589099 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 21:54:47.589241 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.589176 6162 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 21:54:47.589241 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.589212 6162 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 21:54:47.589241 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.589232 6162 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 21:54:47.589385 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.589246 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 21:54:47.589385 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:54:47.589288 6162 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 21:54:47.598558 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.598537 6162 generic.go:356] "Generic (PLEG): container finished" podID="b18effbb0686f87752ee78c9d500f5e9" containerID="9e06df71f1a1b67a6846e6253fce25bdcebdbc0c285e105d7d46994aef180d4a" exitCode=0 Oct 30 21:54:47.605671 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.605644 6162 generic.go:356] "Generic (PLEG): container finished" podID="87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1" containerID="47f02eae5e54a955d460cb741adcff9fe49b3edde269790235e529c2d5a72cc6" exitCode=0 Oct 30 21:54:47.605754 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.605721 6162 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 21:54:47.606931 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.606908 6162 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:54:47.607206 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.607187 6162 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:54:47.618559 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.618537 6162 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:54:47.621922 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.621905 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 21:54:47.622238 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.622215 6162 generic.go:356] "Generic (PLEG): container finished" podID="8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410" containerID="603219f6997b236fbec928515821715b331a579c318a196a6393b0e2c21bf659" exitCode=1 Oct 30 21:54:47.625370 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.625344 6162 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="80198ad85351b29611b7477ec785de95ef5b549097c49eb0f8ee0ae961824c6f" exitCode=0 Oct 30 21:54:47.625370 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.625370 6162 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="61cee8ff7e385a9b8f0168693adf867b61e02d3a50ff7610da369621c02efb25" exitCode=0 Oct 30 21:54:47.625520 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.625379 6162 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="e41a3428e4a8c43adcc3f673e1538e164aff03c8ceba9b0cfaf459caccc35952" exitCode=0 Oct 30 21:54:47.625520 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.625386 6162 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="d8e8e18e278ae3df49a0413cca8179c0105fab231ad0f901a5077598a214dc2f" exitCode=0 Oct 30 21:54:47.625520 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.625391 6162 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="857c37390d1800ad384c78f7e07022b8142b31138ab8cff7fd522a70dc00dd0f" exitCode=0 Oct 30 21:54:47.625520 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.625396 6162 generic.go:356] "Generic (PLEG): container finished" podID="a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8" containerID="7a477681649bd06cbe3a8a6d91c84bede908d40eaee50ca83d94063b74fedd74" exitCode=0 Oct 30 21:54:47.628829 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.628802 6162 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:54:47.633403 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.633378 6162 generic.go:356] "Generic (PLEG): container finished" podID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerID="987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26" exitCode=0 Oct 30 21:54:47.658793 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.658776 6162 manager.go:324] Recovery completed Oct 30 21:54:47.677507 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677483 6162 cpu_manager.go:226] "Starting" policy="none" Oct 30 21:54:47.677507 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677503 6162 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 21:54:47.677636 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677524 6162 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 21:54:47.677728 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677711 6162 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 21:54:47.677759 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677730 6162 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 21:54:47.677759 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677754 6162 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 21:54:47.677810 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677760 6162 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 21:54:47.677810 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677766 6162 policy_none.go:50] "Start" Oct 30 21:54:47.677810 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677775 6162 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 21:54:47.677810 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677786 6162 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 21:54:47.677942 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677932 6162 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 21:54:47.677971 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677943 6162 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 21:54:47.677971 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.677948 6162 policy_none.go:44] "Start" Oct 30 21:54:47.682097 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.682072 6162 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 21:54:47.684611 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.684601 6162 manager.go:341] "Starting Device Plugin manager" Oct 30 21:54:47.685237 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:54:47.684623 6162 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 21:54:47.685288 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.685241 6162 server.go:87] "Starting device plugin registration server" Oct 30 21:54:47.685495 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.685484 6162 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 21:54:47.685525 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.685500 6162 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 21:54:47.685620 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.685597 6162 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 21:54:47.685756 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.685715 6162 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 21:54:47.685850 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.685759 6162 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 21:54:47.685850 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.685766 6162 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 21:54:47.685955 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.685843 6162 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:54:47.68574747Z","UUID":"4ca01bda-6aaa-4c80-99bf-402adda2bf4e","Handler":null,"Name":"","Endpoint":""} Oct 30 21:54:47.687671 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:54:47.687644 6162 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 21:54:47.688160 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.688136 6162 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 21:54:47.688240 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.688173 6162 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 21:54:47.689532 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.689493 6162 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal"] Oct 30 21:54:47.690595 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.690547 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" event={"ID":"b18effbb0686f87752ee78c9d500f5e9","Type":"ContainerStarted","Data":"7c39e1af876e71f210367eb5e0cec51c751b7c0bf3515f4272cef1622cf58a11"} Oct 30 21:54:47.690708 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.690601 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" event={"ID":"b18effbb0686f87752ee78c9d500f5e9","Type":"ContainerDied","Data":"9e06df71f1a1b67a6846e6253fce25bdcebdbc0c285e105d7d46994aef180d4a"} Oct 30 21:54:47.690995 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.690631 6162 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.691070 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.690934 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" event={"ID":"b18effbb0686f87752ee78c9d500f5e9","Type":"ContainerStarted","Data":"cd46fecc1af62a7c464bbc942fa5ef088e0003c2c9fa523acff9dd9837da973d"} Oct 30 21:54:47.691135 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.690888 6162 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.691194 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.691166 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" event={"ID":"e328aa15a0f90aee4513670f92d54212","Type":"ContainerStarted","Data":"1653422355e2e1d25005bcdb16cb760b76ce15e6e91b7e9e51dd10f0b031fb36"} Oct 30 21:54:47.691194 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.691192 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" event={"ID":"e328aa15a0f90aee4513670f92d54212","Type":"ContainerStarted","Data":"a594d750c7b9c30f0261589d87b933d8e86209f2f59105f5088d66748ac3fe9d"} Oct 30 21:54:47.724807 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.724756 6162 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:54:47.724807 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:54:47.724796 6162 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.725979 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.725965 6162 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:54:47.726027 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:54:47.725997 6162 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.786562 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.786547 6162 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:54:47.788628 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.788610 6162 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Oct 30 21:54:47.788715 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.788643 6162 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 21:54:47.788715 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.788658 6162 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Oct 30 21:54:47.788715 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.788710 6162 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.806068 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.806048 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e328aa15a0f90aee4513670f92d54212-config\") pod \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" (UID: \"e328aa15a0f90aee4513670f92d54212\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.806153 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.806077 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.806153 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.806094 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.826431 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.826413 6162 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.826505 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.826476 6162 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.906795 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.906763 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e328aa15a0f90aee4513670f92d54212-config\") pod \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" (UID: \"e328aa15a0f90aee4513670f92d54212\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.906948 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.906802 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.906948 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.906846 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.906948 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.906851 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e328aa15a0f90aee4513670f92d54212-config\") pod \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" (UID: \"e328aa15a0f90aee4513670f92d54212\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.906948 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.906886 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:54:47.906948 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:47.906872 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b18effbb0686f87752ee78c9d500f5e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"b18effbb0686f87752ee78c9d500f5e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:54:48.549753 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.549717 6162 apiserver.go:52] "Watching apiserver" Oct 30 21:54:48.604011 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.603984 6162 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 21:54:48.604536 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.604514 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86bf5f57db-g2647","openshift-monitoring/node-exporter-8b4rc","openshift-ovn-kubernetes/ovnkube-node-x949s","openshift-dns/node-resolver-ksczz","openshift-network-operator/iptables-alerter-bff8j","openshift-image-registry/node-ca-5gsg6","openshift-monitoring/alertmanager-main-0","openshift-multus/network-metrics-daemon-hzlsq","openshift-ingress-canary/ingress-canary-89856","openshift-monitoring/telemeter-client-7f49cd584c-q44h7","kube-system/global-pull-secret-syncer-p9l8h","openshift-multus/multus-additional-cni-plugins-4tmvv","openshift-dns/dns-default-2mffv","openshift-insights/insights-runtime-extractor-ttjm8","kube-system/konnectivity-agent-s5hdv","kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29","openshift-cluster-node-tuning-operator/tuned-glhwd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal","openshift-network-diagnostics/network-check-target-q9b4k","openshift-multus/multus-bjm7d"] Oct 30 21:54:48.622531 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622506 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 21:54:48.622531 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622507 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.622744 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622511 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 21:54:48.622744 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622579 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 21:54:48.622744 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622681 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.622744 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622688 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-cggx8\"" Oct 30 21:54:48.622744 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622725 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vv6qp\"" Oct 30 21:54:48.623006 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622792 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.623006 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622831 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.623006 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622842 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-28tsh\"" Oct 30 21:54:48.623006 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622961 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 21:54:48.623006 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.622999 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 21:54:48.623164 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.623041 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.623164 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.623075 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.623164 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.623146 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 21:54:48.623260 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.623202 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-htkkz\"" Oct 30 21:54:48.623376 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.623363 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.623484 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.623470 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cn5n2\"" Oct 30 21:54:48.623759 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.623745 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 21:54:48.623899 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.623887 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nhqdj\"" Oct 30 21:54:48.623991 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.623978 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.624039 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.624019 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.624117 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.624105 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 21:54:48.624117 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.624106 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.629320 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.629308 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-h8qq9\"" Oct 30 21:54:48.630540 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.630529 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 21:54:48.630662 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.630650 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2n5cw\"" Oct 30 21:54:48.630929 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.630914 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-gzm2w\"" Oct 30 21:54:48.630969 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.630954 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hxntv\"" Oct 30 21:54:48.631154 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.631133 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-vwffm\"" Oct 30 21:54:48.631215 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.631200 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v8mh7\"" Oct 30 21:54:48.631287 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.631269 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bv47g\"" Oct 30 21:54:48.631365 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.631352 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 21:54:48.631423 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.631368 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 21:54:48.631423 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.631388 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 21:54:48.631483 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.631427 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8hlnq\"" Oct 30 21:54:48.633446 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.633431 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.633498 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.633486 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 21:54:48.633578 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.633563 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 21:54:48.633622 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.633614 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 21:54:48.633663 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.633629 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.633700 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.633675 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.633700 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.633684 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.633766 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.633706 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.633766 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.633724 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.633886 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.633773 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.634053 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.634038 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 21:54:48.634111 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.634071 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.634111 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.634077 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 21:54:48.634194 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.634111 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 21:54:48.634194 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.634120 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 21:54:48.634194 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.634127 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.634321 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.634215 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 21:54:48.634321 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.634262 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 21:54:48.634321 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.634299 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.634692 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.634678 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 30 21:54:48.635026 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635013 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 21:54:48.635227 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635213 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 30 21:54:48.635330 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635319 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 21:54:48.635394 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635338 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 30 21:54:48.635394 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635357 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Oct 30 21:54:48.635502 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635487 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 21:54:48.635535 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635492 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 21:54:48.635575 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635566 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 21:54:48.635631 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635574 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 21:54:48.635631 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635587 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 21:54:48.635631 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635616 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 21:54:48.635744 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635628 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 21:54:48.635744 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635710 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 21:54:48.635893 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635854 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Oct 30 21:54:48.635893 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635896 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Oct 30 21:54:48.636099 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.635956 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 30 21:54:48.636099 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.636000 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-5mpht\"" Oct 30 21:54:48.636099 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.636007 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Oct 30 21:54:48.636099 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.636041 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 21:54:48.636099 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.636053 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 21:54:48.636099 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.636057 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5kd5n\"" Oct 30 21:54:48.636099 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.636092 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rp7c8\"" Oct 30 21:54:48.636407 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.636118 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 21:54:48.636407 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.636121 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gsmcv\"" Oct 30 21:54:48.636407 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.636261 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c9uib9u4aivsb\"" Oct 30 21:54:48.636407 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.636271 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Oct 30 21:54:48.641962 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.641943 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-x4ghg\"" Oct 30 21:54:48.644806 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.644789 6162 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:54:48.645002 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.644979 6162 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:54:48.645942 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.645923 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Oct 30 21:54:48.646027 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.645941 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 21:54:48.663165 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.663139 6162 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 21:54:48.667934 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.667921 6162 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:54:48.667998 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:54:48.667958 6162 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Oct 30 21:54:48.669337 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.669324 6162 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:54:48.669387 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:54:48.669349 6162 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Oct 30 21:54:48.710269 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710246 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d07c193-84b5-44e2-bf42-fb645c2f0f35-crio-socket\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.710356 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710275 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d07c193-84b5-44e2-bf42-fb645c2f0f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.710356 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710293 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-device-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.710356 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710309 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.710356 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710326 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khnfl\" (UniqueName: \"kubernetes.io/projected/d0eae92f-5b3d-408a-9049-39e00d341085-kube-api-access-khnfl\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:54:48.710476 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710383 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2r76\" (UniqueName: \"kubernetes.io/projected/70a9e9bc-0057-4e34-9bf2-396832ce4e76-kube-api-access-v2r76\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:48.710476 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710415 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f49231a6-2242-467f-85c2-c526cafef9cb-serviceca\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:54:48.710476 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710444 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-modprobe-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.710595 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710550 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-lib-modules\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.710633 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710600 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a9e9bc-0057-4e34-9bf2-396832ce4e76-metrics-tls\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:48.710633 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710604 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d07c193-84b5-44e2-bf42-fb645c2f0f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.710728 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710635 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxft2\" (UniqueName: \"kubernetes.io/projected/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-api-access-kxft2\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.710728 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710664 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-systemd-units\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.710728 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710680 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-etc-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.710895 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710730 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.710895 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710762 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.710895 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710791 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-client-certs\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.710895 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710801 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a9e9bc-0057-4e34-9bf2-396832ce4e76-metrics-tls\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:48.710895 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710836 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.710895 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710871 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-tls\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710897 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lstz5\" (UniqueName: \"kubernetes.io/projected/8883c3b4-99a3-4933-942c-e8e7fc999348-kube-api-access-lstz5\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710930 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-bin\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710949 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.710955 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-config-out\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711002 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711012 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711015 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-client-certs\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711029 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-config-out\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711043 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711083 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-root\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711082 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711149 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f49231a6-2242-467f-85c2-c526cafef9cb-serviceca\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:54:48.711178 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711178 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-var-lib-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711194 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-secret-metrics-server-tls\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711211 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-sys\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711229 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711243 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-var-lib-kubelet\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711258 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711283 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-dbus\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711307 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqk7s\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-kube-api-access-lqk7s\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711340 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-tls\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711404 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2djr\" (UniqueName: \"kubernetes.io/projected/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-kube-api-access-c2djr\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711433 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-sys-fs\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.711576 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711461 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovn-node-metrics-cert\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711578 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-multus\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711600 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-wtmp\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711618 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711579 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-tls\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711646 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8567\" (UniqueName: \"kubernetes.io/projected/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-kube-api-access-d8567\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711669 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-metrics-client-ca\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711703 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711720 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovn-node-metrics-cert\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711736 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711761 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-system-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711799 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-kubelet\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711863 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-conf-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711895 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-metrics-client-ca\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711902 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711895 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-secret-telemeter-client\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711925 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711942 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.711976 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.711977 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-sys\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712076 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712117 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-federate-client-tls\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712155 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-etc-tuned\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712206 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-cnibin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712229 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-etc-tuned\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712231 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712243 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-web-config\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712273 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-netns\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712310 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-daemon-config\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712316 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-federate-client-tls\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712356 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-serving-certs-ca-bundle\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712383 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-telemeter-client-tls\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712413 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a12383c-22ae-47a8-b17a-0bcb91c998f6-iptables-alerter-script\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712423 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-web-config\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712434 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-daemon-config\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712438 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712467 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.712497 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712491 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl84k\" (UniqueName: \"kubernetes.io/projected/7edf8063-b8bf-429f-90aa-aeed3a525670-kube-api-access-pl84k\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712516 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a9e9bc-0057-4e34-9bf2-396832ce4e76-tmp-dir\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712528 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-serving-certs-ca-bundle\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712545 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-kubelet\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712566 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a12383c-22ae-47a8-b17a-0bcb91c998f6-iptables-alerter-script\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712571 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712607 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a9e9bc-0057-4e34-9bf2-396832ce4e76-tmp-dir\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712618 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0d137e6f-4945-4476-8d93-feb093738387-telemeter-client-tls\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712635 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712689 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-k8s-cni-cncf-io\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712712 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-slash\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712740 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysconfig\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712754 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712783 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-systemd\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712834 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-metrics-client-ca\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712863 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-ovn\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712887 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-netd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712957 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7sb4\" (UniqueName: \"kubernetes.io/projected/9a12383c-22ae-47a8-b17a-0bcb91c998f6-kube-api-access-f7sb4\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.712996 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-cni-binary-copy\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713077 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cnibin\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713114 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d07c193-84b5-44e2-bf42-fb645c2f0f35-data-volume\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713153 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2801dd83-9869-447f-8e3f-6e70d12b7d21-cert\") pod \"ingress-canary-89856\" (UID: \"2801dd83-9869-447f-8e3f-6e70d12b7d21\") " pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:48.713230 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713223 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-metrics-client-ca\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713287 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d07c193-84b5-44e2-bf42-fb645c2f0f35-data-volume\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713294 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7edf8063-b8bf-429f-90aa-aeed3a525670-cni-binary-copy\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713321 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-socket-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713329 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2801dd83-9869-447f-8e3f-6e70d12b7d21-cert\") pod \"ingress-canary-89856\" (UID: \"2801dd83-9869-447f-8e3f-6e70d12b7d21\") " pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713347 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0eae92f-5b3d-408a-9049-39e00d341085-hosts-file\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713363 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-system-cni-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713402 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-node-log\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713433 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a9e9bc-0057-4e34-9bf2-396832ce4e76-config-volume\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713475 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-kubelet-config\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713503 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-socket-dir-parent\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713528 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-etc-kubernetes\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713563 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a9e9bc-0057-4e34-9bf2-396832ce4e76-config-volume\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713579 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713603 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvxz\" (UniqueName: \"kubernetes.io/projected/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kube-api-access-vnvxz\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713642 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-run\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713689 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdzfk\" (UniqueName: \"kubernetes.io/projected/7ee54e3e-efb7-461c-9973-90d768900251-kube-api-access-cdzfk\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713726 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-hostroot\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713741 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713754 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713774 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/770590b4-fbb4-4f6d-9187-09ceb5ba873b-konnectivity-ca\") pod \"konnectivity-agent-s5hdv\" (UID: \"770590b4-fbb4-4f6d-9187-09ceb5ba873b\") " pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713865 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-registration-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.713987 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-conf\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714020 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25s8p\" (UniqueName: \"kubernetes.io/projected/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-kube-api-access-25s8p\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714025 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/770590b4-fbb4-4f6d-9187-09ceb5ba873b-konnectivity-ca\") pod \"konnectivity-agent-s5hdv\" (UID: \"770590b4-fbb4-4f6d-9187-09ceb5ba873b\") " pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714056 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-metrics-server-audit-profiles\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714080 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-systemd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714107 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714135 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f92ch\" (UniqueName: \"kubernetes.io/projected/2801dd83-9869-447f-8e3f-6e70d12b7d21-kube-api-access-f92ch\") pod \"ingress-canary-89856\" (UID: \"2801dd83-9869-447f-8e3f-6e70d12b7d21\") " pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714167 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-bin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714196 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.714267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714222 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714343 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-log-socket\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714347 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8883c3b4-99a3-4933-942c-e8e7fc999348-metrics-server-audit-profiles\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714387 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714457 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714459 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714487 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714520 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714561 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714538 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d137e6f-4945-4476-8d93-feb093738387-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714652 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714673 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmk62\" (UniqueName: \"kubernetes.io/projected/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-kube-api-access-kmk62\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714688 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-host\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714692 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714703 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714720 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a12383c-22ae-47a8-b17a-0bcb91c998f6-host-slash\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714741 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714756 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714762 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-kubernetes\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714786 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714799 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8883c3b4-99a3-4933-942c-e8e7fc999348-audit-log\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714886 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714891 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8883c3b4-99a3-4933-942c-e8e7fc999348-audit-log\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714936 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49231a6-2242-467f-85c2-c526cafef9cb-host\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714944 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714978 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-client-ca-bundle\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.714997 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-metrics-certs\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715005 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-env-overrides\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715023 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-script-lib\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715044 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0eae92f-5b3d-408a-9049-39e00d341085-tmp-dir\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715059 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-tmp\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715076 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/770590b4-fbb4-4f6d-9187-09ceb5ba873b-agent-certs\") pod \"konnectivity-agent-s5hdv\" (UID: \"770590b4-fbb4-4f6d-9187-09ceb5ba873b\") " pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715100 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715121 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715145 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-netns\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715165 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-env-overrides\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715167 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-config\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715187 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0eae92f-5b3d-408a-9049-39e00d341085-tmp-dir\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715208 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee54e3e-efb7-461c-9973-90d768900251-tmp\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715212 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-script-lib\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715224 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8883c3b4-99a3-4933-942c-e8e7fc999348-client-ca-bundle\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715216 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-textfile\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715270 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-multus-certs\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715277 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-textfile\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715298 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw722\" (UniqueName: \"kubernetes.io/projected/f49231a6-2242-467f-85c2-c526cafef9cb-kube-api-access-sw722\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715331 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715337 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-ovnkube-config\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715413 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/770590b4-fbb4-4f6d-9187-09ceb5ba873b-agent-certs\") pod \"konnectivity-agent-s5hdv\" (UID: \"770590b4-fbb4-4f6d-9187-09ceb5ba873b\") " pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715460 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhqb\" (UniqueName: \"kubernetes.io/projected/0d137e6f-4945-4476-8d93-feb093738387-kube-api-access-plhqb\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715513 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715518 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c97dc8b9-40b5-4277-93b5-2c31bad3c352-original-pull-secret\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:48.715961 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.715529 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.729495 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.729474 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxft2\" (UniqueName: \"kubernetes.io/projected/7d07c193-84b5-44e2-bf42-fb645c2f0f35-kube-api-access-kxft2\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.729875 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.729838 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2r76\" (UniqueName: \"kubernetes.io/projected/70a9e9bc-0057-4e34-9bf2-396832ce4e76-kube-api-access-v2r76\") pod \"dns-default-2mffv\" (UID: \"70a9e9bc-0057-4e34-9bf2-396832ce4e76\") " pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:48.730240 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.730222 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lstz5\" (UniqueName: \"kubernetes.io/projected/8883c3b4-99a3-4933-942c-e8e7fc999348-kube-api-access-lstz5\") pod \"metrics-server-86bf5f57db-g2647\" (UID: \"8883c3b4-99a3-4933-942c-e8e7fc999348\") " pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:54:48.730299 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.730278 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2djr\" (UniqueName: \"kubernetes.io/projected/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-kube-api-access-c2djr\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.730299 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.730291 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqk7s\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-kube-api-access-lqk7s\") pod \"alertmanager-main-0\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:48.730594 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.730575 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8567\" (UniqueName: \"kubernetes.io/projected/2b0d4d6c-d8f6-4ea5-930c-d97120dd189e-kube-api-access-d8567\") pod \"network-metrics-daemon-hzlsq\" (UID: \"2b0d4d6c-d8f6-4ea5-930c-d97120dd189e\") " pod="openshift-multus/network-metrics-daemon-hzlsq" Oct 30 21:54:48.730594 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.730587 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khnfl\" (UniqueName: \"kubernetes.io/projected/d0eae92f-5b3d-408a-9049-39e00d341085-kube-api-access-khnfl\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:54:48.730868 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.730848 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl84k\" (UniqueName: \"kubernetes.io/projected/7edf8063-b8bf-429f-90aa-aeed3a525670-kube-api-access-pl84k\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.731112 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.731096 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnvxz\" (UniqueName: \"kubernetes.io/projected/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kube-api-access-vnvxz\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.731259 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.731233 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqdg\" (UniqueName: \"kubernetes.io/projected/87f0bae4-f0d6-49ac-80f4-2e31394c0764-kube-api-access-rqqdg\") pod \"network-check-target-q9b4k\" (UID: \"87f0bae4-f0d6-49ac-80f4-2e31394c0764\") " pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:48.731622 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.731608 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7sb4\" (UniqueName: \"kubernetes.io/projected/9a12383c-22ae-47a8-b17a-0bcb91c998f6-kube-api-access-f7sb4\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:54:48.736916 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.736888 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25s8p\" (UniqueName: \"kubernetes.io/projected/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-kube-api-access-25s8p\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.737035 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.737017 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmk62\" (UniqueName: \"kubernetes.io/projected/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-kube-api-access-kmk62\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.737095 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.737017 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw722\" (UniqueName: \"kubernetes.io/projected/f49231a6-2242-467f-85c2-c526cafef9cb-kube-api-access-sw722\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:54:48.737554 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.737539 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdzfk\" (UniqueName: \"kubernetes.io/projected/7ee54e3e-efb7-461c-9973-90d768900251-kube-api-access-cdzfk\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.737597 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.737567 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92ch\" (UniqueName: \"kubernetes.io/projected/2801dd83-9869-447f-8e3f-6e70d12b7d21-kube-api-access-f92ch\") pod \"ingress-canary-89856\" (UID: \"2801dd83-9869-447f-8e3f-6e70d12b7d21\") " pod="openshift-ingress-canary/ingress-canary-89856" Oct 30 21:54:48.738564 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.738548 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhqb\" (UniqueName: \"kubernetes.io/projected/0d137e6f-4945-4476-8d93-feb093738387-kube-api-access-plhqb\") pod \"telemeter-client-7f49cd584c-q44h7\" (UID: \"0d137e6f-4945-4476-8d93-feb093738387\") " pod="openshift-monitoring/telemeter-client-7f49cd584c-q44h7" Oct 30 21:54:48.816119 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816045 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cnibin\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.816119 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816076 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-socket-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.816119 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816093 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0eae92f-5b3d-408a-9049-39e00d341085-hosts-file\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:54:48.816119 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816108 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-system-cni-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816148 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-cnibin\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816165 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d0eae92f-5b3d-408a-9049-39e00d341085-hosts-file\") pod \"node-resolver-ksczz\" (UID: \"d0eae92f-5b3d-408a-9049-39e00d341085\") " pod="openshift-dns/node-resolver-ksczz" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816146 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-node-log\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816177 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-node-log\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816205 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-system-cni-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816216 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-kubelet-config\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816233 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-socket-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816240 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-socket-dir-parent\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816267 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-etc-kubernetes\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816276 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-socket-dir-parent\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816284 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-run\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816305 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-kubelet-config\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816304 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-hostroot\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816305 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-etc-kubernetes\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816333 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816336 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-hostroot\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816349 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-registration-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816355 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-run\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816365 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-conf\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816383 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-systemd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816387 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tmvv\" (UID: \"a650fa9d-f3d0-40b4-8c37-b6faaa2da3f8\") " pod="openshift-multus/multus-additional-cni-plugins-4tmvv" Oct 30 21:54:48.816386 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816399 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-bin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816405 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-registration-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816420 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-systemd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816432 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-log-socket\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816454 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816456 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-bin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816471 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816503 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-log-socket\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816508 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-host\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816513 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-conf\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816542 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a12383c-22ae-47a8-b17a-0bcb91c998f6-host-slash\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816569 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-kubernetes\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816575 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysctl-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816578 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816543 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-host\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816591 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816603 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a12383c-22ae-47a8-b17a-0bcb91c998f6-host-slash\") pod \"iptables-alerter-bff8j\" (UID: \"9a12383c-22ae-47a8-b17a-0bcb91c998f6\") " pod="openshift-network-operator/iptables-alerter-bff8j" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816614 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49231a6-2242-467f-85c2-c526cafef9cb-host\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816616 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-kubernetes\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816636 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49231a6-2242-467f-85c2-c526cafef9cb-host\") pod \"node-ca-5gsg6\" (UID: \"f49231a6-2242-467f-85c2-c526cafef9cb\") " pod="openshift-image-registry/node-ca-5gsg6" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816640 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-netns\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816645 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816668 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-multus-certs\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816691 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d07c193-84b5-44e2-bf42-fb645c2f0f35-crio-socket\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816699 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-netns\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816715 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-device-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816737 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816740 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-multus-certs\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816743 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d07c193-84b5-44e2-bf42-fb645c2f0f35-crio-socket\") pod \"insights-runtime-extractor-ttjm8\" (UID: \"7d07c193-84b5-44e2-bf42-fb645c2f0f35\") " pod="openshift-insights/insights-runtime-extractor-ttjm8" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816760 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-modprobe-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816775 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-device-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816782 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-lib-modules\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816792 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816806 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-systemd-units\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816848 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-etc-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816874 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-bin\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816880 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-modprobe-d\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816886 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-systemd-units\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816896 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-root\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816922 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-lib-modules\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816931 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-bin\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816926 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-etc-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816944 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-root\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816956 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-var-lib-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.816997 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-sys\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817020 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-var-lib-kubelet\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817025 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-var-lib-openvswitch\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817042 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-dbus\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817067 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-sys-fs\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817077 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-var-lib-kubelet\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817078 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-sys\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817092 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-multus\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817120 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c97dc8b9-40b5-4277-93b5-2c31bad3c352-dbus\") pod \"global-pull-secret-syncer-p9l8h\" (UID: \"c97dc8b9-40b5-4277-93b5-2c31bad3c352\") " pod="kube-system/global-pull-secret-syncer-p9l8h" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817139 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-wtmp\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817152 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-cni-multus\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817151 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-sys-fs\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817171 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817203 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-system-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817208 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-node-exporter-wtmp\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817227 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-kubelet\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817245 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817251 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-var-lib-kubelet\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817249 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-conf-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817282 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-sys\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817284 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-multus-conf-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817299 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817315 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-cnibin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817255 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-system-cni-dir\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817335 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-netns\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817341 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1-sys\") pod \"node-exporter-8b4rc\" (UID: \"87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1\") " pod="openshift-monitoring/node-exporter-8b4rc" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817356 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-kubelet\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817358 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-cnibin\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817379 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-kubelet\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817372 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817390 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-run-ovn-kubernetes\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817395 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55631fc0-8b3a-40ac-96a0-786f08ed12ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-57j29\" (UID: \"55631fc0-8b3a-40ac-96a0-786f08ed12ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57j29" Oct 30 21:54:48.817347 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817409 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-k8s-cni-cncf-io\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817382 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-netns\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817434 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-slash\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817459 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysconfig\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817470 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7edf8063-b8bf-429f-90aa-aeed3a525670-host-run-k8s-cni-cncf-io\") pod \"multus-bjm7d\" (UID: \"7edf8063-b8bf-429f-90aa-aeed3a525670\") " pod="openshift-multus/multus-bjm7d" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817475 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-slash\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817481 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-systemd\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817501 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-sysconfig\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817504 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-ovn\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817509 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee54e3e-efb7-461c-9973-90d768900251-etc-systemd\") pod \"tuned-glhwd\" (UID: \"7ee54e3e-efb7-461c-9973-90d768900251\") " pod="openshift-cluster-node-tuning-operator/tuned-glhwd" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817526 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-netd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817541 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-run-ovn\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:48.819509 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:48.817589 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410-host-cni-netd\") pod \"ovnkube-node-x949s\" (UID: \"8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410\") " pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:49.125839 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:49.125790 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:50.810155 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:50.810124 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2mffv" Oct 30 21:54:51.740416 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:51.740365 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:54:52.390979 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:52.390953 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:54:52.391346 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:52.391141 6162 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 21:54:54.095480 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:54:54.095444 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 21:54:57.780868 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:54:57.780838 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86bf5f57db-g2647" Oct 30 21:55:02.192686 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:02.192616 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x949s" Oct 30 21:55:06.444933 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.444900 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:55:06.445335 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.445296 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="alertmanager" containerID="cri-o://8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f" gracePeriod=120 Oct 30 21:55:06.445499 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.445365 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy-metric" containerID="cri-o://9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd" gracePeriod=120 Oct 30 21:55:06.445499 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.445395 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="prom-label-proxy" containerID="cri-o://f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316" gracePeriod=120 Oct 30 21:55:06.445499 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.445433 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy-web" containerID="cri-o://0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279" gracePeriod=120 Oct 30 21:55:06.445499 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.445457 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="config-reloader" containerID="cri-o://9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356" gracePeriod=120 Oct 30 21:55:06.445792 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.445438 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy" containerID="cri-o://09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd" gracePeriod=120 Oct 30 21:55:06.710607 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.710525 6162 generic.go:356] "Generic (PLEG): container finished" podID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerID="f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316" exitCode=0 Oct 30 21:55:06.710607 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.710555 6162 generic.go:356] "Generic (PLEG): container finished" podID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerID="9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd" exitCode=0 Oct 30 21:55:06.710607 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.710562 6162 generic.go:356] "Generic (PLEG): container finished" podID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerID="09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd" exitCode=0 Oct 30 21:55:06.710607 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.710568 6162 generic.go:356] "Generic (PLEG): container finished" podID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerID="9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356" exitCode=0 Oct 30 21:55:06.710607 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.710573 6162 generic.go:356] "Generic (PLEG): container finished" podID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerID="8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f" exitCode=0 Oct 30 21:55:06.710607 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.710596 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerDied","Data":"f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316"} Oct 30 21:55:06.710905 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.710659 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerDied","Data":"9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd"} Oct 30 21:55:06.710905 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.710686 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerDied","Data":"09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd"} Oct 30 21:55:06.710905 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.710710 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerDied","Data":"9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356"} Oct 30 21:55:06.710905 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:06.710733 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerDied","Data":"8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f"} Oct 30 21:55:07.679232 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.679209 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:07.716413 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.716391 6162 generic.go:356] "Generic (PLEG): container finished" podID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerID="0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279" exitCode=0 Oct 30 21:55:07.716526 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.716446 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerDied","Data":"0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279"} Oct 30 21:55:07.716526 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.716464 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:07.716526 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.716518 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d6ffc6b-7858-438b-a24f-94a882233c63","Type":"ContainerDied","Data":"c0fd027d85db47015b0e3ddae316fdbabbf26a350e41e91cd84cdb5c8aa33f9c"} Oct 30 21:55:07.716743 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.716571 6162 scope.go:122] "RemoveContainer" containerID="f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316" Oct 30 21:55:07.723383 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.723368 6162 scope.go:122] "RemoveContainer" containerID="9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd" Oct 30 21:55:07.729745 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.729728 6162 scope.go:122] "RemoveContainer" containerID="09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd" Oct 30 21:55:07.735681 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.735666 6162 scope.go:122] "RemoveContainer" containerID="0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279" Oct 30 21:55:07.741331 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.741303 6162 scope.go:122] "RemoveContainer" containerID="9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356" Oct 30 21:55:07.747581 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.747565 6162 scope.go:122] "RemoveContainer" containerID="8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f" Oct 30 21:55:07.754305 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.754289 6162 scope.go:122] "RemoveContainer" containerID="987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26" Oct 30 21:55:07.761272 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.761254 6162 scope.go:122] "RemoveContainer" containerID="f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316" Oct 30 21:55:07.761543 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:55:07.761522 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316\": container with ID starting with f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316 not found: ID does not exist" containerID="f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316" Oct 30 21:55:07.761588 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.761552 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316"} err="failed to get container status \"f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316\": rpc error: code = NotFound desc = could not find container \"f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316\": container with ID starting with f72892bfddec4ff933059793951f85888fd4e2096cba5537131b5e8850b1f316 not found: ID does not exist" Oct 30 21:55:07.761641 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.761588 6162 scope.go:122] "RemoveContainer" containerID="9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd" Oct 30 21:55:07.761878 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:55:07.761856 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd\": container with ID starting with 9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd not found: ID does not exist" containerID="9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd" Oct 30 21:55:07.761927 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.761890 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd"} err="failed to get container status \"9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd\": rpc error: code = NotFound desc = could not find container \"9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd\": container with ID starting with 9f61a6dbb597b4465f61d43821537f012ec966da919e3c193092fc858627afcd not found: ID does not exist" Oct 30 21:55:07.761927 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.761912 6162 scope.go:122] "RemoveContainer" containerID="09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd" Oct 30 21:55:07.762220 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:55:07.762200 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd\": container with ID starting with 09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd not found: ID does not exist" containerID="09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd" Oct 30 21:55:07.762309 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.762223 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd"} err="failed to get container status \"09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd\": rpc error: code = NotFound desc = could not find container \"09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd\": container with ID starting with 09152c956172d95835d0cbcd733df081ae285c6af271c066cf8aeea8e6350bbd not found: ID does not exist" Oct 30 21:55:07.762309 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.762236 6162 scope.go:122] "RemoveContainer" containerID="0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279" Oct 30 21:55:07.762467 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:55:07.762451 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279\": container with ID starting with 0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279 not found: ID does not exist" containerID="0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279" Oct 30 21:55:07.762529 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.762469 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279"} err="failed to get container status \"0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279\": rpc error: code = NotFound desc = could not find container \"0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279\": container with ID starting with 0954488f2ab0d2a027cb35ef9e4a7c3dcc906cd31e52860092938fbb29d3f279 not found: ID does not exist" Oct 30 21:55:07.762529 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.762480 6162 scope.go:122] "RemoveContainer" containerID="9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356" Oct 30 21:55:07.762731 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:55:07.762712 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356\": container with ID starting with 9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356 not found: ID does not exist" containerID="9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356" Oct 30 21:55:07.762802 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.762733 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356"} err="failed to get container status \"9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356\": rpc error: code = NotFound desc = could not find container \"9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356\": container with ID starting with 9c3ecd9da5de9188fc41868c900a41dd93388047806dbfb2fea8af1bc8c26356 not found: ID does not exist" Oct 30 21:55:07.762802 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.762747 6162 scope.go:122] "RemoveContainer" containerID="8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f" Oct 30 21:55:07.763253 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:55:07.763236 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f\": container with ID starting with 8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f not found: ID does not exist" containerID="8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f" Oct 30 21:55:07.763334 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.763254 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f"} err="failed to get container status \"8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f\": rpc error: code = NotFound desc = could not find container \"8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f\": container with ID starting with 8434f098229c9462fa10076798d9c274e0c6a9b0b0b3dcf972cdbb0ee8055d9f not found: ID does not exist" Oct 30 21:55:07.763334 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.763265 6162 scope.go:122] "RemoveContainer" containerID="987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26" Oct 30 21:55:07.763482 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:55:07.763461 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26\": container with ID starting with 987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26 not found: ID does not exist" containerID="987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26" Oct 30 21:55:07.763624 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.763486 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26"} err="failed to get container status \"987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26\": rpc error: code = NotFound desc = could not find container \"987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26\": container with ID starting with 987d2a80d6de045ec524b42383d5745f8374a41b762146996e3de3f9b133fb26 not found: ID does not exist" Oct 30 21:55:07.842010 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.841944 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842010 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.841989 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-config-volume\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-config-volume\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842192 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842022 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-web\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842192 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842059 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-main-db\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842192 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842086 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-config-out\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842192 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842122 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842192 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842147 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-cluster-tls-config\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842192 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842184 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-tls-assets\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-tls-assets\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842485 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842228 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-web-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-web-config\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842485 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842261 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-main-tls\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842485 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842299 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-metrics-client-ca\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842485 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842342 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-trusted-ca-bundle\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842485 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842379 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-main-db" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:55:07.842485 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842393 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-kube-api-access-lqk7s\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-kube-api-access-lqk7s\") pod \"2d6ffc6b-7858-438b-a24f-94a882233c63\" (UID: \"2d6ffc6b-7858-438b-a24f-94a882233c63\") " Oct 30 21:55:07.842761 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.842640 6162 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-main-db\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.845226 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.845005 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-web" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:07.845226 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.845170 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-config-volume" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:07.845391 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.845253 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:07.845391 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.845357 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-metrics-client-ca" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:55:07.845507 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.845427 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-metric" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:07.845507 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.845487 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-config-out" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:55:07.845630 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.845607 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-trusted-ca-bundle" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:55:07.846110 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.846081 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-kube-api-access-lqk7s" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "kube-api-access-lqk7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:55:07.847158 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.847137 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-main-tls" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:07.847267 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.847248 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-tls-assets" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:55:07.849583 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.849559 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-cluster-tls-config" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:07.854261 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.854240 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-web-config" pod "2d6ffc6b-7858-438b-a24f-94a882233c63" (UID: "2d6ffc6b-7858-438b-a24f-94a882233c63"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:07.943244 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943216 6162 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-tls-assets\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943244 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943238 6162 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-web-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943244 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943247 6162 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-main-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943413 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943257 6162 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-metrics-client-ca\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943413 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943268 6162 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d6ffc6b-7858-438b-a24f-94a882233c63-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943413 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943278 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqk7s\" (UniqueName: \"kubernetes.io/projected/2d6ffc6b-7858-438b-a24f-94a882233c63-kube-api-access-lqk7s\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943413 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943288 6162 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943413 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943296 6162 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-config-volume\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943413 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943306 6162 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943413 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943314 6162 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d6ffc6b-7858-438b-a24f-94a882233c63-config-out\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943413 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943323 6162 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:07.943413 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:07.943332 6162 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d6ffc6b-7858-438b-a24f-94a882233c63-cluster-tls-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 21:55:08.061571 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.061544 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:55:08.066401 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.066379 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:55:08.097870 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.097795 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:55:08.098114 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098095 6162 cpu_manager.go:414] "containerMap: removing container" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="init-config-reloader" Oct 30 21:55:08.098188 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098116 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="init-config-reloader" Oct 30 21:55:08.098188 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098132 6162 cpu_manager.go:414] "containerMap: removing container" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="prom-label-proxy" Oct 30 21:55:08.098188 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098139 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="prom-label-proxy" Oct 30 21:55:08.098188 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098148 6162 cpu_manager.go:414] "containerMap: removing container" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy" Oct 30 21:55:08.098188 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098156 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy" Oct 30 21:55:08.098188 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098166 6162 cpu_manager.go:414] "containerMap: removing container" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="alertmanager" Oct 30 21:55:08.098188 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098175 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="alertmanager" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098210 6162 cpu_manager.go:414] "containerMap: removing container" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy-metric" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098217 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy-metric" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098229 6162 cpu_manager.go:414] "containerMap: removing container" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy-web" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098236 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy-web" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098246 6162 cpu_manager.go:414] "containerMap: removing container" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="config-reloader" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098253 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="config-reloader" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098312 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy-metric" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098324 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy-web" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098332 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="config-reloader" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098342 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="init-config-reloader" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098351 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="prom-label-proxy" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098360 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="kube-rbac-proxy" Oct 30 21:55:08.098527 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.098368 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" containerName="alertmanager" Oct 30 21:55:08.102287 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.102267 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.118573 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.118550 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 21:55:08.118676 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.118657 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 21:55:08.118744 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.118661 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 21:55:08.118744 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.118718 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 21:55:08.118744 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.118666 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 21:55:08.118891 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.118758 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 21:55:08.118891 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.118789 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gsmcv\"" Oct 30 21:55:08.118891 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.118863 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 21:55:08.118989 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.118979 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 21:55:08.129373 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.129353 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 21:55:08.131073 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.131047 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:55:08.245412 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245377 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55aff1da-7717-4b60-af65-6d36e43ec956-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245412 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245414 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-config-volume\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245653 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245433 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245653 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245454 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55aff1da-7717-4b60-af65-6d36e43ec956-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245653 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245559 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245653 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245609 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245653 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245645 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55aff1da-7717-4b60-af65-6d36e43ec956-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245941 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245675 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245941 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245755 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245941 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245785 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-web-config\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245941 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245843 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55aff1da-7717-4b60-af65-6d36e43ec956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245941 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245872 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55aff1da-7717-4b60-af65-6d36e43ec956-config-out\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.245941 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.245919 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9852k\" (UniqueName: \"kubernetes.io/projected/55aff1da-7717-4b60-af65-6d36e43ec956-kube-api-access-9852k\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.346335 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346305 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.346483 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346340 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.346483 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346360 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-web-config\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.346483 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346393 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55aff1da-7717-4b60-af65-6d36e43ec956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.346483 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346417 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55aff1da-7717-4b60-af65-6d36e43ec956-config-out\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.346483 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346442 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9852k\" (UniqueName: \"kubernetes.io/projected/55aff1da-7717-4b60-af65-6d36e43ec956-kube-api-access-9852k\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.346483 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346474 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55aff1da-7717-4b60-af65-6d36e43ec956-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.346785 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346502 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-config-volume\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.346785 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346742 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.346785 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346767 6162 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 21:55:08.346988 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.346789 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55aff1da-7717-4b60-af65-6d36e43ec956-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.347251 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.347088 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/55aff1da-7717-4b60-af65-6d36e43ec956-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.347335 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.347316 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55aff1da-7717-4b60-af65-6d36e43ec956-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.347390 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.347344 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55aff1da-7717-4b60-af65-6d36e43ec956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.347449 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.347368 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.347449 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.347415 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.347554 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.347452 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55aff1da-7717-4b60-af65-6d36e43ec956-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.349654 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.349593 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.349806 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.349787 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.349806 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.349795 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55aff1da-7717-4b60-af65-6d36e43ec956-config-out\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.349939 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.349918 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-config-volume\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.349977 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.349951 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.350010 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.349974 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.350085 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.350071 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55aff1da-7717-4b60-af65-6d36e43ec956-tls-assets\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.350992 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.350977 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-web-config\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.351177 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.351161 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/55aff1da-7717-4b60-af65-6d36e43ec956-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.367051 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.367032 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9852k\" (UniqueName: \"kubernetes.io/projected/55aff1da-7717-4b60-af65-6d36e43ec956-kube-api-access-9852k\") pod \"alertmanager-main-0\" (UID: \"55aff1da-7717-4b60-af65-6d36e43ec956\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.417926 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.417905 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:55:08.741370 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:08.741318 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:55:08.745572 ip-10-0-135-200 kubenswrapper[6162]: W1030 21:55:08.745547 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55aff1da_7717_4b60_af65_6d36e43ec956.slice/crio-36b90bc46a8d5df80fdc4bdfa61fdd12e2c02a3f865cbdaf12eb4fd3b041d72f WatchSource:0}: Error finding container 36b90bc46a8d5df80fdc4bdfa61fdd12e2c02a3f865cbdaf12eb4fd3b041d72f: Status 404 returned error can't find the container with id 36b90bc46a8d5df80fdc4bdfa61fdd12e2c02a3f865cbdaf12eb4fd3b041d72f Oct 30 21:55:09.594018 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:09.593993 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d6ffc6b-7858-438b-a24f-94a882233c63" path="/var/lib/kubelet/pods/2d6ffc6b-7858-438b-a24f-94a882233c63/volumes" Oct 30 21:55:09.727796 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:09.727768 6162 generic.go:356] "Generic (PLEG): container finished" podID="55aff1da-7717-4b60-af65-6d36e43ec956" containerID="c81e26fd94e299f2aa5dd65a15fead6e2683a8eff070d6ceee886188653b4dc2" exitCode=0 Oct 30 21:55:09.727941 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:09.727808 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aff1da-7717-4b60-af65-6d36e43ec956","Type":"ContainerDied","Data":"c81e26fd94e299f2aa5dd65a15fead6e2683a8eff070d6ceee886188653b4dc2"} Oct 30 21:55:09.727941 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:09.727879 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aff1da-7717-4b60-af65-6d36e43ec956","Type":"ContainerStarted","Data":"36b90bc46a8d5df80fdc4bdfa61fdd12e2c02a3f865cbdaf12eb4fd3b041d72f"} Oct 30 21:55:10.733737 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:10.733692 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aff1da-7717-4b60-af65-6d36e43ec956","Type":"ContainerStarted","Data":"95908872615b507a9b840f687ec4509bc83d1c88e871d50878fdd319a1324d5b"} Oct 30 21:55:10.734140 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:10.733780 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aff1da-7717-4b60-af65-6d36e43ec956","Type":"ContainerStarted","Data":"8f30e3dc123d9a2c6003371b723adca83c83f1660cf57b194c13c07aec84e68e"} Oct 30 21:55:10.734140 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:10.733846 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aff1da-7717-4b60-af65-6d36e43ec956","Type":"ContainerStarted","Data":"cce7dcba7a6baff08b889b98b87f92455917c639b256ca4be30f25f59cbed826"} Oct 30 21:55:10.734140 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:10.733882 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aff1da-7717-4b60-af65-6d36e43ec956","Type":"ContainerStarted","Data":"38467cd1607b5e57e2db4f92e1a7a3e6918e25a3a348cb6455070a0abe6a63e2"} Oct 30 21:55:10.734140 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:10.733917 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aff1da-7717-4b60-af65-6d36e43ec956","Type":"ContainerStarted","Data":"4ed375fff687169dfa927d35383b7eb75b973c3bb8224c62a175ef924a996b7e"} Oct 30 21:55:10.734140 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:10.733954 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"55aff1da-7717-4b60-af65-6d36e43ec956","Type":"ContainerStarted","Data":"bb1eaf023ae916cac54d8b7c1cd24f3be965362afe8fa04357bf9734aa9d2650"} Oct 30 21:55:10.816546 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:10.816495 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.805637732 podStartE2EDuration="2.816482616s" totalImagesPullingTime="0s" totalInitContainerRuntime="10.844884ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:55:10.816249759 +0000 UTC m=+23.326121318" watchObservedRunningTime="2026-10-30 21:55:10.816482616 +0000 UTC m=+23.326354170" Oct 30 21:55:14.970716 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:14.970687 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s5hdv" Oct 30 21:55:21.743483 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:55:21.743451 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q9b4k" Oct 30 21:55:24.094572 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:55:24.094535 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 21:55:54.095428 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:55:54.095390 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 21:56:24.094881 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:56:24.094845 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 21:56:54.095258 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:56:54.095177 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 21:57:24.095526 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:57:24.095494 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 21:57:54.095305 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:57:54.095271 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 21:58:24.095221 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:58:24.095184 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 21:58:54.095717 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:58:54.095681 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 21:59:24.095435 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:59:24.095401 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 21:59:47.613016 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:59:47.612990 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 21:59:47.614210 ip-10-0-135-200 kubenswrapper[6162]: I1030 21:59:47.614191 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 21:59:54.095673 ip-10-0-135-200 kubenswrapper[6162]: E1030 21:59:54.095632 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:00:24.095723 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:00:24.095684 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:00:54.096505 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:00:54.096465 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:01:24.094803 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:01:24.094766 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:01:26.955230 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:26.955197 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd"] Oct 30 22:01:26.958716 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:26.958698 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:26.973472 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:26.973456 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 22:01:26.983948 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:26.983927 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 22:01:26.984016 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:26.983959 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"98a21a31f7a8ae0212b9c22cc643f9202bfa37-6b211c7f-dockercfg-65q69\"" Oct 30 22:01:26.993371 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:26.993353 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd"] Oct 30 22:01:27.062991 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.062968 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxxb5\" (UniqueName: \"kubernetes.io/projected/e59623fc-c203-4a71-b365-210ef113884b-kube-api-access-vxxb5\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:27.063093 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.063007 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:27.063093 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.063033 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:27.164299 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.164271 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:27.164383 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.164310 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:27.164383 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.164348 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxxb5\" (UniqueName: \"kubernetes.io/projected/e59623fc-c203-4a71-b365-210ef113884b-kube-api-access-vxxb5\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:27.164732 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.164708 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:27.164767 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.164721 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:27.185311 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.185286 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxxb5\" (UniqueName: \"kubernetes.io/projected/e59623fc-c203-4a71-b365-210ef113884b-kube-api-access-vxxb5\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:27.273898 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.273827 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:27.568107 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.568043 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd"] Oct 30 22:01:27.573068 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:01:27.573044 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59623fc_c203_4a71_b365_210ef113884b.slice/crio-7ce02f16725222d94ad5e27b24a4dfa8202f2807d05da488c90b7ccd1ca07d9c WatchSource:0}: Error finding container 7ce02f16725222d94ad5e27b24a4dfa8202f2807d05da488c90b7ccd1ca07d9c: Status 404 returned error can't find the container with id 7ce02f16725222d94ad5e27b24a4dfa8202f2807d05da488c90b7ccd1ca07d9c Oct 30 22:01:27.575007 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.574984 6162 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:01:27.887618 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:27.887582 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" event={"ID":"e59623fc-c203-4a71-b365-210ef113884b","Type":"ContainerStarted","Data":"7ce02f16725222d94ad5e27b24a4dfa8202f2807d05da488c90b7ccd1ca07d9c"} Oct 30 22:01:33.908953 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:33.908921 6162 generic.go:356] "Generic (PLEG): container finished" podID="e59623fc-c203-4a71-b365-210ef113884b" containerID="dfc446f30d81fab08c3357171e0f19b2e1a6741192a3a1f8b725735956b5802b" exitCode=0 Oct 30 22:01:33.909384 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:33.908968 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" event={"ID":"e59623fc-c203-4a71-b365-210ef113884b","Type":"ContainerDied","Data":"dfc446f30d81fab08c3357171e0f19b2e1a6741192a3a1f8b725735956b5802b"} Oct 30 22:01:37.924522 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:37.924491 6162 generic.go:356] "Generic (PLEG): container finished" podID="e59623fc-c203-4a71-b365-210ef113884b" containerID="35117d2dc99f566d5a04c19319a6d2b3a794f9da3ae99cdd7eca88f257ef1ee7" exitCode=0 Oct 30 22:01:37.924977 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:37.924531 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" event={"ID":"e59623fc-c203-4a71-b365-210ef113884b","Type":"ContainerDied","Data":"35117d2dc99f566d5a04c19319a6d2b3a794f9da3ae99cdd7eca88f257ef1ee7"} Oct 30 22:01:43.946741 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:43.946705 6162 generic.go:356] "Generic (PLEG): container finished" podID="e59623fc-c203-4a71-b365-210ef113884b" containerID="95843b756609958472af8d4aba4663202c5d3d48a16c69b63e40ead6ea9dd0ff" exitCode=0 Oct 30 22:01:43.947126 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:43.946789 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" event={"ID":"e59623fc-c203-4a71-b365-210ef113884b","Type":"ContainerDied","Data":"95843b756609958472af8d4aba4663202c5d3d48a16c69b63e40ead6ea9dd0ff"} Oct 30 22:01:45.070263 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.070237 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:45.208312 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.208251 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-bundle\") pod \"e59623fc-c203-4a71-b365-210ef113884b\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " Oct 30 22:01:45.208446 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.208322 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-util\" (UniqueName: \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-util\") pod \"e59623fc-c203-4a71-b365-210ef113884b\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " Oct 30 22:01:45.208446 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.208361 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e59623fc-c203-4a71-b365-210ef113884b-kube-api-access-vxxb5\" (UniqueName: \"kubernetes.io/projected/e59623fc-c203-4a71-b365-210ef113884b-kube-api-access-vxxb5\") pod \"e59623fc-c203-4a71-b365-210ef113884b\" (UID: \"e59623fc-c203-4a71-b365-210ef113884b\") " Oct 30 22:01:45.208903 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.208880 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-bundle" pod "e59623fc-c203-4a71-b365-210ef113884b" (UID: "e59623fc-c203-4a71-b365-210ef113884b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:01:45.210436 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.210408 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59623fc-c203-4a71-b365-210ef113884b-kube-api-access-vxxb5" pod "e59623fc-c203-4a71-b365-210ef113884b" (UID: "e59623fc-c203-4a71-b365-210ef113884b"). InnerVolumeSpecName "kube-api-access-vxxb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:01:45.212593 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.212573 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-util" pod "e59623fc-c203-4a71-b365-210ef113884b" (UID: "e59623fc-c203-4a71-b365-210ef113884b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:01:45.308719 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.308695 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxxb5\" (UniqueName: \"kubernetes.io/projected/e59623fc-c203-4a71-b365-210ef113884b-kube-api-access-vxxb5\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:01:45.308719 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.308716 6162 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-bundle\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:01:45.308873 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.308726 6162 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e59623fc-c203-4a71-b365-210ef113884b-util\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:01:45.955098 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.955070 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" event={"ID":"e59623fc-c203-4a71-b365-210ef113884b","Type":"ContainerDied","Data":"7ce02f16725222d94ad5e27b24a4dfa8202f2807d05da488c90b7ccd1ca07d9c"} Oct 30 22:01:45.955266 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.955114 6162 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ce02f16725222d94ad5e27b24a4dfa8202f2807d05da488c90b7ccd1ca07d9c" Oct 30 22:01:45.955266 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:45.955180 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820chqlrd" Oct 30 22:01:50.343281 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.343249 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr"] Oct 30 22:01:50.343883 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.343622 6162 cpu_manager.go:414] "containerMap: removing container" podUID="e59623fc-c203-4a71-b365-210ef113884b" containerName="pull" Oct 30 22:01:50.343883 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.343641 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e59623fc-c203-4a71-b365-210ef113884b" containerName="pull" Oct 30 22:01:50.343883 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.343656 6162 cpu_manager.go:414] "containerMap: removing container" podUID="e59623fc-c203-4a71-b365-210ef113884b" containerName="util" Oct 30 22:01:50.343883 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.343663 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e59623fc-c203-4a71-b365-210ef113884b" containerName="util" Oct 30 22:01:50.343883 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.343701 6162 cpu_manager.go:414] "containerMap: removing container" podUID="e59623fc-c203-4a71-b365-210ef113884b" containerName="extract" Oct 30 22:01:50.343883 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.343708 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e59623fc-c203-4a71-b365-210ef113884b" containerName="extract" Oct 30 22:01:50.343883 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.343782 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="e59623fc-c203-4a71-b365-210ef113884b" containerName="extract" Oct 30 22:01:50.345658 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.345643 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" Oct 30 22:01:50.360411 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.360392 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Oct 30 22:01:50.370908 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.370888 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-xh227\"" Oct 30 22:01:50.370985 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.370944 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Oct 30 22:01:50.371026 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.371011 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Oct 30 22:01:50.372172 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.372156 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr"] Oct 30 22:01:50.444572 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.444545 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b7c358d8-5104-4539-ab69-825c412cb631-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-rpbvr\" (UID: \"b7c358d8-5104-4539-ab69-825c412cb631\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" Oct 30 22:01:50.444690 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.444585 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p6mp\" (UniqueName: \"kubernetes.io/projected/b7c358d8-5104-4539-ab69-825c412cb631-kube-api-access-8p6mp\") pod \"custom-metrics-autoscaler-operator-c667576c8-rpbvr\" (UID: \"b7c358d8-5104-4539-ab69-825c412cb631\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" Oct 30 22:01:50.545498 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.545467 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b7c358d8-5104-4539-ab69-825c412cb631-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-rpbvr\" (UID: \"b7c358d8-5104-4539-ab69-825c412cb631\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" Oct 30 22:01:50.545618 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.545520 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p6mp\" (UniqueName: \"kubernetes.io/projected/b7c358d8-5104-4539-ab69-825c412cb631-kube-api-access-8p6mp\") pod \"custom-metrics-autoscaler-operator-c667576c8-rpbvr\" (UID: \"b7c358d8-5104-4539-ab69-825c412cb631\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" Oct 30 22:01:50.547658 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.547639 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b7c358d8-5104-4539-ab69-825c412cb631-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-rpbvr\" (UID: \"b7c358d8-5104-4539-ab69-825c412cb631\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" Oct 30 22:01:50.564128 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.564106 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p6mp\" (UniqueName: \"kubernetes.io/projected/b7c358d8-5104-4539-ab69-825c412cb631-kube-api-access-8p6mp\") pod \"custom-metrics-autoscaler-operator-c667576c8-rpbvr\" (UID: \"b7c358d8-5104-4539-ab69-825c412cb631\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" Oct 30 22:01:50.656268 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.656245 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" Oct 30 22:01:50.971779 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:50.971713 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr"] Oct 30 22:01:50.976216 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:01:50.976184 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c358d8_5104_4539_ab69_825c412cb631.slice/crio-37f2e0eac700b39cf131955c98a78a997026373084747baaa696a96de900cb87 WatchSource:0}: Error finding container 37f2e0eac700b39cf131955c98a78a997026373084747baaa696a96de900cb87: Status 404 returned error can't find the container with id 37f2e0eac700b39cf131955c98a78a997026373084747baaa696a96de900cb87 Oct 30 22:01:51.975887 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:51.975850 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" event={"ID":"b7c358d8-5104-4539-ab69-825c412cb631","Type":"ContainerStarted","Data":"37f2e0eac700b39cf131955c98a78a997026373084747baaa696a96de900cb87"} Oct 30 22:01:54.095101 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:01:54.095064 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:01:54.988057 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:54.988022 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" event={"ID":"b7c358d8-5104-4539-ab69-825c412cb631","Type":"ContainerStarted","Data":"f37bb5620280ba0f6e4d9bbde24478b594a385b77fae20ee0b7ce88039baeb1f"} Oct 30 22:01:54.988257 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:54.988241 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" Oct 30 22:01:55.064464 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.064415 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" podStartSLOduration=2.011970728 podStartE2EDuration="5.064402108s" totalImagesPullingTime="3.05243138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:55.053038976 +0000 UTC m=+427.562910536" watchObservedRunningTime="2026-10-30 22:01:55.064402108 +0000 UTC m=+427.574273669" Oct 30 22:01:55.407385 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.407350 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-7dc85965f-mz2lc"] Oct 30 22:01:55.409855 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.409830 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.432219 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.432196 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Oct 30 22:01:55.447716 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.447688 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-mz2lc"] Oct 30 22:01:55.510477 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.510447 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Oct 30 22:01:55.510601 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.510562 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-nf4tn\"" Oct 30 22:01:55.582118 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.582090 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b4f68ea0-7933-4711-a585-23aa08887c65-certificates\") pod \"keda-operator-7dc85965f-mz2lc\" (UID: \"b4f68ea0-7933-4711-a585-23aa08887c65\") " pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.582227 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.582120 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/b4f68ea0-7933-4711-a585-23aa08887c65-cabundle0\") pod \"keda-operator-7dc85965f-mz2lc\" (UID: \"b4f68ea0-7933-4711-a585-23aa08887c65\") " pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.582227 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.582143 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q97j\" (UniqueName: \"kubernetes.io/projected/b4f68ea0-7933-4711-a585-23aa08887c65-kube-api-access-5q97j\") pod \"keda-operator-7dc85965f-mz2lc\" (UID: \"b4f68ea0-7933-4711-a585-23aa08887c65\") " pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.682947 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.682887 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b4f68ea0-7933-4711-a585-23aa08887c65-certificates\") pod \"keda-operator-7dc85965f-mz2lc\" (UID: \"b4f68ea0-7933-4711-a585-23aa08887c65\") " pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.682947 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.682914 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/b4f68ea0-7933-4711-a585-23aa08887c65-cabundle0\") pod \"keda-operator-7dc85965f-mz2lc\" (UID: \"b4f68ea0-7933-4711-a585-23aa08887c65\") " pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.682947 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.682934 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q97j\" (UniqueName: \"kubernetes.io/projected/b4f68ea0-7933-4711-a585-23aa08887c65-kube-api-access-5q97j\") pod \"keda-operator-7dc85965f-mz2lc\" (UID: \"b4f68ea0-7933-4711-a585-23aa08887c65\") " pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.683559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.683542 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/b4f68ea0-7933-4711-a585-23aa08887c65-cabundle0\") pod \"keda-operator-7dc85965f-mz2lc\" (UID: \"b4f68ea0-7933-4711-a585-23aa08887c65\") " pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.685215 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.685198 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b4f68ea0-7933-4711-a585-23aa08887c65-certificates\") pod \"keda-operator-7dc85965f-mz2lc\" (UID: \"b4f68ea0-7933-4711-a585-23aa08887c65\") " pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.718716 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.718691 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q97j\" (UniqueName: \"kubernetes.io/projected/b4f68ea0-7933-4711-a585-23aa08887c65-kube-api-access-5q97j\") pod \"keda-operator-7dc85965f-mz2lc\" (UID: \"b4f68ea0-7933-4711-a585-23aa08887c65\") " pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.720489 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.720472 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:01:55.903317 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.903277 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj"] Oct 30 22:01:55.905524 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.905499 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:55.920248 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.920226 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Oct 30 22:01:55.927674 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:55.927648 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj"] Oct 30 22:01:56.011748 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.011669 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-mz2lc"] Oct 30 22:01:56.016774 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:01:56.016746 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f68ea0_7933_4711_a585_23aa08887c65.slice/crio-9f50a04de654b3bf4110409757c37f59658a3cfafaf36446e37a5a49499dc769 WatchSource:0}: Error finding container 9f50a04de654b3bf4110409757c37f59658a3cfafaf36446e37a5a49499dc769: Status 404 returned error can't find the container with id 9f50a04de654b3bf4110409757c37f59658a3cfafaf36446e37a5a49499dc769 Oct 30 22:01:56.085328 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.085293 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccgtq\" (UniqueName: \"kubernetes.io/projected/9ecac275-b1dc-4923-a138-1c26a3446ba6-kube-api-access-ccgtq\") pod \"keda-metrics-apiserver-86bd856cfb-cx5rj\" (UID: \"9ecac275-b1dc-4923-a138-1c26a3446ba6\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:56.085490 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.085345 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9ecac275-b1dc-4923-a138-1c26a3446ba6-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-cx5rj\" (UID: \"9ecac275-b1dc-4923-a138-1c26a3446ba6\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:56.085490 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.085449 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9ecac275-b1dc-4923-a138-1c26a3446ba6-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-cx5rj\" (UID: \"9ecac275-b1dc-4923-a138-1c26a3446ba6\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:56.186077 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.186043 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9ecac275-b1dc-4923-a138-1c26a3446ba6-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-cx5rj\" (UID: \"9ecac275-b1dc-4923-a138-1c26a3446ba6\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:56.186228 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.186098 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccgtq\" (UniqueName: \"kubernetes.io/projected/9ecac275-b1dc-4923-a138-1c26a3446ba6-kube-api-access-ccgtq\") pod \"keda-metrics-apiserver-86bd856cfb-cx5rj\" (UID: \"9ecac275-b1dc-4923-a138-1c26a3446ba6\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:56.186228 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.186121 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9ecac275-b1dc-4923-a138-1c26a3446ba6-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-cx5rj\" (UID: \"9ecac275-b1dc-4923-a138-1c26a3446ba6\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:56.186439 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.186419 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9ecac275-b1dc-4923-a138-1c26a3446ba6-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-cx5rj\" (UID: \"9ecac275-b1dc-4923-a138-1c26a3446ba6\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:56.188520 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.188494 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9ecac275-b1dc-4923-a138-1c26a3446ba6-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-cx5rj\" (UID: \"9ecac275-b1dc-4923-a138-1c26a3446ba6\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:56.209423 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.209395 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccgtq\" (UniqueName: \"kubernetes.io/projected/9ecac275-b1dc-4923-a138-1c26a3446ba6-kube-api-access-ccgtq\") pod \"keda-metrics-apiserver-86bd856cfb-cx5rj\" (UID: \"9ecac275-b1dc-4923-a138-1c26a3446ba6\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:56.216092 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.216074 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:01:56.220125 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.220103 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-q5nz2"] Oct 30 22:01:56.222374 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.222352 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" Oct 30 22:01:56.240843 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.240799 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Oct 30 22:01:56.255559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.255529 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-q5nz2"] Oct 30 22:01:56.388142 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.388109 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vngkx\" (UniqueName: \"kubernetes.io/projected/07987e6a-3e0b-4085-a1c3-ede487a72b95-kube-api-access-vngkx\") pod \"keda-admission-7b7c985c58-q5nz2\" (UID: \"07987e6a-3e0b-4085-a1c3-ede487a72b95\") " pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" Oct 30 22:01:56.388307 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.388229 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/07987e6a-3e0b-4085-a1c3-ede487a72b95-certificates\") pod \"keda-admission-7b7c985c58-q5nz2\" (UID: \"07987e6a-3e0b-4085-a1c3-ede487a72b95\") " pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" Oct 30 22:01:56.489550 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.489508 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/07987e6a-3e0b-4085-a1c3-ede487a72b95-certificates\") pod \"keda-admission-7b7c985c58-q5nz2\" (UID: \"07987e6a-3e0b-4085-a1c3-ede487a72b95\") " pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" Oct 30 22:01:56.489953 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.489560 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vngkx\" (UniqueName: \"kubernetes.io/projected/07987e6a-3e0b-4085-a1c3-ede487a72b95-kube-api-access-vngkx\") pod \"keda-admission-7b7c985c58-q5nz2\" (UID: \"07987e6a-3e0b-4085-a1c3-ede487a72b95\") " pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" Oct 30 22:01:56.491996 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.491971 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/07987e6a-3e0b-4085-a1c3-ede487a72b95-certificates\") pod \"keda-admission-7b7c985c58-q5nz2\" (UID: \"07987e6a-3e0b-4085-a1c3-ede487a72b95\") " pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" Oct 30 22:01:56.514163 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.514103 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj"] Oct 30 22:01:56.516810 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.516792 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vngkx\" (UniqueName: \"kubernetes.io/projected/07987e6a-3e0b-4085-a1c3-ede487a72b95-kube-api-access-vngkx\") pod \"keda-admission-7b7c985c58-q5nz2\" (UID: \"07987e6a-3e0b-4085-a1c3-ede487a72b95\") " pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" Oct 30 22:01:56.518643 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:01:56.518619 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ecac275_b1dc_4923_a138_1c26a3446ba6.slice/crio-fbb8f7ee2704bd10937314e3eb6394b1d8c3840593d777eda0f02e1108cf34a4 WatchSource:0}: Error finding container fbb8f7ee2704bd10937314e3eb6394b1d8c3840593d777eda0f02e1108cf34a4: Status 404 returned error can't find the container with id fbb8f7ee2704bd10937314e3eb6394b1d8c3840593d777eda0f02e1108cf34a4 Oct 30 22:01:56.534907 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.534886 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" Oct 30 22:01:56.830219 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.829641 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-q5nz2"] Oct 30 22:01:56.834423 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:01:56.834391 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07987e6a_3e0b_4085_a1c3_ede487a72b95.slice/crio-795edf8545e34dffc9388f22a8b186ca3b30f551c60c0a29b9a1120cbc6fc7f1 WatchSource:0}: Error finding container 795edf8545e34dffc9388f22a8b186ca3b30f551c60c0a29b9a1120cbc6fc7f1: Status 404 returned error can't find the container with id 795edf8545e34dffc9388f22a8b186ca3b30f551c60c0a29b9a1120cbc6fc7f1 Oct 30 22:01:56.996508 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.996472 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-mz2lc" event={"ID":"b4f68ea0-7933-4711-a585-23aa08887c65","Type":"ContainerStarted","Data":"9f50a04de654b3bf4110409757c37f59658a3cfafaf36446e37a5a49499dc769"} Oct 30 22:01:56.997733 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.997702 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" event={"ID":"07987e6a-3e0b-4085-a1c3-ede487a72b95","Type":"ContainerStarted","Data":"795edf8545e34dffc9388f22a8b186ca3b30f551c60c0a29b9a1120cbc6fc7f1"} Oct 30 22:01:56.999032 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:56.999003 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" event={"ID":"9ecac275-b1dc-4923-a138-1c26a3446ba6","Type":"ContainerStarted","Data":"fbb8f7ee2704bd10937314e3eb6394b1d8c3840593d777eda0f02e1108cf34a4"} Oct 30 22:01:59.010838 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:59.010788 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" event={"ID":"07987e6a-3e0b-4085-a1c3-ede487a72b95","Type":"ContainerStarted","Data":"5ad0fbb6614d43a71c2be0d40eb7409252b5aaa0f69377467ed63227648919c6"} Oct 30 22:01:59.011614 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:59.011591 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" Oct 30 22:01:59.050533 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:01:59.050470 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" podStartSLOduration=1.392172224 podStartE2EDuration="3.050448398s" totalImagesPullingTime="1.658276174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:59.049602284 +0000 UTC m=+431.559473844" watchObservedRunningTime="2026-10-30 22:01:59.050448398 +0000 UTC m=+431.560319960" Oct 30 22:02:00.020657 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:02:00.020613 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-mz2lc" event={"ID":"b4f68ea0-7933-4711-a585-23aa08887c65","Type":"ContainerStarted","Data":"55c19043f927593543472f5f47f0fd985ec7f25ee443c958b402103e75dce116"} Oct 30 22:02:00.021176 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:02:00.020764 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:02:00.022367 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:02:00.022340 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" event={"ID":"9ecac275-b1dc-4923-a138-1c26a3446ba6","Type":"ContainerStarted","Data":"8efa0ef1786cc60fde437fbfada441da018ff2f9b27a040ce77d1404e2b54be5"} Oct 30 22:02:00.022518 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:02:00.022499 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:02:00.062007 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:02:00.061934 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-operator-7dc85965f-mz2lc" podStartSLOduration=1.568345113 podStartE2EDuration="5.061921845s" totalImagesPullingTime="3.493576732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:00.061098111 +0000 UTC m=+432.570969683" watchObservedRunningTime="2026-10-30 22:02:00.061921845 +0000 UTC m=+432.571793404" Oct 30 22:02:00.100171 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:02:00.100115 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" podStartSLOduration=2.242541017 podStartE2EDuration="5.100100771s" totalImagesPullingTime="2.857559754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:00.099910772 +0000 UTC m=+432.609782343" watchObservedRunningTime="2026-10-30 22:02:00.100100771 +0000 UTC m=+432.609972332" Oct 30 22:02:11.030428 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:02:11.030394 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-cx5rj" Oct 30 22:02:15.992896 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:02:15.992864 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-rpbvr" Oct 30 22:02:21.028528 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:02:21.028497 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-7dc85965f-mz2lc" Oct 30 22:02:21.029043 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:02:21.028582 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-7b7c985c58-q5nz2" Oct 30 22:02:24.094871 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:02:24.094836 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:02:54.095296 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:02:54.095258 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:03:16.415440 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.415400 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7bbc5d6b46-nk9rp"] Oct 30 22:03:16.417672 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.417654 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:03:16.433025 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.433008 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Oct 30 22:03:16.442781 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.442760 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Oct 30 22:03:16.442896 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.442842 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Oct 30 22:03:16.442958 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.442914 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-5kb2s\"" Oct 30 22:03:16.443862 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.443844 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7bbc5d6b46-nk9rp"] Oct 30 22:03:16.469464 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.469437 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5"] Oct 30 22:03:16.471684 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.471665 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" Oct 30 22:03:16.495239 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.495213 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Oct 30 22:03:16.495440 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.495420 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-k8jtx\"" Oct 30 22:03:16.496320 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.496296 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5"] Oct 30 22:03:16.505298 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.505273 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-8krdj"] Oct 30 22:03:16.507736 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.507715 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-8krdj" Oct 30 22:03:16.528063 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.528033 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-8krdj"] Oct 30 22:03:16.533841 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.533805 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-xf6xv\"" Oct 30 22:03:16.533950 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.533846 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Oct 30 22:03:16.536752 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.536732 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8d6ddcbc-eb15-48a2-9b8d-e78b69040443-data\") pod \"seaweedfs-78bb9c6ff8-8krdj\" (UID: \"8d6ddcbc-eb15-48a2-9b8d-e78b69040443\") " pod="kserve/seaweedfs-78bb9c6ff8-8krdj" Oct 30 22:03:16.536873 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.536778 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c146d83-fd34-47d1-a490-ac9ee3b0815c-cert\") pod \"kserve-controller-manager-7bbc5d6b46-nk9rp\" (UID: \"5c146d83-fd34-47d1-a490-ac9ee3b0815c\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:03:16.536940 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.536869 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c204b677-929d-4c13-b318-a8c878e854c1-cert\") pod \"llmisvc-controller-manager-85b8fbffd9-xx6z5\" (UID: \"c204b677-929d-4c13-b318-a8c878e854c1\") " pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" Oct 30 22:03:16.537000 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.536934 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtt4h\" (UniqueName: \"kubernetes.io/projected/5c146d83-fd34-47d1-a490-ac9ee3b0815c-kube-api-access-xtt4h\") pod \"kserve-controller-manager-7bbc5d6b46-nk9rp\" (UID: \"5c146d83-fd34-47d1-a490-ac9ee3b0815c\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:03:16.537063 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.537044 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gszkf\" (UniqueName: \"kubernetes.io/projected/c204b677-929d-4c13-b318-a8c878e854c1-kube-api-access-gszkf\") pod \"llmisvc-controller-manager-85b8fbffd9-xx6z5\" (UID: \"c204b677-929d-4c13-b318-a8c878e854c1\") " pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" Oct 30 22:03:16.537130 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.537077 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grwcs\" (UniqueName: \"kubernetes.io/projected/8d6ddcbc-eb15-48a2-9b8d-e78b69040443-kube-api-access-grwcs\") pod \"seaweedfs-78bb9c6ff8-8krdj\" (UID: \"8d6ddcbc-eb15-48a2-9b8d-e78b69040443\") " pod="kserve/seaweedfs-78bb9c6ff8-8krdj" Oct 30 22:03:16.637990 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.637949 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtt4h\" (UniqueName: \"kubernetes.io/projected/5c146d83-fd34-47d1-a490-ac9ee3b0815c-kube-api-access-xtt4h\") pod \"kserve-controller-manager-7bbc5d6b46-nk9rp\" (UID: \"5c146d83-fd34-47d1-a490-ac9ee3b0815c\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:03:16.638193 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.637998 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gszkf\" (UniqueName: \"kubernetes.io/projected/c204b677-929d-4c13-b318-a8c878e854c1-kube-api-access-gszkf\") pod \"llmisvc-controller-manager-85b8fbffd9-xx6z5\" (UID: \"c204b677-929d-4c13-b318-a8c878e854c1\") " pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" Oct 30 22:03:16.638193 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.638027 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grwcs\" (UniqueName: \"kubernetes.io/projected/8d6ddcbc-eb15-48a2-9b8d-e78b69040443-kube-api-access-grwcs\") pod \"seaweedfs-78bb9c6ff8-8krdj\" (UID: \"8d6ddcbc-eb15-48a2-9b8d-e78b69040443\") " pod="kserve/seaweedfs-78bb9c6ff8-8krdj" Oct 30 22:03:16.638193 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.638063 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8d6ddcbc-eb15-48a2-9b8d-e78b69040443-data\") pod \"seaweedfs-78bb9c6ff8-8krdj\" (UID: \"8d6ddcbc-eb15-48a2-9b8d-e78b69040443\") " pod="kserve/seaweedfs-78bb9c6ff8-8krdj" Oct 30 22:03:16.638193 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.638095 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c146d83-fd34-47d1-a490-ac9ee3b0815c-cert\") pod \"kserve-controller-manager-7bbc5d6b46-nk9rp\" (UID: \"5c146d83-fd34-47d1-a490-ac9ee3b0815c\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:03:16.638193 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.638115 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c204b677-929d-4c13-b318-a8c878e854c1-cert\") pod \"llmisvc-controller-manager-85b8fbffd9-xx6z5\" (UID: \"c204b677-929d-4c13-b318-a8c878e854c1\") " pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" Oct 30 22:03:16.638505 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.638483 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8d6ddcbc-eb15-48a2-9b8d-e78b69040443-data\") pod \"seaweedfs-78bb9c6ff8-8krdj\" (UID: \"8d6ddcbc-eb15-48a2-9b8d-e78b69040443\") " pod="kserve/seaweedfs-78bb9c6ff8-8krdj" Oct 30 22:03:16.640549 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.640530 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c204b677-929d-4c13-b318-a8c878e854c1-cert\") pod \"llmisvc-controller-manager-85b8fbffd9-xx6z5\" (UID: \"c204b677-929d-4c13-b318-a8c878e854c1\") " pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" Oct 30 22:03:16.640642 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.640553 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c146d83-fd34-47d1-a490-ac9ee3b0815c-cert\") pod \"kserve-controller-manager-7bbc5d6b46-nk9rp\" (UID: \"5c146d83-fd34-47d1-a490-ac9ee3b0815c\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:03:16.657888 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.657857 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtt4h\" (UniqueName: \"kubernetes.io/projected/5c146d83-fd34-47d1-a490-ac9ee3b0815c-kube-api-access-xtt4h\") pod \"kserve-controller-manager-7bbc5d6b46-nk9rp\" (UID: \"5c146d83-fd34-47d1-a490-ac9ee3b0815c\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:03:16.658035 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.657892 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grwcs\" (UniqueName: \"kubernetes.io/projected/8d6ddcbc-eb15-48a2-9b8d-e78b69040443-kube-api-access-grwcs\") pod \"seaweedfs-78bb9c6ff8-8krdj\" (UID: \"8d6ddcbc-eb15-48a2-9b8d-e78b69040443\") " pod="kserve/seaweedfs-78bb9c6ff8-8krdj" Oct 30 22:03:16.658035 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.657938 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gszkf\" (UniqueName: \"kubernetes.io/projected/c204b677-929d-4c13-b318-a8c878e854c1-kube-api-access-gszkf\") pod \"llmisvc-controller-manager-85b8fbffd9-xx6z5\" (UID: \"c204b677-929d-4c13-b318-a8c878e854c1\") " pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" Oct 30 22:03:16.727958 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.727874 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:03:16.783310 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.783272 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" Oct 30 22:03:16.819774 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:16.819743 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-8krdj" Oct 30 22:03:17.022778 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:17.022703 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7bbc5d6b46-nk9rp"] Oct 30 22:03:17.028741 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:03:17.028709 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c146d83_fd34_47d1_a490_ac9ee3b0815c.slice/crio-13462a1661106f852a59d9729611b0c2dbffbb80c6d57e15a6c972dd6f355724 WatchSource:0}: Error finding container 13462a1661106f852a59d9729611b0c2dbffbb80c6d57e15a6c972dd6f355724: Status 404 returned error can't find the container with id 13462a1661106f852a59d9729611b0c2dbffbb80c6d57e15a6c972dd6f355724 Oct 30 22:03:17.087116 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:17.087089 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5"] Oct 30 22:03:17.091414 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:03:17.091386 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc204b677_929d_4c13_b318_a8c878e854c1.slice/crio-bed3f3344f3dce42552a93bcc75839ad813eb2da88e00557b00c5bc1838369c1 WatchSource:0}: Error finding container bed3f3344f3dce42552a93bcc75839ad813eb2da88e00557b00c5bc1838369c1: Status 404 returned error can't find the container with id bed3f3344f3dce42552a93bcc75839ad813eb2da88e00557b00c5bc1838369c1 Oct 30 22:03:17.123947 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:17.123917 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-8krdj"] Oct 30 22:03:17.128117 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:03:17.128097 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d6ddcbc_eb15_48a2_9b8d_e78b69040443.slice/crio-5492589a7edc01ec86cf1a866001331f27a700b990eeff11520db1117fd72740 WatchSource:0}: Error finding container 5492589a7edc01ec86cf1a866001331f27a700b990eeff11520db1117fd72740: Status 404 returned error can't find the container with id 5492589a7edc01ec86cf1a866001331f27a700b990eeff11520db1117fd72740 Oct 30 22:03:17.291236 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:17.291148 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-8krdj" event={"ID":"8d6ddcbc-eb15-48a2-9b8d-e78b69040443","Type":"ContainerStarted","Data":"5492589a7edc01ec86cf1a866001331f27a700b990eeff11520db1117fd72740"} Oct 30 22:03:17.292403 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:17.292377 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" event={"ID":"5c146d83-fd34-47d1-a490-ac9ee3b0815c","Type":"ContainerStarted","Data":"13462a1661106f852a59d9729611b0c2dbffbb80c6d57e15a6c972dd6f355724"} Oct 30 22:03:17.293432 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:17.293410 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" event={"ID":"c204b677-929d-4c13-b318-a8c878e854c1","Type":"ContainerStarted","Data":"bed3f3344f3dce42552a93bcc75839ad813eb2da88e00557b00c5bc1838369c1"} Oct 30 22:03:21.314089 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:21.314052 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-8krdj" event={"ID":"8d6ddcbc-eb15-48a2-9b8d-e78b69040443","Type":"ContainerStarted","Data":"e6a56730c93aaa734842766546a0899ae205e3f97bcc24bd807a2b50cfe3eb64"} Oct 30 22:03:21.314545 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:21.314134 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-78bb9c6ff8-8krdj" Oct 30 22:03:21.315634 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:21.315602 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" event={"ID":"5c146d83-fd34-47d1-a490-ac9ee3b0815c","Type":"ContainerStarted","Data":"c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072"} Oct 30 22:03:21.315735 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:21.315713 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:03:21.316917 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:21.316894 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" event={"ID":"c204b677-929d-4c13-b318-a8c878e854c1","Type":"ContainerStarted","Data":"5b9e29c25e82f020e9c4a3c3a0a80668564d0db1f1508bec41589fd1671c6943"} Oct 30 22:03:21.317034 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:21.317022 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" Oct 30 22:03:21.353712 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:21.353118 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/seaweedfs-78bb9c6ff8-8krdj" podStartSLOduration=1.6394060929999998 podStartE2EDuration="5.353103993s" totalImagesPullingTime="3.7136979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:21.352556528 +0000 UTC m=+513.862428092" watchObservedRunningTime="2026-10-30 22:03:21.353103993 +0000 UTC m=+513.862975554" Oct 30 22:03:21.392498 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:21.392460 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" podStartSLOduration=1.831614263 podStartE2EDuration="5.392448327s" totalImagesPullingTime="3.560834064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:21.392134714 +0000 UTC m=+513.902006276" watchObservedRunningTime="2026-10-30 22:03:21.392448327 +0000 UTC m=+513.902319886" Oct 30 22:03:21.432875 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:21.432808 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" podStartSLOduration=1.856599538 podStartE2EDuration="5.432794722s" totalImagesPullingTime="3.576195184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:21.43253837 +0000 UTC m=+513.942409943" watchObservedRunningTime="2026-10-30 22:03:21.432794722 +0000 UTC m=+513.942666281" Oct 30 22:03:24.095315 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:03:24.095276 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:03:27.323427 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:27.323399 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-78bb9c6ff8-8krdj" Oct 30 22:03:52.323670 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:52.323634 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-85b8fbffd9-xx6z5" Oct 30 22:03:52.326498 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:03:52.326478 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:03:54.096664 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:03:54.096564 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:04:03.841118 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:03.841033 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7bbc5d6b46-nk9rp"] Oct 30 22:04:03.841665 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:03.841288 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" podUID="5c146d83-fd34-47d1-a490-ac9ee3b0815c" containerName="manager" containerID="cri-o://c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072" gracePeriod=10 Oct 30 22:04:03.867119 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:03.867084 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7bbc5d6b46-t7nlk"] Oct 30 22:04:03.869264 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:03.869250 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" Oct 30 22:04:03.892775 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:03.892751 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7bbc5d6b46-t7nlk"] Oct 30 22:04:04.002852 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.002802 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f580314e-bcf6-481f-a4f4-c2cc5228b6db-cert\") pod \"kserve-controller-manager-7bbc5d6b46-t7nlk\" (UID: \"f580314e-bcf6-481f-a4f4-c2cc5228b6db\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" Oct 30 22:04:04.003002 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.002882 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2hvc\" (UniqueName: \"kubernetes.io/projected/f580314e-bcf6-481f-a4f4-c2cc5228b6db-kube-api-access-k2hvc\") pod \"kserve-controller-manager-7bbc5d6b46-t7nlk\" (UID: \"f580314e-bcf6-481f-a4f4-c2cc5228b6db\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" Oct 30 22:04:04.077547 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.077525 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:04:04.103874 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.103798 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f580314e-bcf6-481f-a4f4-c2cc5228b6db-cert\") pod \"kserve-controller-manager-7bbc5d6b46-t7nlk\" (UID: \"f580314e-bcf6-481f-a4f4-c2cc5228b6db\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" Oct 30 22:04:04.103991 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.103882 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2hvc\" (UniqueName: \"kubernetes.io/projected/f580314e-bcf6-481f-a4f4-c2cc5228b6db-kube-api-access-k2hvc\") pod \"kserve-controller-manager-7bbc5d6b46-t7nlk\" (UID: \"f580314e-bcf6-481f-a4f4-c2cc5228b6db\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" Oct 30 22:04:04.106184 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.106152 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f580314e-bcf6-481f-a4f4-c2cc5228b6db-cert\") pod \"kserve-controller-manager-7bbc5d6b46-t7nlk\" (UID: \"f580314e-bcf6-481f-a4f4-c2cc5228b6db\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" Oct 30 22:04:04.127348 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.124471 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2hvc\" (UniqueName: \"kubernetes.io/projected/f580314e-bcf6-481f-a4f4-c2cc5228b6db-kube-api-access-k2hvc\") pod \"kserve-controller-manager-7bbc5d6b46-t7nlk\" (UID: \"f580314e-bcf6-481f-a4f4-c2cc5228b6db\") " pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" Oct 30 22:04:04.205065 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.205033 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c146d83-fd34-47d1-a490-ac9ee3b0815c-kube-api-access-xtt4h\" (UniqueName: \"kubernetes.io/projected/5c146d83-fd34-47d1-a490-ac9ee3b0815c-kube-api-access-xtt4h\") pod \"5c146d83-fd34-47d1-a490-ac9ee3b0815c\" (UID: \"5c146d83-fd34-47d1-a490-ac9ee3b0815c\") " Oct 30 22:04:04.205244 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.205088 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c146d83-fd34-47d1-a490-ac9ee3b0815c-cert\" (UniqueName: \"kubernetes.io/secret/5c146d83-fd34-47d1-a490-ac9ee3b0815c-cert\") pod \"5c146d83-fd34-47d1-a490-ac9ee3b0815c\" (UID: \"5c146d83-fd34-47d1-a490-ac9ee3b0815c\") " Oct 30 22:04:04.207188 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.207159 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c146d83-fd34-47d1-a490-ac9ee3b0815c-kube-api-access-xtt4h" pod "5c146d83-fd34-47d1-a490-ac9ee3b0815c" (UID: "5c146d83-fd34-47d1-a490-ac9ee3b0815c"). InnerVolumeSpecName "kube-api-access-xtt4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:04:04.207276 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.207181 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c146d83-fd34-47d1-a490-ac9ee3b0815c-cert" pod "5c146d83-fd34-47d1-a490-ac9ee3b0815c" (UID: "5c146d83-fd34-47d1-a490-ac9ee3b0815c"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:04:04.224422 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.224400 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" Oct 30 22:04:04.306344 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.306317 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtt4h\" (UniqueName: \"kubernetes.io/projected/5c146d83-fd34-47d1-a490-ac9ee3b0815c-kube-api-access-xtt4h\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:04:04.306344 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.306343 6162 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c146d83-fd34-47d1-a490-ac9ee3b0815c-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:04:04.475120 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.475094 6162 generic.go:356] "Generic (PLEG): container finished" podID="5c146d83-fd34-47d1-a490-ac9ee3b0815c" containerID="c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072" exitCode=0 Oct 30 22:04:04.475273 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.475148 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" Oct 30 22:04:04.475273 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.475170 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" event={"ID":"5c146d83-fd34-47d1-a490-ac9ee3b0815c","Type":"ContainerDied","Data":"c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072"} Oct 30 22:04:04.475273 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.475243 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7bbc5d6b46-nk9rp" event={"ID":"5c146d83-fd34-47d1-a490-ac9ee3b0815c","Type":"ContainerDied","Data":"13462a1661106f852a59d9729611b0c2dbffbb80c6d57e15a6c972dd6f355724"} Oct 30 22:04:04.475273 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.475266 6162 scope.go:122] "RemoveContainer" containerID="c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072" Oct 30 22:04:04.483291 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.483271 6162 scope.go:122] "RemoveContainer" containerID="c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072" Oct 30 22:04:04.483539 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:04:04.483519 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072\": container with ID starting with c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072 not found: ID does not exist" containerID="c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072" Oct 30 22:04:04.483618 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.483551 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072"} err="failed to get container status \"c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072\": rpc error: code = NotFound desc = could not find container \"c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072\": container with ID starting with c9239866ae628806954022457a678b0ba0e98e60b62cd10ce154bb9e24224072 not found: ID does not exist" Oct 30 22:04:04.510468 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.510451 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7bbc5d6b46-t7nlk"] Oct 30 22:04:04.513056 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:04:04.513029 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf580314e_bcf6_481f_a4f4_c2cc5228b6db.slice/crio-57c000fa198379f5f08f490cda1dc3642d850f4d54d6c1a3e1c08a180bf1cae4 WatchSource:0}: Error finding container 57c000fa198379f5f08f490cda1dc3642d850f4d54d6c1a3e1c08a180bf1cae4: Status 404 returned error can't find the container with id 57c000fa198379f5f08f490cda1dc3642d850f4d54d6c1a3e1c08a180bf1cae4 Oct 30 22:04:04.523746 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.523726 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7bbc5d6b46-nk9rp"] Oct 30 22:04:04.529585 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:04.529559 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-7bbc5d6b46-nk9rp"] Oct 30 22:04:05.481551 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:05.481517 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" event={"ID":"f580314e-bcf6-481f-a4f4-c2cc5228b6db","Type":"ContainerStarted","Data":"cfedec2cb4278f723ef489400b6c9e8ea2c76f20701154bad60406fa6d963156"} Oct 30 22:04:05.481965 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:05.481564 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" event={"ID":"f580314e-bcf6-481f-a4f4-c2cc5228b6db","Type":"ContainerStarted","Data":"57c000fa198379f5f08f490cda1dc3642d850f4d54d6c1a3e1c08a180bf1cae4"} Oct 30 22:04:05.481965 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:05.481656 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" Oct 30 22:04:05.522036 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:05.521989 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" podStartSLOduration=2.245746436 podStartE2EDuration="2.521975725s" totalImagesPullingTime="276.229289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:05.520835342 +0000 UTC m=+558.030706896" watchObservedRunningTime="2026-10-30 22:04:05.521975725 +0000 UTC m=+558.031847286" Oct 30 22:04:05.593471 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:05.593446 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c146d83-fd34-47d1-a490-ac9ee3b0815c" path="/var/lib/kubelet/pods/5c146d83-fd34-47d1-a490-ac9ee3b0815c/volumes" Oct 30 22:04:24.095608 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:04:24.095573 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:04:36.488588 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:36.488560 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7bbc5d6b46-t7nlk" Oct 30 22:04:38.504807 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.504771 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-56ddc4c448-zdd98"] Oct 30 22:04:38.505357 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.505183 6162 cpu_manager.go:414] "containerMap: removing container" podUID="5c146d83-fd34-47d1-a490-ac9ee3b0815c" containerName="manager" Oct 30 22:04:38.505357 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.505197 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c146d83-fd34-47d1-a490-ac9ee3b0815c" containerName="manager" Oct 30 22:04:38.505357 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.505263 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c146d83-fd34-47d1-a490-ac9ee3b0815c" containerName="manager" Oct 30 22:04:38.507104 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.507089 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-56ddc4c448-zdd98" Oct 30 22:04:38.530001 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.529977 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Oct 30 22:04:38.532528 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.532510 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-mm4d8\"" Oct 30 22:04:38.533429 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.533413 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-56ddc4c448-zdd98"] Oct 30 22:04:38.535964 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.535939 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh6q6\" (UniqueName: \"kubernetes.io/projected/8d5cb391-b313-4ec9-abcd-b016cd71e625-kube-api-access-vh6q6\") pod \"model-serving-api-56ddc4c448-zdd98\" (UID: \"8d5cb391-b313-4ec9-abcd-b016cd71e625\") " pod="kserve/model-serving-api-56ddc4c448-zdd98" Oct 30 22:04:38.536065 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.535972 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d5cb391-b313-4ec9-abcd-b016cd71e625-tls-certs\") pod \"model-serving-api-56ddc4c448-zdd98\" (UID: \"8d5cb391-b313-4ec9-abcd-b016cd71e625\") " pod="kserve/model-serving-api-56ddc4c448-zdd98" Oct 30 22:04:38.636999 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.636968 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh6q6\" (UniqueName: \"kubernetes.io/projected/8d5cb391-b313-4ec9-abcd-b016cd71e625-kube-api-access-vh6q6\") pod \"model-serving-api-56ddc4c448-zdd98\" (UID: \"8d5cb391-b313-4ec9-abcd-b016cd71e625\") " pod="kserve/model-serving-api-56ddc4c448-zdd98" Oct 30 22:04:38.637176 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.637005 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d5cb391-b313-4ec9-abcd-b016cd71e625-tls-certs\") pod \"model-serving-api-56ddc4c448-zdd98\" (UID: \"8d5cb391-b313-4ec9-abcd-b016cd71e625\") " pod="kserve/model-serving-api-56ddc4c448-zdd98" Oct 30 22:04:38.639384 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.639362 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d5cb391-b313-4ec9-abcd-b016cd71e625-tls-certs\") pod \"model-serving-api-56ddc4c448-zdd98\" (UID: \"8d5cb391-b313-4ec9-abcd-b016cd71e625\") " pod="kserve/model-serving-api-56ddc4c448-zdd98" Oct 30 22:04:38.656605 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.656579 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh6q6\" (UniqueName: \"kubernetes.io/projected/8d5cb391-b313-4ec9-abcd-b016cd71e625-kube-api-access-vh6q6\") pod \"model-serving-api-56ddc4c448-zdd98\" (UID: \"8d5cb391-b313-4ec9-abcd-b016cd71e625\") " pod="kserve/model-serving-api-56ddc4c448-zdd98" Oct 30 22:04:38.818277 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:38.818191 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-56ddc4c448-zdd98" Oct 30 22:04:39.107908 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:39.107887 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-56ddc4c448-zdd98"] Oct 30 22:04:39.110720 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:04:39.110693 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5cb391_b313_4ec9_abcd_b016cd71e625.slice/crio-0a1105fc71f8bb1049d98950f74c5667b41706dad3f1bf04139ae4a3abac7e27 WatchSource:0}: Error finding container 0a1105fc71f8bb1049d98950f74c5667b41706dad3f1bf04139ae4a3abac7e27: Status 404 returned error can't find the container with id 0a1105fc71f8bb1049d98950f74c5667b41706dad3f1bf04139ae4a3abac7e27 Oct 30 22:04:39.615804 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:39.615768 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-56ddc4c448-zdd98" event={"ID":"8d5cb391-b313-4ec9-abcd-b016cd71e625","Type":"ContainerStarted","Data":"0a1105fc71f8bb1049d98950f74c5667b41706dad3f1bf04139ae4a3abac7e27"} Oct 30 22:04:40.620518 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:40.620490 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-56ddc4c448-zdd98" event={"ID":"8d5cb391-b313-4ec9-abcd-b016cd71e625","Type":"ContainerStarted","Data":"d91ce38faa58daa852671e75b25309a237932b02c9ecf6efbbd12939c3a012f8"} Oct 30 22:04:40.620854 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:40.620622 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-56ddc4c448-zdd98" Oct 30 22:04:40.671695 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:40.671658 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/model-serving-api-56ddc4c448-zdd98" podStartSLOduration=1.276411796 podStartE2EDuration="2.671646042s" totalImagesPullingTime="1.395234246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:40.660449613 +0000 UTC m=+593.170321173" watchObservedRunningTime="2026-10-30 22:04:40.671646042 +0000 UTC m=+593.181517601" Oct 30 22:04:47.640113 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:47.640086 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 22:04:47.641308 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:47.641288 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 22:04:51.627485 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:04:51.627454 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-56ddc4c448-zdd98" Oct 30 22:04:54.096232 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:04:54.096195 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:05:24.096099 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:05:24.096053 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:05:54.094978 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:05:54.094944 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:06:24.096333 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:06:24.096299 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:06:31.333158 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.333121 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2"] Oct 30 22:06:31.336586 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.336570 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.353139 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.353114 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-rollback-predictor-serving-cert\"" Oct 30 22:06:31.365057 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.365025 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"seaweedfs-s3-creds\"" Oct 30 22:06:31.365057 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.365025 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"default-dockercfg-d9bw2\"" Oct 30 22:06:31.366073 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.366047 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2"] Oct 30 22:06:31.373637 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.373617 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"kube-root-ca.crt\"" Oct 30 22:06:31.373637 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.373620 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:06:31.373784 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.373647 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"openshift-service-ca.crt\"" Oct 30 22:06:31.373784 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.373677 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\"" Oct 30 22:06:31.495562 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.495532 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wx4l\" (UniqueName: \"kubernetes.io/projected/93964ceb-4736-465e-9d30-06f9da1221d3-kube-api-access-6wx4l\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.495562 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.495570 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/93964ceb-4736-465e-9d30-06f9da1221d3-proxy-tls\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.495801 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.495676 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-cabundle-cert\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.495801 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.495785 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.495911 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.495811 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93964ceb-4736-465e-9d30-06f9da1221d3-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.597037 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.596959 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-cabundle-cert\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.597037 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.597014 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.597255 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.597126 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93964ceb-4736-465e-9d30-06f9da1221d3-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.597255 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.597179 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wx4l\" (UniqueName: \"kubernetes.io/projected/93964ceb-4736-465e-9d30-06f9da1221d3-kube-api-access-6wx4l\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.597255 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.597212 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/93964ceb-4736-465e-9d30-06f9da1221d3-proxy-tls\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.597521 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.597499 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93964ceb-4736-465e-9d30-06f9da1221d3-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.597732 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.597713 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.597795 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.597712 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-cabundle-cert\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.599610 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.599594 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/93964ceb-4736-465e-9d30-06f9da1221d3-proxy-tls\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.618039 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.618009 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wx4l\" (UniqueName: \"kubernetes.io/projected/93964ceb-4736-465e-9d30-06f9da1221d3-kube-api-access-6wx4l\") pod \"isvc-canary-rollback-predictor-75dd485c97-g8ss2\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.653200 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.653163 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:31.956754 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.956725 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2"] Oct 30 22:06:31.957865 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:06:31.957836 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93964ceb_4736_465e_9d30_06f9da1221d3.slice/crio-dfcd2eccda773ae20045cdfb63b5f8d47ff7354da995809effdd68ea613f14f8 WatchSource:0}: Error finding container dfcd2eccda773ae20045cdfb63b5f8d47ff7354da995809effdd68ea613f14f8: Status 404 returned error can't find the container with id dfcd2eccda773ae20045cdfb63b5f8d47ff7354da995809effdd68ea613f14f8 Oct 30 22:06:31.959978 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:31.959956 6162 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:06:32.035736 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:32.035697 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" event={"ID":"93964ceb-4736-465e-9d30-06f9da1221d3","Type":"ContainerStarted","Data":"dfcd2eccda773ae20045cdfb63b5f8d47ff7354da995809effdd68ea613f14f8"} Oct 30 22:06:36.053160 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:36.053126 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" event={"ID":"93964ceb-4736-465e-9d30-06f9da1221d3","Type":"ContainerStarted","Data":"cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc"} Oct 30 22:06:40.070109 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:40.070071 6162 generic.go:356] "Generic (PLEG): container finished" podID="93964ceb-4736-465e-9d30-06f9da1221d3" containerID="cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc" exitCode=0 Oct 30 22:06:40.070495 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:40.070125 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" event={"ID":"93964ceb-4736-465e-9d30-06f9da1221d3","Type":"ContainerDied","Data":"cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc"} Oct 30 22:06:54.099043 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:06:54.098998 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:06:54.139372 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:54.139337 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" event={"ID":"93964ceb-4736-465e-9d30-06f9da1221d3","Type":"ContainerStarted","Data":"9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5"} Oct 30 22:06:56.150703 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:56.150667 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" event={"ID":"93964ceb-4736-465e-9d30-06f9da1221d3","Type":"ContainerStarted","Data":"759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687"} Oct 30 22:06:56.151221 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:56.150837 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:56.208762 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:56.208710 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podStartSLOduration=2.613506106 podStartE2EDuration="25.208697163s" totalImagesPullingTime="18.671007341s" totalInitContainerRuntime="3.924183716s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:56.208465251 +0000 UTC m=+728.718336812" watchObservedRunningTime="2026-10-30 22:06:56.208697163 +0000 UTC m=+728.718568722" Oct 30 22:06:57.156350 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:57.156325 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:06:57.157356 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:57.157325 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:06:58.160080 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:06:58.160038 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:07:03.165019 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:07:03.164948 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:07:03.165473 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:07:03.165411 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:07:13.166432 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:07:13.166395 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:07:23.166355 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:07:23.166318 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:07:24.095862 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:07:24.095807 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:07:33.166291 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:07:33.166251 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:07:43.166013 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:07:43.165967 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:07:53.166140 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:07:53.166105 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:07:54.095920 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:07:54.095889 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:08:03.165502 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:08:03.165462 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:08:13.165981 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:08:13.165949 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:08:24.095647 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:08:24.095609 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:08:54.096953 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:08:54.096851 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:09:24.095856 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:09:24.095801 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:09:47.663148 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:09:47.663121 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 22:09:47.667084 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:09:47.667061 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 22:09:54.095721 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:09:54.095679 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:10:21.300908 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:21.300877 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2"] Oct 30 22:10:21.301458 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:21.301095 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" containerID="cri-o://9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5" gracePeriod=30 Oct 30 22:10:21.301458 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:21.301154 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kube-rbac-proxy" containerID="cri-o://759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687" gracePeriod=30 Oct 30 22:10:21.932240 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:21.932202 6162 generic.go:356] "Generic (PLEG): container finished" podID="93964ceb-4736-465e-9d30-06f9da1221d3" containerID="759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687" exitCode=0 Oct 30 22:10:21.932410 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:21.932272 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" event={"ID":"93964ceb-4736-465e-9d30-06f9da1221d3","Type":"ContainerDied","Data":"759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687"} Oct 30 22:10:23.161132 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:23.161090 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.23:8643/healthz\": dial tcp 10.133.0.23:8643: connect: connection refused" Oct 30 22:10:23.165491 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:23.165468 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:10:24.095373 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:10:24.095335 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:10:25.640147 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.640127 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:10:25.746745 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.746673 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-cabundle-cert\") pod \"93964ceb-4736-465e-9d30-06f9da1221d3\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " Oct 30 22:10:25.746745 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.746706 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93964ceb-4736-465e-9d30-06f9da1221d3-proxy-tls\" (UniqueName: \"kubernetes.io/secret/93964ceb-4736-465e-9d30-06f9da1221d3-proxy-tls\") pod \"93964ceb-4736-465e-9d30-06f9da1221d3\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " Oct 30 22:10:25.746745 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.746734 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-kube-rbac-proxy-sar-config\") pod \"93964ceb-4736-465e-9d30-06f9da1221d3\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " Oct 30 22:10:25.747038 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.746752 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93964ceb-4736-465e-9d30-06f9da1221d3-kube-api-access-6wx4l\" (UniqueName: \"kubernetes.io/projected/93964ceb-4736-465e-9d30-06f9da1221d3-kube-api-access-6wx4l\") pod \"93964ceb-4736-465e-9d30-06f9da1221d3\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " Oct 30 22:10:25.747038 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.746795 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93964ceb-4736-465e-9d30-06f9da1221d3-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93964ceb-4736-465e-9d30-06f9da1221d3-kserve-provision-location\") pod \"93964ceb-4736-465e-9d30-06f9da1221d3\" (UID: \"93964ceb-4736-465e-9d30-06f9da1221d3\") " Oct 30 22:10:25.747174 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.747150 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-cabundle-cert" pod "93964ceb-4736-465e-9d30-06f9da1221d3" (UID: "93964ceb-4736-465e-9d30-06f9da1221d3"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:25.747228 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.747189 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93964ceb-4736-465e-9d30-06f9da1221d3-kserve-provision-location" pod "93964ceb-4736-465e-9d30-06f9da1221d3" (UID: "93964ceb-4736-465e-9d30-06f9da1221d3"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:10:25.747228 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.747199 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-kube-rbac-proxy-sar-config" pod "93964ceb-4736-465e-9d30-06f9da1221d3" (UID: "93964ceb-4736-465e-9d30-06f9da1221d3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:25.748947 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.748923 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93964ceb-4736-465e-9d30-06f9da1221d3-proxy-tls" pod "93964ceb-4736-465e-9d30-06f9da1221d3" (UID: "93964ceb-4736-465e-9d30-06f9da1221d3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:10:25.749049 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.748997 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93964ceb-4736-465e-9d30-06f9da1221d3-kube-api-access-6wx4l" pod "93964ceb-4736-465e-9d30-06f9da1221d3" (UID: "93964ceb-4736-465e-9d30-06f9da1221d3"). InnerVolumeSpecName "kube-api-access-6wx4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:10:25.848110 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.848084 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/93964ceb-4736-465e-9d30-06f9da1221d3-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:10:25.848110 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.848105 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:10:25.848110 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.848114 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wx4l\" (UniqueName: \"kubernetes.io/projected/93964ceb-4736-465e-9d30-06f9da1221d3-kube-api-access-6wx4l\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:10:25.848274 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.848123 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93964ceb-4736-465e-9d30-06f9da1221d3-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:10:25.848274 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.848132 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/93964ceb-4736-465e-9d30-06f9da1221d3-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:10:25.949328 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.949294 6162 generic.go:356] "Generic (PLEG): container finished" podID="93964ceb-4736-465e-9d30-06f9da1221d3" containerID="9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5" exitCode=0 Oct 30 22:10:25.949436 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.949344 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" Oct 30 22:10:25.949436 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.949367 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" event={"ID":"93964ceb-4736-465e-9d30-06f9da1221d3","Type":"ContainerDied","Data":"9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5"} Oct 30 22:10:25.949436 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.949423 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2" event={"ID":"93964ceb-4736-465e-9d30-06f9da1221d3","Type":"ContainerDied","Data":"dfcd2eccda773ae20045cdfb63b5f8d47ff7354da995809effdd68ea613f14f8"} Oct 30 22:10:25.949546 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.949449 6162 scope.go:122] "RemoveContainer" containerID="759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687" Oct 30 22:10:25.958886 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.958802 6162 scope.go:122] "RemoveContainer" containerID="9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5" Oct 30 22:10:25.966022 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.966005 6162 scope.go:122] "RemoveContainer" containerID="cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc" Oct 30 22:10:25.972808 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.972791 6162 scope.go:122] "RemoveContainer" containerID="759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687" Oct 30 22:10:25.973094 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:10:25.973075 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687\": container with ID starting with 759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687 not found: ID does not exist" containerID="759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687" Oct 30 22:10:25.973150 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.973102 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687"} err="failed to get container status \"759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687\": rpc error: code = NotFound desc = could not find container \"759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687\": container with ID starting with 759b0c91a77319ac0ed527c601edb5234a589c471c90edf0a526900b2b701687 not found: ID does not exist" Oct 30 22:10:25.973150 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.973120 6162 scope.go:122] "RemoveContainer" containerID="9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5" Oct 30 22:10:25.973340 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:10:25.973319 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5\": container with ID starting with 9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5 not found: ID does not exist" containerID="9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5" Oct 30 22:10:25.973380 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.973347 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5"} err="failed to get container status \"9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5\": rpc error: code = NotFound desc = could not find container \"9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5\": container with ID starting with 9525e30c94aa7babb950a1981fc9dc96dcce1c75260e3d4cd558d7a54e0e92d5 not found: ID does not exist" Oct 30 22:10:25.973380 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.973362 6162 scope.go:122] "RemoveContainer" containerID="cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc" Oct 30 22:10:25.973578 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:10:25.973556 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc\": container with ID starting with cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc not found: ID does not exist" containerID="cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc" Oct 30 22:10:25.973620 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:25.973582 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc"} err="failed to get container status \"cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc\": rpc error: code = NotFound desc = could not find container \"cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc\": container with ID starting with cc300501bae9f87a36d39acbd8b9253c05af544ffe62f09af6364953283f34dc not found: ID does not exist" Oct 30 22:10:26.011970 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:26.011901 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2"] Oct 30 22:10:26.022678 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:26.022654 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-rollback-predictor-75dd485c97-g8ss2"] Oct 30 22:10:27.594823 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:27.594792 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" path="/var/lib/kubelet/pods/93964ceb-4736-465e-9d30-06f9da1221d3/volumes" Oct 30 22:10:28.962617 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.962589 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7"] Oct 30 22:10:28.962994 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.962933 6162 cpu_manager.go:414] "containerMap: removing container" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="storage-initializer" Oct 30 22:10:28.962994 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.962945 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="storage-initializer" Oct 30 22:10:28.962994 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.962964 6162 cpu_manager.go:414] "containerMap: removing container" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" Oct 30 22:10:28.962994 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.962969 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" Oct 30 22:10:28.962994 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.962981 6162 cpu_manager.go:414] "containerMap: removing container" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kube-rbac-proxy" Oct 30 22:10:28.962994 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.962986 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kube-rbac-proxy" Oct 30 22:10:28.963183 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.963037 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kserve-container" Oct 30 22:10:28.963183 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.963045 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="93964ceb-4736-465e-9d30-06f9da1221d3" containerName="kube-rbac-proxy" Oct 30 22:10:28.967651 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.967628 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:28.984211 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.984185 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"seaweedfs-s3-creds\"" Oct 30 22:10:28.996867 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.996842 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-stop-v2-predictor-serving-cert\"" Oct 30 22:10:28.996986 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.996935 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"kube-root-ca.crt\"" Oct 30 22:10:28.996986 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.996935 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:10:28.996986 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.996967 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\"" Oct 30 22:10:28.997136 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.996971 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"default-dockercfg-d9bw2\"" Oct 30 22:10:28.997136 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.996972 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"openshift-service-ca.crt\"" Oct 30 22:10:28.997979 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:28.997957 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7"] Oct 30 22:10:29.071309 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.071285 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0da94a4e-aec5-4319-a774-729bcdbad052-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.071439 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.071326 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.071439 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.071347 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0da94a4e-aec5-4319-a774-729bcdbad052-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.071439 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.071405 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.071603 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.071473 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l549\" (UniqueName: \"kubernetes.io/projected/0da94a4e-aec5-4319-a774-729bcdbad052-kube-api-access-4l549\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.172011 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.171990 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0da94a4e-aec5-4319-a774-729bcdbad052-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.172134 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.172027 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.172134 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.172050 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0da94a4e-aec5-4319-a774-729bcdbad052-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.172218 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.172161 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.172218 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.172203 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l549\" (UniqueName: \"kubernetes.io/projected/0da94a4e-aec5-4319-a774-729bcdbad052-kube-api-access-4l549\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.172422 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.172403 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0da94a4e-aec5-4319-a774-729bcdbad052-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.172777 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.172762 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.172852 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.172791 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.174247 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.174229 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0da94a4e-aec5-4319-a774-729bcdbad052-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.192788 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.192760 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l549\" (UniqueName: \"kubernetes.io/projected/0da94a4e-aec5-4319-a774-729bcdbad052-kube-api-access-4l549\") pod \"isvc-canary-stop-v2-predictor-86c6548d64-jbxl7\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.249496 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.249446 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz"] Oct 30 22:10:29.253174 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.253159 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.269453 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.269432 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-stop-predictor-serving-cert\"" Oct 30 22:10:29.275377 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.275357 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz"] Oct 30 22:10:29.283608 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.283586 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:29.373306 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.373271 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/46abca9a-2a2c-40be-b272-14dadd72606c-proxy-tls\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.373430 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.373398 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dklj\" (UniqueName: \"kubernetes.io/projected/46abca9a-2a2c-40be-b272-14dadd72606c-kube-api-access-4dklj\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.373480 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.373458 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46abca9a-2a2c-40be-b272-14dadd72606c-kserve-provision-location\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.373520 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.373485 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.373595 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.373566 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-cabundle-cert\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.474033 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.473999 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dklj\" (UniqueName: \"kubernetes.io/projected/46abca9a-2a2c-40be-b272-14dadd72606c-kube-api-access-4dklj\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.474195 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.474047 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46abca9a-2a2c-40be-b272-14dadd72606c-kserve-provision-location\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.474195 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.474168 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.474319 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.474235 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-cabundle-cert\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.474319 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.474287 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/46abca9a-2a2c-40be-b272-14dadd72606c-proxy-tls\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.474448 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.474431 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46abca9a-2a2c-40be-b272-14dadd72606c-kserve-provision-location\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.474749 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.474732 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.474796 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.474760 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-cabundle-cert\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.476554 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.476539 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/46abca9a-2a2c-40be-b272-14dadd72606c-proxy-tls\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.494936 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.494910 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dklj\" (UniqueName: \"kubernetes.io/projected/46abca9a-2a2c-40be-b272-14dadd72606c-kube-api-access-4dklj\") pod \"isvc-canary-stop-predictor-7f5d58797c-8wlhz\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.570183 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.570121 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:29.614343 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.614314 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7"] Oct 30 22:10:29.867536 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.867507 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz"] Oct 30 22:10:29.870783 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:10:29.870756 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46abca9a_2a2c_40be_b272_14dadd72606c.slice/crio-a5ceecd43ee9e1f7fa6e33cc3d5d55d939a53a6bf30bbed970a725331e016c71 WatchSource:0}: Error finding container a5ceecd43ee9e1f7fa6e33cc3d5d55d939a53a6bf30bbed970a725331e016c71: Status 404 returned error can't find the container with id a5ceecd43ee9e1f7fa6e33cc3d5d55d939a53a6bf30bbed970a725331e016c71 Oct 30 22:10:29.975589 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.975547 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" event={"ID":"46abca9a-2a2c-40be-b272-14dadd72606c","Type":"ContainerStarted","Data":"7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893"} Oct 30 22:10:29.976076 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.975610 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" event={"ID":"46abca9a-2a2c-40be-b272-14dadd72606c","Type":"ContainerStarted","Data":"a5ceecd43ee9e1f7fa6e33cc3d5d55d939a53a6bf30bbed970a725331e016c71"} Oct 30 22:10:29.977190 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.977155 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" event={"ID":"0da94a4e-aec5-4319-a774-729bcdbad052","Type":"ContainerStarted","Data":"2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454"} Oct 30 22:10:29.977316 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:29.977204 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" event={"ID":"0da94a4e-aec5-4319-a774-729bcdbad052","Type":"ContainerStarted","Data":"2adde14063107875aedcc15e7fc900f8e2f7dfe1d644691ba976c7b3a7773dda"} Oct 30 22:10:33.994611 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:33.994530 6162 generic.go:356] "Generic (PLEG): container finished" podID="46abca9a-2a2c-40be-b272-14dadd72606c" containerID="7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893" exitCode=0 Oct 30 22:10:33.994611 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:33.994601 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" event={"ID":"46abca9a-2a2c-40be-b272-14dadd72606c","Type":"ContainerDied","Data":"7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893"} Oct 30 22:10:33.996314 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:33.996224 6162 generic.go:356] "Generic (PLEG): container finished" podID="0da94a4e-aec5-4319-a774-729bcdbad052" containerID="2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454" exitCode=0 Oct 30 22:10:33.996314 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:33.996280 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" event={"ID":"0da94a4e-aec5-4319-a774-729bcdbad052","Type":"ContainerDied","Data":"2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454"} Oct 30 22:10:35.002941 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:35.002910 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" event={"ID":"46abca9a-2a2c-40be-b272-14dadd72606c","Type":"ContainerStarted","Data":"d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3"} Oct 30 22:10:35.003382 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:35.002971 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" event={"ID":"46abca9a-2a2c-40be-b272-14dadd72606c","Type":"ContainerStarted","Data":"a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820"} Oct 30 22:10:35.003382 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:35.003259 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:35.004912 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:35.004893 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" event={"ID":"0da94a4e-aec5-4319-a774-729bcdbad052","Type":"ContainerStarted","Data":"a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3"} Oct 30 22:10:35.005015 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:35.004938 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" event={"ID":"0da94a4e-aec5-4319-a774-729bcdbad052","Type":"ContainerStarted","Data":"ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b"} Oct 30 22:10:35.005128 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:35.005114 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:35.060108 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:35.060065 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podStartSLOduration=2.265279214 podStartE2EDuration="6.060052151s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.794772937s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:35.059808463 +0000 UTC m=+947.569680023" watchObservedRunningTime="2026-10-30 22:10:35.060052151 +0000 UTC m=+947.569923707" Oct 30 22:10:35.105285 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:35.105232 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podStartSLOduration=3.340144715 podStartE2EDuration="7.10522033s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.765075615s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:35.104701649 +0000 UTC m=+947.614573220" watchObservedRunningTime="2026-10-30 22:10:35.10522033 +0000 UTC m=+947.615091890" Oct 30 22:10:36.009019 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:36.008983 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:36.009453 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:36.009051 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:36.009982 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:36.009957 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:10:36.009982 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:36.009970 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:10:37.012422 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:37.012383 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:10:37.012804 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:37.012513 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:10:42.017600 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:42.017560 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:10:42.018125 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:42.018106 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:10:42.018125 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:42.018111 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:10:42.018590 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:42.018565 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:10:52.018401 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:52.018364 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:10:52.018833 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:10:52.018494 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:10:54.096123 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:10:54.096088 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:11:02.018350 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:02.018314 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:11:02.018765 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:02.018619 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:11:12.018615 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:12.018577 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:11:12.018615 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:12.018604 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:11:22.018599 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:22.018564 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:11:22.019024 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:22.018564 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:11:24.095833 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:11:24.095787 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:11:32.018393 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:32.018307 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:11:32.018884 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:32.018493 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:11:42.019038 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:42.018999 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:11:42.019421 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:42.018997 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:11:49.590837 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:49.590791 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:11:52.019980 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:52.019949 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:11:54.096116 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:11:54.096082 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:11:59.594412 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:11:59.594385 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:12:00.045744 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:00.045710 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz"] Oct 30 22:12:00.046001 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:00.045957 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" containerID="cri-o://a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820" gracePeriod=30 Oct 30 22:12:00.046054 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:00.045991 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kube-rbac-proxy" containerID="cri-o://d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3" gracePeriod=30 Oct 30 22:12:00.348043 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:00.347959 6162 generic.go:356] "Generic (PLEG): container finished" podID="46abca9a-2a2c-40be-b272-14dadd72606c" containerID="d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3" exitCode=0 Oct 30 22:12:00.348043 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:00.348031 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" event={"ID":"46abca9a-2a2c-40be-b272-14dadd72606c","Type":"ContainerDied","Data":"d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3"} Oct 30 22:12:02.013547 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:02.013500 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused" Oct 30 22:12:02.019273 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:02.019242 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:12:04.032393 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.032359 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7"] Oct 30 22:12:04.032902 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.032574 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" containerID="cri-o://ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b" gracePeriod=30 Oct 30 22:12:04.032902 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.032617 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kube-rbac-proxy" containerID="cri-o://a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3" gracePeriod=30 Oct 30 22:12:04.366132 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.366057 6162 generic.go:356] "Generic (PLEG): container finished" podID="0da94a4e-aec5-4319-a774-729bcdbad052" containerID="a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3" exitCode=0 Oct 30 22:12:04.366275 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.366129 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" event={"ID":"0da94a4e-aec5-4319-a774-729bcdbad052","Type":"ContainerDied","Data":"a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3"} Oct 30 22:12:04.699096 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.699073 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:12:04.843225 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.843194 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46abca9a-2a2c-40be-b272-14dadd72606c-kube-api-access-4dklj\" (UniqueName: \"kubernetes.io/projected/46abca9a-2a2c-40be-b272-14dadd72606c-kube-api-access-4dklj\") pod \"46abca9a-2a2c-40be-b272-14dadd72606c\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " Oct 30 22:12:04.843225 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.843228 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-cabundle-cert\") pod \"46abca9a-2a2c-40be-b272-14dadd72606c\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " Oct 30 22:12:04.843464 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.843293 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-kube-rbac-proxy-sar-config\") pod \"46abca9a-2a2c-40be-b272-14dadd72606c\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " Oct 30 22:12:04.843464 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.843317 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/46abca9a-2a2c-40be-b272-14dadd72606c-proxy-tls\" (UniqueName: \"kubernetes.io/secret/46abca9a-2a2c-40be-b272-14dadd72606c-proxy-tls\") pod \"46abca9a-2a2c-40be-b272-14dadd72606c\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " Oct 30 22:12:04.843464 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.843367 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46abca9a-2a2c-40be-b272-14dadd72606c-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46abca9a-2a2c-40be-b272-14dadd72606c-kserve-provision-location\") pod \"46abca9a-2a2c-40be-b272-14dadd72606c\" (UID: \"46abca9a-2a2c-40be-b272-14dadd72606c\") " Oct 30 22:12:04.843627 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.843597 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-cabundle-cert" pod "46abca9a-2a2c-40be-b272-14dadd72606c" (UID: "46abca9a-2a2c-40be-b272-14dadd72606c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:12:04.843749 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.843726 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-kube-rbac-proxy-sar-config" pod "46abca9a-2a2c-40be-b272-14dadd72606c" (UID: "46abca9a-2a2c-40be-b272-14dadd72606c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:12:04.843800 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.843757 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46abca9a-2a2c-40be-b272-14dadd72606c-kserve-provision-location" pod "46abca9a-2a2c-40be-b272-14dadd72606c" (UID: "46abca9a-2a2c-40be-b272-14dadd72606c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:12:04.845330 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.845311 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46abca9a-2a2c-40be-b272-14dadd72606c-proxy-tls" pod "46abca9a-2a2c-40be-b272-14dadd72606c" (UID: "46abca9a-2a2c-40be-b272-14dadd72606c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:12:04.845395 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.845374 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46abca9a-2a2c-40be-b272-14dadd72606c-kube-api-access-4dklj" pod "46abca9a-2a2c-40be-b272-14dadd72606c" (UID: "46abca9a-2a2c-40be-b272-14dadd72606c"). InnerVolumeSpecName "kube-api-access-4dklj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:12:04.943869 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.943795 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dklj\" (UniqueName: \"kubernetes.io/projected/46abca9a-2a2c-40be-b272-14dadd72606c-kube-api-access-4dklj\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:12:04.943869 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.943828 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:12:04.943869 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.943839 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/46abca9a-2a2c-40be-b272-14dadd72606c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:12:04.943869 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.943849 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/46abca9a-2a2c-40be-b272-14dadd72606c-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:12:04.943869 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:04.943859 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46abca9a-2a2c-40be-b272-14dadd72606c-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:12:05.371553 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.371520 6162 generic.go:356] "Generic (PLEG): container finished" podID="46abca9a-2a2c-40be-b272-14dadd72606c" containerID="a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820" exitCode=0 Oct 30 22:12:05.371950 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.371569 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" Oct 30 22:12:05.371950 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.371599 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" event={"ID":"46abca9a-2a2c-40be-b272-14dadd72606c","Type":"ContainerDied","Data":"a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820"} Oct 30 22:12:05.371950 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.371659 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz" event={"ID":"46abca9a-2a2c-40be-b272-14dadd72606c","Type":"ContainerDied","Data":"a5ceecd43ee9e1f7fa6e33cc3d5d55d939a53a6bf30bbed970a725331e016c71"} Oct 30 22:12:05.371950 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.371685 6162 scope.go:122] "RemoveContainer" containerID="d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3" Oct 30 22:12:05.380246 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.380228 6162 scope.go:122] "RemoveContainer" containerID="a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820" Oct 30 22:12:05.387169 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.387151 6162 scope.go:122] "RemoveContainer" containerID="7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893" Oct 30 22:12:05.393852 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.393833 6162 scope.go:122] "RemoveContainer" containerID="d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3" Oct 30 22:12:05.394090 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:12:05.394073 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3\": container with ID starting with d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3 not found: ID does not exist" containerID="d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3" Oct 30 22:12:05.394135 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.394102 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3"} err="failed to get container status \"d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3\": rpc error: code = NotFound desc = could not find container \"d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3\": container with ID starting with d55d81ea492aaed18b541b003c029ec272d07af3fee6e78474c447d17b81a2a3 not found: ID does not exist" Oct 30 22:12:05.394135 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.394119 6162 scope.go:122] "RemoveContainer" containerID="a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820" Oct 30 22:12:05.394370 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:12:05.394355 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820\": container with ID starting with a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820 not found: ID does not exist" containerID="a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820" Oct 30 22:12:05.394409 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.394376 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820"} err="failed to get container status \"a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820\": rpc error: code = NotFound desc = could not find container \"a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820\": container with ID starting with a3732636ab12d8926ab6c4c3e315218f2bdf24aec5426672c7cecd993b52c820 not found: ID does not exist" Oct 30 22:12:05.394409 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.394389 6162 scope.go:122] "RemoveContainer" containerID="7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893" Oct 30 22:12:05.394615 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:12:05.394597 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893\": container with ID starting with 7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893 not found: ID does not exist" containerID="7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893" Oct 30 22:12:05.394659 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.394619 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893"} err="failed to get container status \"7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893\": rpc error: code = NotFound desc = could not find container \"7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893\": container with ID starting with 7b3b0c103d938e66d9121ca69be4014351a5eaf91898fe279f8c365a4d319893 not found: ID does not exist" Oct 30 22:12:05.473072 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.473039 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz"] Oct 30 22:12:05.485992 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.485962 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-predictor-7f5d58797c-8wlhz"] Oct 30 22:12:05.594297 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:05.594266 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" path="/var/lib/kubelet/pods/46abca9a-2a2c-40be-b272-14dadd72606c/volumes" Oct 30 22:12:07.012742 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:07.012703 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.24:8643/healthz\": dial tcp 10.133.0.24:8643: connect: connection refused" Oct 30 22:12:08.771174 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.771152 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:12:08.874729 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.874698 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0da94a4e-aec5-4319-a774-729bcdbad052-proxy-tls\" (UniqueName: \"kubernetes.io/secret/0da94a4e-aec5-4319-a774-729bcdbad052-proxy-tls\") pod \"0da94a4e-aec5-4319-a774-729bcdbad052\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " Oct 30 22:12:08.874900 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.874743 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-cabundle-cert\") pod \"0da94a4e-aec5-4319-a774-729bcdbad052\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " Oct 30 22:12:08.874900 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.874801 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0da94a4e-aec5-4319-a774-729bcdbad052-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0da94a4e-aec5-4319-a774-729bcdbad052-kserve-provision-location\") pod \"0da94a4e-aec5-4319-a774-729bcdbad052\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " Oct 30 22:12:08.874900 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.874863 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-kube-rbac-proxy-sar-config\") pod \"0da94a4e-aec5-4319-a774-729bcdbad052\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " Oct 30 22:12:08.875027 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.874920 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0da94a4e-aec5-4319-a774-729bcdbad052-kube-api-access-4l549\" (UniqueName: \"kubernetes.io/projected/0da94a4e-aec5-4319-a774-729bcdbad052-kube-api-access-4l549\") pod \"0da94a4e-aec5-4319-a774-729bcdbad052\" (UID: \"0da94a4e-aec5-4319-a774-729bcdbad052\") " Oct 30 22:12:08.875180 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.875154 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da94a4e-aec5-4319-a774-729bcdbad052-kserve-provision-location" pod "0da94a4e-aec5-4319-a774-729bcdbad052" (UID: "0da94a4e-aec5-4319-a774-729bcdbad052"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:12:08.875260 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.875175 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-cabundle-cert" pod "0da94a4e-aec5-4319-a774-729bcdbad052" (UID: "0da94a4e-aec5-4319-a774-729bcdbad052"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:12:08.875260 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.875229 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-kube-rbac-proxy-sar-config" pod "0da94a4e-aec5-4319-a774-729bcdbad052" (UID: "0da94a4e-aec5-4319-a774-729bcdbad052"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:12:08.876834 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.876802 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0da94a4e-aec5-4319-a774-729bcdbad052-proxy-tls" pod "0da94a4e-aec5-4319-a774-729bcdbad052" (UID: "0da94a4e-aec5-4319-a774-729bcdbad052"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:12:08.876912 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.876885 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da94a4e-aec5-4319-a774-729bcdbad052-kube-api-access-4l549" pod "0da94a4e-aec5-4319-a774-729bcdbad052" (UID: "0da94a4e-aec5-4319-a774-729bcdbad052"). InnerVolumeSpecName "kube-api-access-4l549". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:12:08.975804 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.975771 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0da94a4e-aec5-4319-a774-729bcdbad052-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:12:08.975804 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.975802 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:12:08.975804 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.975812 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l549\" (UniqueName: \"kubernetes.io/projected/0da94a4e-aec5-4319-a774-729bcdbad052-kube-api-access-4l549\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:12:08.976117 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.975846 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0da94a4e-aec5-4319-a774-729bcdbad052-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:12:08.976117 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:08.975857 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0da94a4e-aec5-4319-a774-729bcdbad052-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:12:09.393892 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.393854 6162 generic.go:356] "Generic (PLEG): container finished" podID="0da94a4e-aec5-4319-a774-729bcdbad052" containerID="ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b" exitCode=0 Oct 30 22:12:09.394052 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.393923 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" event={"ID":"0da94a4e-aec5-4319-a774-729bcdbad052","Type":"ContainerDied","Data":"ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b"} Oct 30 22:12:09.394052 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.393936 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" Oct 30 22:12:09.394052 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.394010 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7" event={"ID":"0da94a4e-aec5-4319-a774-729bcdbad052","Type":"ContainerDied","Data":"2adde14063107875aedcc15e7fc900f8e2f7dfe1d644691ba976c7b3a7773dda"} Oct 30 22:12:09.394052 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.394045 6162 scope.go:122] "RemoveContainer" containerID="a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3" Oct 30 22:12:09.402072 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.402035 6162 scope.go:122] "RemoveContainer" containerID="ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b" Oct 30 22:12:09.410802 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.410787 6162 scope.go:122] "RemoveContainer" containerID="2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454" Oct 30 22:12:09.417932 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.417914 6162 scope.go:122] "RemoveContainer" containerID="a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3" Oct 30 22:12:09.418197 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:12:09.418179 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3\": container with ID starting with a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3 not found: ID does not exist" containerID="a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3" Oct 30 22:12:09.418253 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.418205 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3"} err="failed to get container status \"a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3\": rpc error: code = NotFound desc = could not find container \"a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3\": container with ID starting with a07606b46c69d7dfc81c521b2752809be30ab78dd20a98d0085436e7dcd1feb3 not found: ID does not exist" Oct 30 22:12:09.418253 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.418221 6162 scope.go:122] "RemoveContainer" containerID="ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b" Oct 30 22:12:09.418453 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:12:09.418435 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b\": container with ID starting with ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b not found: ID does not exist" containerID="ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b" Oct 30 22:12:09.418491 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.418460 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b"} err="failed to get container status \"ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b\": rpc error: code = NotFound desc = could not find container \"ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b\": container with ID starting with ac1c9cedee4c51fdd086490cc8c87f100c9b00fd0e85f5150872c32394ccc73b not found: ID does not exist" Oct 30 22:12:09.418491 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.418475 6162 scope.go:122] "RemoveContainer" containerID="2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454" Oct 30 22:12:09.418682 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:12:09.418668 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454\": container with ID starting with 2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454 not found: ID does not exist" containerID="2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454" Oct 30 22:12:09.418716 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.418687 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454"} err="failed to get container status \"2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454\": rpc error: code = NotFound desc = could not find container \"2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454\": container with ID starting with 2d832f0113f98f75bb1599775e2a2cd695ecfd6c35124cb69343ebccf5f8a454 not found: ID does not exist" Oct 30 22:12:09.461522 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.461500 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7"] Oct 30 22:12:09.474241 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.474221 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-stop-v2-predictor-86c6548d64-jbxl7"] Oct 30 22:12:09.594970 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:09.594937 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" path="/var/lib/kubelet/pods/0da94a4e-aec5-4319-a774-729bcdbad052/volumes" Oct 30 22:12:12.991799 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.991771 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz"] Oct 30 22:12:12.992284 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992230 6162 cpu_manager.go:414] "containerMap: removing container" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kube-rbac-proxy" Oct 30 22:12:12.992284 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992248 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kube-rbac-proxy" Oct 30 22:12:12.992284 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992264 6162 cpu_manager.go:414] "containerMap: removing container" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" Oct 30 22:12:12.992284 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992271 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" Oct 30 22:12:12.992284 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992282 6162 cpu_manager.go:414] "containerMap: removing container" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="storage-initializer" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992290 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="storage-initializer" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992308 6162 cpu_manager.go:414] "containerMap: removing container" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="storage-initializer" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992316 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="storage-initializer" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992328 6162 cpu_manager.go:414] "containerMap: removing container" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992336 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992347 6162 cpu_manager.go:414] "containerMap: removing container" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kube-rbac-proxy" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992354 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kube-rbac-proxy" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992430 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kube-rbac-proxy" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992444 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="46abca9a-2a2c-40be-b272-14dadd72606c" containerName="kserve-container" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992455 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kserve-container" Oct 30 22:12:12.992559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.992464 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="0da94a4e-aec5-4319-a774-729bcdbad052" containerName="kube-rbac-proxy" Oct 30 22:12:12.997278 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:12.997256 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.026630 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.026594 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-primary-795342-predictor-serving-cert\"" Oct 30 22:12:13.026630 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.026614 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"default-dockercfg-d9bw2\"" Oct 30 22:12:13.026630 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.026595 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"seaweedfs-s3-creds\"" Oct 30 22:12:13.026888 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.026656 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"kube-root-ca.crt\"" Oct 30 22:12:13.026888 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.026695 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:12:13.026888 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.026783 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"openshift-service-ca.crt\"" Oct 30 22:12:13.027037 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.027019 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-primary-795342-kube-rbac-proxy-sar-config\"" Oct 30 22:12:13.027628 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.027608 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz"] Oct 30 22:12:13.105176 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.105146 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ecd31558-8c60-414f-82c5-00737626d89a-proxy-tls\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.105316 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.105179 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecd31558-8c60-414f-82c5-00737626d89a-kserve-provision-location\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.105316 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.105205 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-cabundle-cert\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.105316 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.105303 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4gpx\" (UniqueName: \"kubernetes.io/projected/ecd31558-8c60-414f-82c5-00737626d89a-kube-api-access-p4gpx\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.105473 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.105350 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-kube-rbac-proxy-sar-config\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.206343 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.206311 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ecd31558-8c60-414f-82c5-00737626d89a-proxy-tls\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.206480 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.206347 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecd31558-8c60-414f-82c5-00737626d89a-kserve-provision-location\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.206480 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.206367 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-cabundle-cert\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.206480 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.206386 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4gpx\" (UniqueName: \"kubernetes.io/projected/ecd31558-8c60-414f-82c5-00737626d89a-kube-api-access-p4gpx\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.206480 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.206427 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-kube-rbac-proxy-sar-config\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.206836 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.206797 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecd31558-8c60-414f-82c5-00737626d89a-kserve-provision-location\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.207118 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.207097 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-cabundle-cert\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.207177 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.207140 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-kube-rbac-proxy-sar-config\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.208669 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.208642 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ecd31558-8c60-414f-82c5-00737626d89a-proxy-tls\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.228743 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.228724 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4gpx\" (UniqueName: \"kubernetes.io/projected/ecd31558-8c60-414f-82c5-00737626d89a-kube-api-access-p4gpx\") pod \"isvc-primary-795342-predictor-6547cbb8b9-2k4qz\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.313499 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.313440 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:13.624874 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:13.624693 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz"] Oct 30 22:12:13.627631 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:12:13.627605 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd31558_8c60_414f_82c5_00737626d89a.slice/crio-b593aa6cb8f7b8f1d4c18fba51f7e34d66dd81efcfda890f55b71dfe2faddd11 WatchSource:0}: Error finding container b593aa6cb8f7b8f1d4c18fba51f7e34d66dd81efcfda890f55b71dfe2faddd11: Status 404 returned error can't find the container with id b593aa6cb8f7b8f1d4c18fba51f7e34d66dd81efcfda890f55b71dfe2faddd11 Oct 30 22:12:14.415674 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:14.415631 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" event={"ID":"ecd31558-8c60-414f-82c5-00737626d89a","Type":"ContainerStarted","Data":"99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20"} Oct 30 22:12:14.416080 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:14.415736 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" event={"ID":"ecd31558-8c60-414f-82c5-00737626d89a","Type":"ContainerStarted","Data":"b593aa6cb8f7b8f1d4c18fba51f7e34d66dd81efcfda890f55b71dfe2faddd11"} Oct 30 22:12:17.427698 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:17.427664 6162 generic.go:356] "Generic (PLEG): container finished" podID="ecd31558-8c60-414f-82c5-00737626d89a" containerID="99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20" exitCode=0 Oct 30 22:12:17.428050 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:17.427736 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" event={"ID":"ecd31558-8c60-414f-82c5-00737626d89a","Type":"ContainerDied","Data":"99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20"} Oct 30 22:12:18.433482 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:18.433450 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" event={"ID":"ecd31558-8c60-414f-82c5-00737626d89a","Type":"ContainerStarted","Data":"de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932"} Oct 30 22:12:18.433914 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:18.433508 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" event={"ID":"ecd31558-8c60-414f-82c5-00737626d89a","Type":"ContainerStarted","Data":"9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265"} Oct 30 22:12:18.433914 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:18.433696 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:18.493038 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:18.492985 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podStartSLOduration=2.801833303 podStartE2EDuration="6.492972751s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.691139448s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:12:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:12:18.492009495 +0000 UTC m=+1051.001881057" watchObservedRunningTime="2026-10-30 22:12:18.492972751 +0000 UTC m=+1051.002844310" Oct 30 22:12:19.437165 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:19.437128 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:19.438472 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:19.438446 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:12:20.441295 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:20.441250 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:12:24.095872 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:12:24.095842 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:12:25.446318 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:25.446291 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:12:25.446964 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:25.446937 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:12:35.447004 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:35.446963 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:12:45.447458 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:45.447414 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:12:54.095522 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:12:54.095479 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:12:55.447438 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:12:55.447396 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:13:05.447369 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:13:05.447274 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:13:15.447539 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:13:15.447499 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:13:24.096118 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:13:24.096080 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:13:25.446966 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:13:25.446928 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:13:35.447835 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:13:35.447781 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:13:54.096252 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:13:54.096211 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:14:18.671786 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:18.671751 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz"] Oct 30 22:14:18.674141 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:18.672115 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" containerID="cri-o://9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265" gracePeriod=30 Oct 30 22:14:18.674141 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:18.672237 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kube-rbac-proxy" containerID="cri-o://de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932" gracePeriod=30 Oct 30 22:14:18.893767 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:18.893736 6162 generic.go:356] "Generic (PLEG): container finished" podID="ecd31558-8c60-414f-82c5-00737626d89a" containerID="de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932" exitCode=0 Oct 30 22:14:18.893950 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:18.893809 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" event={"ID":"ecd31558-8c60-414f-82c5-00737626d89a","Type":"ContainerDied","Data":"de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932"} Oct 30 22:14:20.442311 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:20.442270 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.26:8643/healthz\": dial tcp 10.133.0.26:8643: connect: connection refused" Oct 30 22:14:23.406717 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.406694 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:14:23.514606 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.514540 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-kube-rbac-proxy-sar-config\") pod \"ecd31558-8c60-414f-82c5-00737626d89a\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " Oct 30 22:14:23.514606 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.514596 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecd31558-8c60-414f-82c5-00737626d89a-kube-api-access-p4gpx\" (UniqueName: \"kubernetes.io/projected/ecd31558-8c60-414f-82c5-00737626d89a-kube-api-access-p4gpx\") pod \"ecd31558-8c60-414f-82c5-00737626d89a\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " Oct 30 22:14:23.514765 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.514635 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ecd31558-8c60-414f-82c5-00737626d89a-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecd31558-8c60-414f-82c5-00737626d89a-kserve-provision-location\") pod \"ecd31558-8c60-414f-82c5-00737626d89a\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " Oct 30 22:14:23.514765 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.514656 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecd31558-8c60-414f-82c5-00737626d89a-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ecd31558-8c60-414f-82c5-00737626d89a-proxy-tls\") pod \"ecd31558-8c60-414f-82c5-00737626d89a\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " Oct 30 22:14:23.514765 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.514676 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-cabundle-cert\") pod \"ecd31558-8c60-414f-82c5-00737626d89a\" (UID: \"ecd31558-8c60-414f-82c5-00737626d89a\") " Oct 30 22:14:23.514974 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.514954 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecd31558-8c60-414f-82c5-00737626d89a-kserve-provision-location" pod "ecd31558-8c60-414f-82c5-00737626d89a" (UID: "ecd31558-8c60-414f-82c5-00737626d89a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:14:23.515036 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.514966 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-kube-rbac-proxy-sar-config" pod "ecd31558-8c60-414f-82c5-00737626d89a" (UID: "ecd31558-8c60-414f-82c5-00737626d89a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:14:23.515150 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.515128 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-cabundle-cert" pod "ecd31558-8c60-414f-82c5-00737626d89a" (UID: "ecd31558-8c60-414f-82c5-00737626d89a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:14:23.516625 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.516605 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecd31558-8c60-414f-82c5-00737626d89a-proxy-tls" pod "ecd31558-8c60-414f-82c5-00737626d89a" (UID: "ecd31558-8c60-414f-82c5-00737626d89a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:14:23.516718 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.516701 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd31558-8c60-414f-82c5-00737626d89a-kube-api-access-p4gpx" pod "ecd31558-8c60-414f-82c5-00737626d89a" (UID: "ecd31558-8c60-414f-82c5-00737626d89a"). InnerVolumeSpecName "kube-api-access-p4gpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:14:23.616012 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.615984 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:14:23.616012 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.616009 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ecd31558-8c60-414f-82c5-00737626d89a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:14:23.616156 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.616019 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4gpx\" (UniqueName: \"kubernetes.io/projected/ecd31558-8c60-414f-82c5-00737626d89a-kube-api-access-p4gpx\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:14:23.616156 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.616028 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecd31558-8c60-414f-82c5-00737626d89a-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:14:23.616156 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.616036 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ecd31558-8c60-414f-82c5-00737626d89a-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:14:23.914470 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.914436 6162 generic.go:356] "Generic (PLEG): container finished" podID="ecd31558-8c60-414f-82c5-00737626d89a" containerID="9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265" exitCode=0 Oct 30 22:14:23.914668 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.914506 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" Oct 30 22:14:23.914668 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.914511 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" event={"ID":"ecd31558-8c60-414f-82c5-00737626d89a","Type":"ContainerDied","Data":"9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265"} Oct 30 22:14:23.914668 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.914623 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz" event={"ID":"ecd31558-8c60-414f-82c5-00737626d89a","Type":"ContainerDied","Data":"b593aa6cb8f7b8f1d4c18fba51f7e34d66dd81efcfda890f55b71dfe2faddd11"} Oct 30 22:14:23.914668 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.914649 6162 scope.go:122] "RemoveContainer" containerID="de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932" Oct 30 22:14:23.922559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.922537 6162 scope.go:122] "RemoveContainer" containerID="9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265" Oct 30 22:14:23.929430 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.929412 6162 scope.go:122] "RemoveContainer" containerID="99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20" Oct 30 22:14:23.936104 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.936091 6162 scope.go:122] "RemoveContainer" containerID="de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932" Oct 30 22:14:23.936349 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:14:23.936333 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932\": container with ID starting with de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932 not found: ID does not exist" containerID="de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932" Oct 30 22:14:23.936402 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.936357 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932"} err="failed to get container status \"de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932\": rpc error: code = NotFound desc = could not find container \"de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932\": container with ID starting with de4212f7886a50f223e646bdb23bad5ee5eaf30e59d088ff5cfea428d86c4932 not found: ID does not exist" Oct 30 22:14:23.936402 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.936373 6162 scope.go:122] "RemoveContainer" containerID="9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265" Oct 30 22:14:23.936594 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:14:23.936578 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265\": container with ID starting with 9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265 not found: ID does not exist" containerID="9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265" Oct 30 22:14:23.936636 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.936602 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265"} err="failed to get container status \"9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265\": rpc error: code = NotFound desc = could not find container \"9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265\": container with ID starting with 9a9cd3ec608f7f79013eb73d404ddfd33788037f911d5897755c493a524c6265 not found: ID does not exist" Oct 30 22:14:23.936636 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.936623 6162 scope.go:122] "RemoveContainer" containerID="99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20" Oct 30 22:14:23.936842 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:14:23.936809 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20\": container with ID starting with 99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20 not found: ID does not exist" containerID="99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20" Oct 30 22:14:23.936882 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.936847 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20"} err="failed to get container status \"99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20\": rpc error: code = NotFound desc = could not find container \"99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20\": container with ID starting with 99e881ea9ced5f6281eba66fd45756e1c72910b52b062b6f3c0052105b4b9e20 not found: ID does not exist" Oct 30 22:14:23.983700 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.983677 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz"] Oct 30 22:14:23.996271 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:23.996249 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-primary-795342-predictor-6547cbb8b9-2k4qz"] Oct 30 22:14:24.095934 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:14:24.095904 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:14:25.594446 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:25.594415 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ecd31558-8c60-414f-82c5-00737626d89a" path="/var/lib/kubelet/pods/ecd31558-8c60-414f-82c5-00737626d89a/volumes" Oct 30 22:14:26.410161 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.410129 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk"] Oct 30 22:14:26.410463 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.410451 6162 cpu_manager.go:414] "containerMap: removing container" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kube-rbac-proxy" Oct 30 22:14:26.410519 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.410464 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kube-rbac-proxy" Oct 30 22:14:26.410519 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.410484 6162 cpu_manager.go:414] "containerMap: removing container" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" Oct 30 22:14:26.410519 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.410489 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" Oct 30 22:14:26.410519 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.410505 6162 cpu_manager.go:414] "containerMap: removing container" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="storage-initializer" Oct 30 22:14:26.410519 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.410510 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="storage-initializer" Oct 30 22:14:26.410680 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.410554 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kserve-container" Oct 30 22:14:26.410680 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.410565 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="ecd31558-8c60-414f-82c5-00737626d89a" containerName="kube-rbac-proxy" Oct 30 22:14:26.415192 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.415172 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.431691 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.431665 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-init-fail-7ff833-kube-rbac-proxy-sar-config\"" Oct 30 22:14:26.444182 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.444139 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:14:26.444182 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.444139 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"fail-s3-secret-7ff833\"" Oct 30 22:14:26.444182 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.444146 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-init-fail-7ff833-predictor-serving-cert\"" Oct 30 22:14:26.444372 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.444153 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"kube-root-ca.crt\"" Oct 30 22:14:26.444372 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.444166 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"openshift-service-ca.crt\"" Oct 30 22:14:26.444372 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.444198 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"fail-s3-sa-7ff833-dockercfg-phr7j\"" Oct 30 22:14:26.445207 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.445192 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk"] Oct 30 22:14:26.535637 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.535609 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fc89a6-ae3a-40d8-832c-b2e70e317d48-proxy-tls\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.535840 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.535661 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kserve-provision-location\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.535840 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.535753 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.535840 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.535797 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-cabundle-cert\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.535840 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.535835 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmwt4\" (UniqueName: \"kubernetes.io/projected/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-api-access-fmwt4\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.637266 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.637235 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kserve-provision-location\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.637700 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.637275 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.637700 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.637418 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-cabundle-cert\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.637700 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.637462 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmwt4\" (UniqueName: \"kubernetes.io/projected/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-api-access-fmwt4\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.637700 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.637553 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fc89a6-ae3a-40d8-832c-b2e70e317d48-proxy-tls\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.637954 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.637705 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kserve-provision-location\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.638132 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.638109 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-cabundle-cert\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.638206 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.638166 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.639932 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.639914 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fc89a6-ae3a-40d8-832c-b2e70e317d48-proxy-tls\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.658441 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.658412 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmwt4\" (UniqueName: \"kubernetes.io/projected/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-api-access-fmwt4\") pod \"isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:26.732524 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:26.732460 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:27.041804 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:27.041722 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk"] Oct 30 22:14:27.044564 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:14:27.044532 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fc89a6_ae3a_40d8_832c_b2e70e317d48.slice/crio-9faffef5ed94c8dc076886c2d4ba9e8b3b369553d92a89d5683c50d705efd48b WatchSource:0}: Error finding container 9faffef5ed94c8dc076886c2d4ba9e8b3b369553d92a89d5683c50d705efd48b: Status 404 returned error can't find the container with id 9faffef5ed94c8dc076886c2d4ba9e8b3b369553d92a89d5683c50d705efd48b Oct 30 22:14:27.938083 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:27.938039 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" event={"ID":"74fc89a6-ae3a-40d8-832c-b2e70e317d48","Type":"ContainerStarted","Data":"409cb29a87300aaf82ab457a9b9395b6010a039c005345d8e4ef466d097b38cb"} Oct 30 22:14:27.938529 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:27.938148 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" event={"ID":"74fc89a6-ae3a-40d8-832c-b2e70e317d48","Type":"ContainerStarted","Data":"9faffef5ed94c8dc076886c2d4ba9e8b3b369553d92a89d5683c50d705efd48b"} Oct 30 22:14:30.954415 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:30.954388 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-2e5a75ca98_isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk_74fc89a6-ae3a-40d8-832c-b2e70e317d48/storage-initializer/0.log" Oct 30 22:14:30.954839 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:30.954429 6162 generic.go:356] "Generic (PLEG): container finished" podID="74fc89a6-ae3a-40d8-832c-b2e70e317d48" containerID="409cb29a87300aaf82ab457a9b9395b6010a039c005345d8e4ef466d097b38cb" exitCode=1 Oct 30 22:14:30.954839 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:30.954501 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" event={"ID":"74fc89a6-ae3a-40d8-832c-b2e70e317d48","Type":"ContainerDied","Data":"409cb29a87300aaf82ab457a9b9395b6010a039c005345d8e4ef466d097b38cb"} Oct 30 22:14:31.959946 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:31.959918 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-2e5a75ca98_isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk_74fc89a6-ae3a-40d8-832c-b2e70e317d48/storage-initializer/0.log" Oct 30 22:14:31.960314 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:31.959997 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" event={"ID":"74fc89a6-ae3a-40d8-832c-b2e70e317d48","Type":"ContainerStarted","Data":"ff3b70c2a80f80a78426448c30fa47ae1d2d2750d4df7c16bba75f908b6cc90b"} Oct 30 22:14:34.972954 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:34.972928 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-2e5a75ca98_isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk_74fc89a6-ae3a-40d8-832c-b2e70e317d48/storage-initializer/1.log" Oct 30 22:14:34.973304 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:34.973288 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-2e5a75ca98_isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk_74fc89a6-ae3a-40d8-832c-b2e70e317d48/storage-initializer/0.log" Oct 30 22:14:34.973348 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:34.973321 6162 generic.go:356] "Generic (PLEG): container finished" podID="74fc89a6-ae3a-40d8-832c-b2e70e317d48" containerID="ff3b70c2a80f80a78426448c30fa47ae1d2d2750d4df7c16bba75f908b6cc90b" exitCode=1 Oct 30 22:14:34.973389 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:34.973377 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" event={"ID":"74fc89a6-ae3a-40d8-832c-b2e70e317d48","Type":"ContainerDied","Data":"ff3b70c2a80f80a78426448c30fa47ae1d2d2750d4df7c16bba75f908b6cc90b"} Oct 30 22:14:34.973437 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:34.973427 6162 scope.go:122] "RemoveContainer" containerID="409cb29a87300aaf82ab457a9b9395b6010a039c005345d8e4ef466d097b38cb" Oct 30 22:14:34.973733 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:34.973713 6162 scope.go:122] "RemoveContainer" containerID="409cb29a87300aaf82ab457a9b9395b6010a039c005345d8e4ef466d097b38cb" Oct 30 22:14:34.983811 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:14:34.983792 6162 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-initializer\" with CrashLoopBackOff: \"back-off 10s restarting failed container=storage-initializer pod=isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk_e2e-gw1-2e5a75ca98(74fc89a6-ae3a-40d8-832c-b2e70e317d48)\"" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" podUID="74fc89a6-ae3a-40d8-832c-b2e70e317d48" Oct 30 22:14:34.984352 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:14:34.984327 6162 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk_e2e-gw1-2e5a75ca98_74fc89a6-ae3a-40d8-832c-b2e70e317d48_0 in pod sandbox 9faffef5ed94c8dc076886c2d4ba9e8b3b369553d92a89d5683c50d705efd48b from index: no such id: '409cb29a87300aaf82ab457a9b9395b6010a039c005345d8e4ef466d097b38cb'" containerID="409cb29a87300aaf82ab457a9b9395b6010a039c005345d8e4ef466d097b38cb" Oct 30 22:14:34.984400 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:34.984361 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409cb29a87300aaf82ab457a9b9395b6010a039c005345d8e4ef466d097b38cb"} err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk_e2e-gw1-2e5a75ca98_74fc89a6-ae3a-40d8-832c-b2e70e317d48_0 in pod sandbox 9faffef5ed94c8dc076886c2d4ba9e8b3b369553d92a89d5683c50d705efd48b from index: no such id: '409cb29a87300aaf82ab457a9b9395b6010a039c005345d8e4ef466d097b38cb'" Oct 30 22:14:35.978026 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:35.977996 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-2e5a75ca98_isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk_74fc89a6-ae3a-40d8-832c-b2e70e317d48/storage-initializer/1.log" Oct 30 22:14:36.408918 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.408881 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk"] Oct 30 22:14:36.535172 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.535148 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-2e5a75ca98_isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk_74fc89a6-ae3a-40d8-832c-b2e70e317d48/storage-initializer/1.log" Oct 30 22:14:36.536940 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.536920 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:36.621351 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.621326 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/74fc89a6-ae3a-40d8-832c-b2e70e317d48-proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fc89a6-ae3a-40d8-832c-b2e70e317d48-proxy-tls\") pod \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " Oct 30 22:14:36.621483 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.621362 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-api-access-fmwt4\" (UniqueName: \"kubernetes.io/projected/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-api-access-fmwt4\") pod \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " Oct 30 22:14:36.621483 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.621402 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kserve-provision-location\") pod \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " Oct 30 22:14:36.621564 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.621500 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-rbac-proxy-sar-config\") pod \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " Oct 30 22:14:36.621626 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.621564 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-cabundle-cert\") pod \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\" (UID: \"74fc89a6-ae3a-40d8-832c-b2e70e317d48\") " Oct 30 22:14:36.621626 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.621614 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kserve-provision-location" pod "74fc89a6-ae3a-40d8-832c-b2e70e317d48" (UID: "74fc89a6-ae3a-40d8-832c-b2e70e317d48"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:14:36.621760 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.621730 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:14:36.621952 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.621889 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-cabundle-cert" pod "74fc89a6-ae3a-40d8-832c-b2e70e317d48" (UID: "74fc89a6-ae3a-40d8-832c-b2e70e317d48"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:14:36.621952 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.621906 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-rbac-proxy-sar-config" pod "74fc89a6-ae3a-40d8-832c-b2e70e317d48" (UID: "74fc89a6-ae3a-40d8-832c-b2e70e317d48"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:14:36.623514 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.623491 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-api-access-fmwt4" pod "74fc89a6-ae3a-40d8-832c-b2e70e317d48" (UID: "74fc89a6-ae3a-40d8-832c-b2e70e317d48"). InnerVolumeSpecName "kube-api-access-fmwt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:14:36.623514 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.623500 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74fc89a6-ae3a-40d8-832c-b2e70e317d48-proxy-tls" pod "74fc89a6-ae3a-40d8-832c-b2e70e317d48" (UID: "74fc89a6-ae3a-40d8-832c-b2e70e317d48"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:14:36.723027 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.722955 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:14:36.723027 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.722987 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/74fc89a6-ae3a-40d8-832c-b2e70e317d48-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:14:36.723027 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.722999 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fc89a6-ae3a-40d8-832c-b2e70e317d48-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:14:36.723027 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.723007 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmwt4\" (UniqueName: \"kubernetes.io/projected/74fc89a6-ae3a-40d8-832c-b2e70e317d48-kube-api-access-fmwt4\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:14:36.983760 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.983681 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-2e5a75ca98_isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk_74fc89a6-ae3a-40d8-832c-b2e70e317d48/storage-initializer/1.log" Oct 30 22:14:36.984174 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.983775 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" Oct 30 22:14:36.984174 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.983791 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk" event={"ID":"74fc89a6-ae3a-40d8-832c-b2e70e317d48","Type":"ContainerDied","Data":"9faffef5ed94c8dc076886c2d4ba9e8b3b369553d92a89d5683c50d705efd48b"} Oct 30 22:14:36.984174 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:36.983874 6162 scope.go:122] "RemoveContainer" containerID="ff3b70c2a80f80a78426448c30fa47ae1d2d2750d4df7c16bba75f908b6cc90b" Oct 30 22:14:37.070788 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:37.070748 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk"] Oct 30 22:14:37.078333 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:37.078305 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-init-fail-7ff833-predictor-85db759dbb-rvpzk"] Oct 30 22:14:37.594766 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:37.594731 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="74fc89a6-ae3a-40d8-832c-b2e70e317d48" path="/var/lib/kubelet/pods/74fc89a6-ae3a-40d8-832c-b2e70e317d48/volumes" Oct 30 22:14:38.127714 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.127680 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj"] Oct 30 22:14:38.128143 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.127997 6162 cpu_manager.go:414] "containerMap: removing container" podUID="74fc89a6-ae3a-40d8-832c-b2e70e317d48" containerName="storage-initializer" Oct 30 22:14:38.128143 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.128007 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74fc89a6-ae3a-40d8-832c-b2e70e317d48" containerName="storage-initializer" Oct 30 22:14:38.128143 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.128028 6162 cpu_manager.go:414] "containerMap: removing container" podUID="74fc89a6-ae3a-40d8-832c-b2e70e317d48" containerName="storage-initializer" Oct 30 22:14:38.128143 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.128033 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74fc89a6-ae3a-40d8-832c-b2e70e317d48" containerName="storage-initializer" Oct 30 22:14:38.128143 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.128082 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="74fc89a6-ae3a-40d8-832c-b2e70e317d48" containerName="storage-initializer" Oct 30 22:14:38.128317 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.128193 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="74fc89a6-ae3a-40d8-832c-b2e70e317d48" containerName="storage-initializer" Oct 30 22:14:38.132394 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.132372 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.148984 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.148963 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"openshift-service-ca.crt\"" Oct 30 22:14:38.149084 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.149021 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"raw-sklearn-dec36-kube-rbac-proxy-sar-config\"" Oct 30 22:14:38.149124 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.149099 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"kube-root-ca.crt\"" Oct 30 22:14:38.149124 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.149110 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:14:38.160729 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.160697 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"default-dockercfg-d9bw2\"" Oct 30 22:14:38.160876 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.160750 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"raw-sklearn-dec36-predictor-serving-cert\"" Oct 30 22:14:38.160876 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.160750 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"seaweedfs-s3-creds\"" Oct 30 22:14:38.161839 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.161798 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj"] Oct 30 22:14:38.233209 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.233179 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-cabundle-cert\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.233340 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.233228 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kserve-provision-location\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.233340 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.233325 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4h7j\" (UniqueName: \"kubernetes.io/projected/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-api-access-v4h7j\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.233431 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.233355 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.233431 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.233391 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a7bc5138-929c-4a4c-b81a-c9cfda904e09-proxy-tls\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.334235 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.334205 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-cabundle-cert\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.334344 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.334262 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kserve-provision-location\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.334344 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.334300 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4h7j\" (UniqueName: \"kubernetes.io/projected/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-api-access-v4h7j\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.334344 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.334318 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.334344 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.334338 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a7bc5138-929c-4a4c-b81a-c9cfda904e09-proxy-tls\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.334745 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.334720 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kserve-provision-location\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.334984 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.334964 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.335070 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.334973 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-cabundle-cert\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.336671 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.336651 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a7bc5138-929c-4a4c-b81a-c9cfda904e09-proxy-tls\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.354864 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.354836 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4h7j\" (UniqueName: \"kubernetes.io/projected/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-api-access-v4h7j\") pod \"raw-sklearn-dec36-predictor-77565db7d8-hm6cj\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.448644 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.448582 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:38.759219 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.759118 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj"] Oct 30 22:14:38.762853 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:14:38.762824 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7bc5138_929c_4a4c_b81a_c9cfda904e09.slice/crio-e6eec7f132be5c66e0b15462b1a20f7da5f216f9a09bf67e746a85f642a62165 WatchSource:0}: Error finding container e6eec7f132be5c66e0b15462b1a20f7da5f216f9a09bf67e746a85f642a62165: Status 404 returned error can't find the container with id e6eec7f132be5c66e0b15462b1a20f7da5f216f9a09bf67e746a85f642a62165 Oct 30 22:14:38.994635 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.994599 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" event={"ID":"a7bc5138-929c-4a4c-b81a-c9cfda904e09","Type":"ContainerStarted","Data":"7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872"} Oct 30 22:14:38.994806 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:38.994668 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" event={"ID":"a7bc5138-929c-4a4c-b81a-c9cfda904e09","Type":"ContainerStarted","Data":"e6eec7f132be5c66e0b15462b1a20f7da5f216f9a09bf67e746a85f642a62165"} Oct 30 22:14:43.012577 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:43.012492 6162 generic.go:356] "Generic (PLEG): container finished" podID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerID="7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872" exitCode=0 Oct 30 22:14:43.012577 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:43.012564 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" event={"ID":"a7bc5138-929c-4a4c-b81a-c9cfda904e09","Type":"ContainerDied","Data":"7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872"} Oct 30 22:14:44.018832 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:44.018794 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" event={"ID":"a7bc5138-929c-4a4c-b81a-c9cfda904e09","Type":"ContainerStarted","Data":"ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64"} Oct 30 22:14:44.019185 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:44.018865 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" event={"ID":"a7bc5138-929c-4a4c-b81a-c9cfda904e09","Type":"ContainerStarted","Data":"2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4"} Oct 30 22:14:44.019185 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:44.019136 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:44.076471 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:44.076425 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podStartSLOduration=2.16935991 podStartE2EDuration="6.076412519s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.907052609s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:44.075382209 +0000 UTC m=+1196.585253770" watchObservedRunningTime="2026-10-30 22:14:44.076412519 +0000 UTC m=+1196.586284081" Oct 30 22:14:45.022552 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:45.022524 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:45.023925 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:45.023900 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:14:46.026744 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:46.026707 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:14:47.689111 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:47.689085 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 22:14:47.693614 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:47.693591 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 22:14:51.031008 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:51.030982 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:14:51.031508 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:14:51.031482 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:14:54.097495 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:14:54.097448 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:15:01.031838 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:15:01.031787 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:15:11.031480 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:15:11.031441 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:15:21.031597 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:15:21.031558 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:15:24.095646 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:15:24.095595 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:15:31.031539 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:15:31.031499 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:15:41.031694 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:15:41.031659 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:15:51.032334 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:15:51.032298 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:15:54.095700 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:15:54.095667 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:16:01.032765 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:01.032689 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:16:08.901011 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:08.900975 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj"] Oct 30 22:16:08.901441 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:08.901213 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" containerID="cri-o://2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4" gracePeriod=30 Oct 30 22:16:08.901441 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:08.901288 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kube-rbac-proxy" containerID="cri-o://ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64" gracePeriod=30 Oct 30 22:16:09.349116 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:09.349027 6162 generic.go:356] "Generic (PLEG): container finished" podID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerID="ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64" exitCode=0 Oct 30 22:16:09.349116 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:09.349064 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" event={"ID":"a7bc5138-929c-4a4c-b81a-c9cfda904e09","Type":"ContainerDied","Data":"ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64"} Oct 30 22:16:11.027654 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:11.027600 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused" Oct 30 22:16:11.032112 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:11.032084 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:16:13.542610 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.542585 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:16:13.644203 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.644181 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a7bc5138-929c-4a4c-b81a-c9cfda904e09-proxy-tls\" (UniqueName: \"kubernetes.io/secret/a7bc5138-929c-4a4c-b81a-c9cfda904e09-proxy-tls\") pod \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " Oct 30 22:16:13.644358 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.644220 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kserve-provision-location\") pod \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " Oct 30 22:16:13.644358 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.644257 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-cabundle-cert\") pod \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " Oct 30 22:16:13.644358 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.644275 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-api-access-v4h7j\" (UniqueName: \"kubernetes.io/projected/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-api-access-v4h7j\") pod \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " Oct 30 22:16:13.644358 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.644297 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-rbac-proxy-sar-config\") pod \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\" (UID: \"a7bc5138-929c-4a4c-b81a-c9cfda904e09\") " Oct 30 22:16:13.644666 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.644640 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kserve-provision-location" pod "a7bc5138-929c-4a4c-b81a-c9cfda904e09" (UID: "a7bc5138-929c-4a4c-b81a-c9cfda904e09"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:16:13.644720 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.644663 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-cabundle-cert" pod "a7bc5138-929c-4a4c-b81a-c9cfda904e09" (UID: "a7bc5138-929c-4a4c-b81a-c9cfda904e09"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:16:13.644720 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.644705 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-rbac-proxy-sar-config" pod "a7bc5138-929c-4a4c-b81a-c9cfda904e09" (UID: "a7bc5138-929c-4a4c-b81a-c9cfda904e09"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:16:13.646298 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.646271 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7bc5138-929c-4a4c-b81a-c9cfda904e09-proxy-tls" pod "a7bc5138-929c-4a4c-b81a-c9cfda904e09" (UID: "a7bc5138-929c-4a4c-b81a-c9cfda904e09"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:16:13.646401 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.646353 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-api-access-v4h7j" pod "a7bc5138-929c-4a4c-b81a-c9cfda904e09" (UID: "a7bc5138-929c-4a4c-b81a-c9cfda904e09"). InnerVolumeSpecName "kube-api-access-v4h7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:16:13.744790 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.744767 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:16:13.744790 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.744788 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4h7j\" (UniqueName: \"kubernetes.io/projected/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-api-access-v4h7j\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:16:13.744942 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.744797 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:16:13.744942 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.744806 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a7bc5138-929c-4a4c-b81a-c9cfda904e09-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:16:13.744942 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:13.744837 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7bc5138-929c-4a4c-b81a-c9cfda904e09-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:16:14.376370 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.376330 6162 generic.go:356] "Generic (PLEG): container finished" podID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerID="2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4" exitCode=0 Oct 30 22:16:14.376534 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.376418 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" Oct 30 22:16:14.376534 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.376415 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" event={"ID":"a7bc5138-929c-4a4c-b81a-c9cfda904e09","Type":"ContainerDied","Data":"2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4"} Oct 30 22:16:14.376607 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.376581 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj" event={"ID":"a7bc5138-929c-4a4c-b81a-c9cfda904e09","Type":"ContainerDied","Data":"e6eec7f132be5c66e0b15462b1a20f7da5f216f9a09bf67e746a85f642a62165"} Oct 30 22:16:14.376640 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.376609 6162 scope.go:122] "RemoveContainer" containerID="ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64" Oct 30 22:16:14.384852 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.384836 6162 scope.go:122] "RemoveContainer" containerID="2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4" Oct 30 22:16:14.391541 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.391525 6162 scope.go:122] "RemoveContainer" containerID="7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872" Oct 30 22:16:14.398679 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.398656 6162 scope.go:122] "RemoveContainer" containerID="ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64" Oct 30 22:16:14.398941 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:16:14.398921 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64\": container with ID starting with ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64 not found: ID does not exist" containerID="ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64" Oct 30 22:16:14.399022 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.398951 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64"} err="failed to get container status \"ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64\": rpc error: code = NotFound desc = could not find container \"ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64\": container with ID starting with ece365f53044f1e5315f487ce401a9292e8b9f7a47b15fcfd643430f74ac4f64 not found: ID does not exist" Oct 30 22:16:14.399022 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.398976 6162 scope.go:122] "RemoveContainer" containerID="2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4" Oct 30 22:16:14.399216 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:16:14.399200 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4\": container with ID starting with 2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4 not found: ID does not exist" containerID="2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4" Oct 30 22:16:14.399253 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.399222 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4"} err="failed to get container status \"2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4\": rpc error: code = NotFound desc = could not find container \"2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4\": container with ID starting with 2205328c1254579d8e0b2e5f29a00f048bac6591fcafcddc0fb9989c96fd2fd4 not found: ID does not exist" Oct 30 22:16:14.399253 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.399236 6162 scope.go:122] "RemoveContainer" containerID="7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872" Oct 30 22:16:14.399456 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:16:14.399439 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872\": container with ID starting with 7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872 not found: ID does not exist" containerID="7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872" Oct 30 22:16:14.399510 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.399464 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872"} err="failed to get container status \"7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872\": rpc error: code = NotFound desc = could not find container \"7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872\": container with ID starting with 7c2b7f5865c7ee53ab7d52641a242f352387a806b4bd81ae7dc53572de8d9872 not found: ID does not exist" Oct 30 22:16:14.447152 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.447125 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj"] Oct 30 22:16:14.459613 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:14.459586 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-dec36-predictor-77565db7d8-hm6cj"] Oct 30 22:16:15.595337 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:15.595307 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" path="/var/lib/kubelet/pods/a7bc5138-929c-4a4c-b81a-c9cfda904e09/volumes" Oct 30 22:16:16.461130 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.461095 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr"] Oct 30 22:16:16.461421 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.461409 6162 cpu_manager.go:414] "containerMap: removing container" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="storage-initializer" Oct 30 22:16:16.461482 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.461423 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="storage-initializer" Oct 30 22:16:16.461482 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.461443 6162 cpu_manager.go:414] "containerMap: removing container" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" Oct 30 22:16:16.461482 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.461448 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" Oct 30 22:16:16.461482 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.461460 6162 cpu_manager.go:414] "containerMap: removing container" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kube-rbac-proxy" Oct 30 22:16:16.461482 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.461465 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kube-rbac-proxy" Oct 30 22:16:16.461632 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.461518 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kserve-container" Oct 30 22:16:16.461632 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.461525 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="a7bc5138-929c-4a4c-b81a-c9cfda904e09" containerName="kube-rbac-proxy" Oct 30 22:16:16.465926 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.465904 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.481506 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.481484 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"raw-sklearn-runtime-f3c44-predictor-serving-cert\"" Oct 30 22:16:16.481981 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.481961 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"seaweedfs-s3-creds\"" Oct 30 22:16:16.494402 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.494373 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"default-dockercfg-d9bw2\"" Oct 30 22:16:16.494558 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.494457 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"kube-root-ca.crt\"" Oct 30 22:16:16.494558 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.494459 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"raw-sklearn-runtime-f3c44-kube-rbac-proxy-sar-config\"" Oct 30 22:16:16.494558 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.494462 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:16:16.494735 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.494592 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"openshift-service-ca.crt\"" Oct 30 22:16:16.497143 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.497122 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr"] Oct 30 22:16:16.567886 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.567848 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mln8w\" (UniqueName: \"kubernetes.io/projected/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-api-access-mln8w\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.568061 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.567907 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-cabundle-cert\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.568061 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.568020 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c422c82b-f74c-493f-bfdd-3c23e063af64-proxy-tls\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.568186 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.568057 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c422c82b-f74c-493f-bfdd-3c23e063af64-kserve-provision-location\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.568186 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.568144 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.669494 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.669456 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mln8w\" (UniqueName: \"kubernetes.io/projected/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-api-access-mln8w\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.669942 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.669512 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-cabundle-cert\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.669942 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.669540 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c422c82b-f74c-493f-bfdd-3c23e063af64-proxy-tls\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.669942 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.669557 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c422c82b-f74c-493f-bfdd-3c23e063af64-kserve-provision-location\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.669942 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.669585 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.670089 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.670068 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c422c82b-f74c-493f-bfdd-3c23e063af64-kserve-provision-location\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.670488 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.670467 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-cabundle-cert\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.670525 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.670467 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.671993 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.671974 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c422c82b-f74c-493f-bfdd-3c23e063af64-proxy-tls\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.691002 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.690975 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mln8w\" (UniqueName: \"kubernetes.io/projected/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-api-access-mln8w\") pod \"raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:16.783212 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:16.783129 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:17.107752 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:17.107725 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr"] Oct 30 22:16:17.110414 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:16:17.110384 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc422c82b_f74c_493f_bfdd_3c23e063af64.slice/crio-cd3dc78e68c9fda2c7a7d5cd6215c95104bd27cea171da0c0c6dcfa949c4c342 WatchSource:0}: Error finding container cd3dc78e68c9fda2c7a7d5cd6215c95104bd27cea171da0c0c6dcfa949c4c342: Status 404 returned error can't find the container with id cd3dc78e68c9fda2c7a7d5cd6215c95104bd27cea171da0c0c6dcfa949c4c342 Oct 30 22:16:17.389870 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:17.389834 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" event={"ID":"c422c82b-f74c-493f-bfdd-3c23e063af64","Type":"ContainerStarted","Data":"b1f9df919db324ca4c0e066cfc26964dc28645825ffbe772949974da5dba21f2"} Oct 30 22:16:17.390010 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:17.389911 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" event={"ID":"c422c82b-f74c-493f-bfdd-3c23e063af64","Type":"ContainerStarted","Data":"cd3dc78e68c9fda2c7a7d5cd6215c95104bd27cea171da0c0c6dcfa949c4c342"} Oct 30 22:16:21.407386 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:21.407350 6162 generic.go:356] "Generic (PLEG): container finished" podID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerID="b1f9df919db324ca4c0e066cfc26964dc28645825ffbe772949974da5dba21f2" exitCode=0 Oct 30 22:16:21.407957 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:21.407428 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" event={"ID":"c422c82b-f74c-493f-bfdd-3c23e063af64","Type":"ContainerDied","Data":"b1f9df919db324ca4c0e066cfc26964dc28645825ffbe772949974da5dba21f2"} Oct 30 22:16:22.414192 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:22.414163 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" event={"ID":"c422c82b-f74c-493f-bfdd-3c23e063af64","Type":"ContainerStarted","Data":"10dffcd9e3541be9e6478f2f98957aa0984e755e996d9cae9a3eac84d31be75d"} Oct 30 22:16:22.414655 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:22.414229 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" event={"ID":"c422c82b-f74c-493f-bfdd-3c23e063af64","Type":"ContainerStarted","Data":"bb89f85692367679accb07e70e827422742e42d53aca7e945bb8d3a98fda26d5"} Oct 30 22:16:22.414655 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:22.414448 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:22.473775 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:22.473735 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podStartSLOduration=2.7386833619999997 podStartE2EDuration="6.473725577s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.735042215s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:22.473714529 +0000 UTC m=+1294.983586089" watchObservedRunningTime="2026-10-30 22:16:22.473725577 +0000 UTC m=+1294.983597136" Oct 30 22:16:23.418740 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:23.418707 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:23.420045 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:23.420016 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:16:24.095711 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:16:24.095679 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:16:24.422403 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:24.422367 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:16:29.427269 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:29.427239 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:16:29.427732 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:29.427707 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:16:39.428586 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:39.428550 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:16:49.427804 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:49.427765 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:16:54.095898 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:16:54.095862 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:16:59.427713 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:16:59.427672 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:17:09.428693 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:09.428658 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:17:19.427927 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:19.427888 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:17:24.095685 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:17:24.095646 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:17:29.428543 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:29.428463 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:17:39.428981 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:39.428949 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:17:47.305326 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:47.305292 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr"] Oct 30 22:17:47.305874 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:47.305571 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" containerID="cri-o://bb89f85692367679accb07e70e827422742e42d53aca7e945bb8d3a98fda26d5" gracePeriod=30 Oct 30 22:17:47.305874 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:47.305624 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kube-rbac-proxy" containerID="cri-o://10dffcd9e3541be9e6478f2f98957aa0984e755e996d9cae9a3eac84d31be75d" gracePeriod=30 Oct 30 22:17:47.742196 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:47.742156 6162 generic.go:356] "Generic (PLEG): container finished" podID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerID="10dffcd9e3541be9e6478f2f98957aa0984e755e996d9cae9a3eac84d31be75d" exitCode=0 Oct 30 22:17:47.742359 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:47.742229 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" event={"ID":"c422c82b-f74c-493f-bfdd-3c23e063af64","Type":"ContainerDied","Data":"10dffcd9e3541be9e6478f2f98957aa0984e755e996d9cae9a3eac84d31be75d"} Oct 30 22:17:49.422619 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:49.422583 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.29:8643/healthz\": dial tcp 10.133.0.29:8643: connect: connection refused" Oct 30 22:17:49.427908 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:49.427882 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:17:51.760863 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.760810 6162 generic.go:356] "Generic (PLEG): container finished" podID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerID="bb89f85692367679accb07e70e827422742e42d53aca7e945bb8d3a98fda26d5" exitCode=0 Oct 30 22:17:51.761214 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.760871 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" event={"ID":"c422c82b-f74c-493f-bfdd-3c23e063af64","Type":"ContainerDied","Data":"bb89f85692367679accb07e70e827422742e42d53aca7e945bb8d3a98fda26d5"} Oct 30 22:17:51.849296 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.849273 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:17:51.896675 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.896653 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-rbac-proxy-sar-config\") pod \"c422c82b-f74c-493f-bfdd-3c23e063af64\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " Oct 30 22:17:51.896824 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.896699 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-api-access-mln8w\" (UniqueName: \"kubernetes.io/projected/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-api-access-mln8w\") pod \"c422c82b-f74c-493f-bfdd-3c23e063af64\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " Oct 30 22:17:51.896824 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.896742 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-cabundle-cert\") pod \"c422c82b-f74c-493f-bfdd-3c23e063af64\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " Oct 30 22:17:51.896824 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.896764 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c422c82b-f74c-493f-bfdd-3c23e063af64-proxy-tls\" (UniqueName: \"kubernetes.io/secret/c422c82b-f74c-493f-bfdd-3c23e063af64-proxy-tls\") pod \"c422c82b-f74c-493f-bfdd-3c23e063af64\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " Oct 30 22:17:51.896824 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.896795 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c422c82b-f74c-493f-bfdd-3c23e063af64-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c422c82b-f74c-493f-bfdd-3c23e063af64-kserve-provision-location\") pod \"c422c82b-f74c-493f-bfdd-3c23e063af64\" (UID: \"c422c82b-f74c-493f-bfdd-3c23e063af64\") " Oct 30 22:17:51.897053 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.897033 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-rbac-proxy-sar-config" pod "c422c82b-f74c-493f-bfdd-3c23e063af64" (UID: "c422c82b-f74c-493f-bfdd-3c23e063af64"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:17:51.897178 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.897149 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-cabundle-cert" pod "c422c82b-f74c-493f-bfdd-3c23e063af64" (UID: "c422c82b-f74c-493f-bfdd-3c23e063af64"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:17:51.897281 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.897205 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c422c82b-f74c-493f-bfdd-3c23e063af64-kserve-provision-location" pod "c422c82b-f74c-493f-bfdd-3c23e063af64" (UID: "c422c82b-f74c-493f-bfdd-3c23e063af64"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:17:51.898755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.898737 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-api-access-mln8w" pod "c422c82b-f74c-493f-bfdd-3c23e063af64" (UID: "c422c82b-f74c-493f-bfdd-3c23e063af64"). InnerVolumeSpecName "kube-api-access-mln8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:17:51.898838 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.898768 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c422c82b-f74c-493f-bfdd-3c23e063af64-proxy-tls" pod "c422c82b-f74c-493f-bfdd-3c23e063af64" (UID: "c422c82b-f74c-493f-bfdd-3c23e063af64"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:17:51.997779 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.997707 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c422c82b-f74c-493f-bfdd-3c23e063af64-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:17:51.997779 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.997730 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c422c82b-f74c-493f-bfdd-3c23e063af64-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:17:51.997779 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.997741 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:17:51.997779 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.997750 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mln8w\" (UniqueName: \"kubernetes.io/projected/c422c82b-f74c-493f-bfdd-3c23e063af64-kube-api-access-mln8w\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:17:51.997779 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:51.997759 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c422c82b-f74c-493f-bfdd-3c23e063af64-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:17:52.768501 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:52.768450 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" event={"ID":"c422c82b-f74c-493f-bfdd-3c23e063af64","Type":"ContainerDied","Data":"cd3dc78e68c9fda2c7a7d5cd6215c95104bd27cea171da0c0c6dcfa949c4c342"} Oct 30 22:17:52.769079 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:52.768583 6162 scope.go:122] "RemoveContainer" containerID="10dffcd9e3541be9e6478f2f98957aa0984e755e996d9cae9a3eac84d31be75d" Oct 30 22:17:52.769079 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:52.768803 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr" Oct 30 22:17:52.778005 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:52.777983 6162 scope.go:122] "RemoveContainer" containerID="bb89f85692367679accb07e70e827422742e42d53aca7e945bb8d3a98fda26d5" Oct 30 22:17:52.787456 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:52.787431 6162 scope.go:122] "RemoveContainer" containerID="b1f9df919db324ca4c0e066cfc26964dc28645825ffbe772949974da5dba21f2" Oct 30 22:17:52.838318 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:52.838286 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr"] Oct 30 22:17:52.851407 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:52.851380 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/raw-sklearn-runtime-f3c44-predictor-7994b6d844-dfjxr"] Oct 30 22:17:53.596137 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:53.596101 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" path="/var/lib/kubelet/pods/c422c82b-f74c-493f-bfdd-3c23e063af64/volumes" Oct 30 22:17:54.095617 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:17:54.095584 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:17:54.899957 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.899923 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht"] Oct 30 22:17:54.900220 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.900209 6162 cpu_manager.go:414] "containerMap: removing container" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" Oct 30 22:17:54.900265 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.900222 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" Oct 30 22:17:54.900265 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.900244 6162 cpu_manager.go:414] "containerMap: removing container" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="storage-initializer" Oct 30 22:17:54.900265 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.900250 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="storage-initializer" Oct 30 22:17:54.900265 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.900259 6162 cpu_manager.go:414] "containerMap: removing container" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kube-rbac-proxy" Oct 30 22:17:54.900265 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.900264 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kube-rbac-proxy" Oct 30 22:17:54.900417 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.900321 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kserve-container" Oct 30 22:17:54.900417 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.900329 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="c422c82b-f74c-493f-bfdd-3c23e063af64" containerName="kube-rbac-proxy" Oct 30 22:17:54.905054 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.905035 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:54.922040 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.922017 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\"" Oct 30 22:17:54.922040 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.922033 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"kube-root-ca.crt\"" Oct 30 22:17:54.934059 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.934035 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:17:54.934059 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.934055 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"default-dockercfg-d9bw2\"" Oct 30 22:17:54.934059 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.934040 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"openshift-service-ca.crt\"" Oct 30 22:17:54.934059 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.934036 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"seaweedfs-s3-creds\"" Oct 30 22:17:54.934315 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.934132 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-create-v2-predictor-serving-cert\"" Oct 30 22:17:54.935351 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:54.935334 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht"] Oct 30 22:17:55.022000 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.021964 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kserve-provision-location\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.022156 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.022005 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-proxy-tls\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.022156 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.022088 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.022156 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.022126 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-cabundle-cert\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.022263 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.022187 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbntl\" (UniqueName: \"kubernetes.io/projected/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-api-access-fbntl\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.071195 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.071158 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9"] Oct 30 22:17:55.074621 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.074601 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.096332 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.096311 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9"] Oct 30 22:17:55.122854 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.122808 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbntl\" (UniqueName: \"kubernetes.io/projected/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-api-access-fbntl\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.122957 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.122879 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n699l\" (UniqueName: \"kubernetes.io/projected/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-api-access-n699l\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.122957 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.122910 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-create-predictor-serving-cert\"" Oct 30 22:17:55.123030 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.122956 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kserve-provision-location\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.123030 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.122982 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.123030 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.123013 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-proxy-tls\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.123121 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.123091 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.123153 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.123134 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kserve-provision-location\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.123189 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.123165 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-cabundle-cert\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.123230 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.123195 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-proxy-tls\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.123316 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.123297 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-cabundle-cert\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.123422 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.123405 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kserve-provision-location\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.123833 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.123792 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-cabundle-cert\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.123927 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.123792 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.125403 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.125384 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-proxy-tls\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.144737 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.144710 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbntl\" (UniqueName: \"kubernetes.io/projected/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-api-access-fbntl\") pod \"isvc-canary-create-v2-predictor-968874b64-pgvht\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.222357 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.222303 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:17:55.224594 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.224569 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.224708 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.224635 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kserve-provision-location\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.224708 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.224669 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-proxy-tls\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.224708 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.224692 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-cabundle-cert\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.224899 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.224742 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n699l\" (UniqueName: \"kubernetes.io/projected/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-api-access-n699l\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.225024 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.225000 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kserve-provision-location\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.225605 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.225308 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.225605 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.225372 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-cabundle-cert\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.226901 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.226883 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-proxy-tls\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.248964 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.248944 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n699l\" (UniqueName: \"kubernetes.io/projected/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-api-access-n699l\") pod \"isvc-canary-create-predictor-57d466f945-kgtp9\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.390671 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.390637 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:17:55.531559 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.531535 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht"] Oct 30 22:17:55.534027 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:17:55.533998 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd3b9ea_5fc8_48da_bca0_8eb926d01166.slice/crio-5b629823882e0816705339c0320f5c69e91777a9778e3690a0997d36a89eb832 WatchSource:0}: Error finding container 5b629823882e0816705339c0320f5c69e91777a9778e3690a0997d36a89eb832: Status 404 returned error can't find the container with id 5b629823882e0816705339c0320f5c69e91777a9778e3690a0997d36a89eb832 Oct 30 22:17:55.685369 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.685346 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9"] Oct 30 22:17:55.688510 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:17:55.688466 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bcd4ea_0a9b_4555_af4c_b2eb8d0feb8f.slice/crio-abcf98bf2cba38ec059dda282eb5455a8a3480dfbe8798028568eee9d3984191 WatchSource:0}: Error finding container abcf98bf2cba38ec059dda282eb5455a8a3480dfbe8798028568eee9d3984191: Status 404 returned error can't find the container with id abcf98bf2cba38ec059dda282eb5455a8a3480dfbe8798028568eee9d3984191 Oct 30 22:17:55.784011 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.783926 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" event={"ID":"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f","Type":"ContainerStarted","Data":"a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720"} Oct 30 22:17:55.784011 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.784003 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" event={"ID":"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f","Type":"ContainerStarted","Data":"abcf98bf2cba38ec059dda282eb5455a8a3480dfbe8798028568eee9d3984191"} Oct 30 22:17:55.785698 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.785674 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" event={"ID":"6dd3b9ea-5fc8-48da-bca0-8eb926d01166","Type":"ContainerStarted","Data":"e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b"} Oct 30 22:17:55.785808 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:55.785726 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" event={"ID":"6dd3b9ea-5fc8-48da-bca0-8eb926d01166","Type":"ContainerStarted","Data":"5b629823882e0816705339c0320f5c69e91777a9778e3690a0997d36a89eb832"} Oct 30 22:17:59.802956 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:59.802922 6162 generic.go:356] "Generic (PLEG): container finished" podID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerID="a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720" exitCode=0 Oct 30 22:17:59.803389 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:59.802990 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" event={"ID":"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f","Type":"ContainerDied","Data":"a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720"} Oct 30 22:17:59.804615 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:59.804593 6162 generic.go:356] "Generic (PLEG): container finished" podID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerID="e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b" exitCode=0 Oct 30 22:17:59.804728 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:17:59.804662 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" event={"ID":"6dd3b9ea-5fc8-48da-bca0-8eb926d01166","Type":"ContainerDied","Data":"e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b"} Oct 30 22:18:00.811304 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:00.811267 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" event={"ID":"6dd3b9ea-5fc8-48da-bca0-8eb926d01166","Type":"ContainerStarted","Data":"5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190"} Oct 30 22:18:00.811709 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:00.811326 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" event={"ID":"6dd3b9ea-5fc8-48da-bca0-8eb926d01166","Type":"ContainerStarted","Data":"1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e"} Oct 30 22:18:00.811709 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:00.811608 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:18:00.813396 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:00.813372 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" event={"ID":"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f","Type":"ContainerStarted","Data":"da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3"} Oct 30 22:18:00.813513 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:00.813423 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" event={"ID":"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f","Type":"ContainerStarted","Data":"e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998"} Oct 30 22:18:00.813765 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:00.813748 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:18:00.813839 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:00.813802 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:18:00.815180 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:00.815157 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:18:00.870313 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:00.870260 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podStartSLOduration=3.152958948 podStartE2EDuration="6.870246974s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.717288026s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:00.869633058 +0000 UTC m=+1393.379504622" watchObservedRunningTime="2026-10-30 22:18:00.870246974 +0000 UTC m=+1393.380118533" Oct 30 22:18:00.916546 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:00.916496 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podStartSLOduration=2.138049422 podStartE2EDuration="5.91648433s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.778434908s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:00.915606581 +0000 UTC m=+1393.425478141" watchObservedRunningTime="2026-10-30 22:18:00.91648433 +0000 UTC m=+1393.426355887" Oct 30 22:18:01.818067 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:01.818022 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:18:01.818528 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:01.818089 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:18:01.819018 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:01.818990 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:18:02.823207 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:02.823164 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:18:06.822466 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:06.822437 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:18:06.822922 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:06.822899 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:18:07.828015 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:07.827990 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:18:07.828433 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:07.828410 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:18:16.822880 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:16.822839 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:18:17.829268 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:17.829230 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:18:24.096686 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:18:24.096649 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:18:26.823333 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:26.823295 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:18:27.828414 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:27.828373 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:18:36.823338 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:36.823297 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:18:37.829128 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:37.829093 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:18:46.822972 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:46.822924 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:18:47.828492 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:47.828457 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:18:54.095596 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:18:54.095561 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:18:56.823219 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:56.823181 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:18:57.829002 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:18:57.828965 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:19:06.823347 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:06.823267 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:19:07.828609 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:07.828567 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:19:08.590082 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:08.590043 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:19:17.829351 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:17.829319 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:19:18.279221 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:18.279186 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9"] Oct 30 22:19:18.279459 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:18.279410 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" containerID="cri-o://e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998" gracePeriod=30 Oct 30 22:19:18.279620 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:18.279480 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kube-rbac-proxy" containerID="cri-o://da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3" gracePeriod=30 Oct 30 22:19:18.280241 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:18.280140 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:19:19.124310 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:19.124279 6162 generic.go:356] "Generic (PLEG): container finished" podID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerID="da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3" exitCode=0 Oct 30 22:19:19.126745 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:19.124352 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" event={"ID":"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f","Type":"ContainerDied","Data":"da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3"} Oct 30 22:19:21.818621 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:21.818568 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 30 22:19:22.928677 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:22.928652 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:19:23.030006 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.029926 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-api-access-n699l\" (UniqueName: \"kubernetes.io/projected/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-api-access-n699l\") pod \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " Oct 30 22:19:23.030182 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.030008 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kserve-provision-location\") pod \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " Oct 30 22:19:23.030182 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.030106 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-rbac-proxy-sar-config\") pod \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " Oct 30 22:19:23.030182 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.030165 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-proxy-tls\" (UniqueName: \"kubernetes.io/secret/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-proxy-tls\") pod \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " Oct 30 22:19:23.030349 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.030229 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-cabundle-cert\") pod \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\" (UID: \"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f\") " Oct 30 22:19:23.030349 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.030279 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kserve-provision-location" pod "22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" (UID: "22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:19:23.030464 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.030448 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:19:23.030513 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.030463 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-rbac-proxy-sar-config" pod "22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" (UID: "22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:19:23.030622 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.030601 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-cabundle-cert" pod "22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" (UID: "22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:19:23.032125 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.032096 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-api-access-n699l" pod "22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" (UID: "22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f"). InnerVolumeSpecName "kube-api-access-n699l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:19:23.032125 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.032117 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-proxy-tls" pod "22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" (UID: "22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:19:23.131515 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.131474 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:19:23.131515 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.131509 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n699l\" (UniqueName: \"kubernetes.io/projected/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-api-access-n699l\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:19:23.131515 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.131520 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:19:23.131515 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.131530 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:19:23.143403 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.143372 6162 generic.go:356] "Generic (PLEG): container finished" podID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerID="e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998" exitCode=0 Oct 30 22:19:23.143512 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.143428 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" Oct 30 22:19:23.143512 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.143458 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" event={"ID":"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f","Type":"ContainerDied","Data":"e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998"} Oct 30 22:19:23.143583 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.143539 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9" event={"ID":"22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f","Type":"ContainerDied","Data":"abcf98bf2cba38ec059dda282eb5455a8a3480dfbe8798028568eee9d3984191"} Oct 30 22:19:23.143583 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.143567 6162 scope.go:122] "RemoveContainer" containerID="da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3" Oct 30 22:19:23.151697 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.151680 6162 scope.go:122] "RemoveContainer" containerID="e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998" Oct 30 22:19:23.160226 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.160150 6162 scope.go:122] "RemoveContainer" containerID="a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720" Oct 30 22:19:23.167312 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.167298 6162 scope.go:122] "RemoveContainer" containerID="da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3" Oct 30 22:19:23.167557 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:19:23.167541 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3\": container with ID starting with da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3 not found: ID does not exist" containerID="da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3" Oct 30 22:19:23.167626 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.167570 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3"} err="failed to get container status \"da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3\": rpc error: code = NotFound desc = could not find container \"da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3\": container with ID starting with da9076f5220960e024e155070b9cd0852d0df3ec9ead67a130b3b17b5ee146d3 not found: ID does not exist" Oct 30 22:19:23.167626 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.167594 6162 scope.go:122] "RemoveContainer" containerID="e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998" Oct 30 22:19:23.167834 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:19:23.167804 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998\": container with ID starting with e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998 not found: ID does not exist" containerID="e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998" Oct 30 22:19:23.167883 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.167843 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998"} err="failed to get container status \"e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998\": rpc error: code = NotFound desc = could not find container \"e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998\": container with ID starting with e66e61e60fe5bbb4a241c3d990312ecfd7660e7246b3bab193df44a9ae890998 not found: ID does not exist" Oct 30 22:19:23.167883 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.167863 6162 scope.go:122] "RemoveContainer" containerID="a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720" Oct 30 22:19:23.168081 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:19:23.168052 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720\": container with ID starting with a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720 not found: ID does not exist" containerID="a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720" Oct 30 22:19:23.168120 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.168085 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720"} err="failed to get container status \"a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720\": rpc error: code = NotFound desc = could not find container \"a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720\": container with ID starting with a9b6b7a5d20c2cd5bac2bac6ee74bb31e98543cc96402f3e0062185b38eb4720 not found: ID does not exist" Oct 30 22:19:23.230008 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.229988 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9"] Oct 30 22:19:23.244098 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.244078 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-predictor-57d466f945-kgtp9"] Oct 30 22:19:23.595167 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:23.595136 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" path="/var/lib/kubelet/pods/22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f/volumes" Oct 30 22:19:24.094918 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:19:24.094883 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:19:25.029719 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:25.029692 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht"] Oct 30 22:19:25.029955 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:25.029929 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" containerID="cri-o://1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e" gracePeriod=30 Oct 30 22:19:25.030107 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:25.029971 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kube-rbac-proxy" containerID="cri-o://5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190" gracePeriod=30 Oct 30 22:19:25.153033 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:25.153008 6162 generic.go:356] "Generic (PLEG): container finished" podID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerID="5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190" exitCode=0 Oct 30 22:19:25.153346 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:25.153041 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" event={"ID":"6dd3b9ea-5fc8-48da-bca0-8eb926d01166","Type":"ContainerDied","Data":"5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190"} Oct 30 22:19:27.823453 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:27.823403 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Oct 30 22:19:27.828693 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:27.828665 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:19:29.571287 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.571265 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:19:29.677316 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.677287 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kserve-provision-location\") pod \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " Oct 30 22:19:29.677511 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.677343 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-proxy-tls\" (UniqueName: \"kubernetes.io/secret/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-proxy-tls\") pod \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " Oct 30 22:19:29.677511 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.677366 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-rbac-proxy-sar-config\") pod \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " Oct 30 22:19:29.677511 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.677402 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-cabundle-cert\") pod \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " Oct 30 22:19:29.677511 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.677432 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-api-access-fbntl\" (UniqueName: \"kubernetes.io/projected/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-api-access-fbntl\") pod \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\" (UID: \"6dd3b9ea-5fc8-48da-bca0-8eb926d01166\") " Oct 30 22:19:29.677741 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.677691 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kserve-provision-location" pod "6dd3b9ea-5fc8-48da-bca0-8eb926d01166" (UID: "6dd3b9ea-5fc8-48da-bca0-8eb926d01166"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:19:29.677848 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.677805 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-rbac-proxy-sar-config" pod "6dd3b9ea-5fc8-48da-bca0-8eb926d01166" (UID: "6dd3b9ea-5fc8-48da-bca0-8eb926d01166"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:19:29.677901 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.677806 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-cabundle-cert" pod "6dd3b9ea-5fc8-48da-bca0-8eb926d01166" (UID: "6dd3b9ea-5fc8-48da-bca0-8eb926d01166"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:19:29.679468 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.679450 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-proxy-tls" pod "6dd3b9ea-5fc8-48da-bca0-8eb926d01166" (UID: "6dd3b9ea-5fc8-48da-bca0-8eb926d01166"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:19:29.679555 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.679536 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-api-access-fbntl" pod "6dd3b9ea-5fc8-48da-bca0-8eb926d01166" (UID: "6dd3b9ea-5fc8-48da-bca0-8eb926d01166"). InnerVolumeSpecName "kube-api-access-fbntl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:19:29.778097 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.778072 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:19:29.778097 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.778097 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:19:29.778223 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.778115 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:19:29.778223 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.778125 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbntl\" (UniqueName: \"kubernetes.io/projected/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kube-api-access-fbntl\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:19:29.778223 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:29.778133 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6dd3b9ea-5fc8-48da-bca0-8eb926d01166-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:19:30.176753 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.176720 6162 generic.go:356] "Generic (PLEG): container finished" podID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerID="1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e" exitCode=0 Oct 30 22:19:30.176925 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.176779 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" Oct 30 22:19:30.176925 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.176811 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" event={"ID":"6dd3b9ea-5fc8-48da-bca0-8eb926d01166","Type":"ContainerDied","Data":"1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e"} Oct 30 22:19:30.176925 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.176885 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht" event={"ID":"6dd3b9ea-5fc8-48da-bca0-8eb926d01166","Type":"ContainerDied","Data":"5b629823882e0816705339c0320f5c69e91777a9778e3690a0997d36a89eb832"} Oct 30 22:19:30.176925 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.176912 6162 scope.go:122] "RemoveContainer" containerID="5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190" Oct 30 22:19:30.185265 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.185248 6162 scope.go:122] "RemoveContainer" containerID="1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e" Oct 30 22:19:30.192197 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.192179 6162 scope.go:122] "RemoveContainer" containerID="e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b" Oct 30 22:19:30.198828 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.198802 6162 scope.go:122] "RemoveContainer" containerID="5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190" Oct 30 22:19:30.199098 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:19:30.199080 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190\": container with ID starting with 5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190 not found: ID does not exist" containerID="5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190" Oct 30 22:19:30.199153 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.199106 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190"} err="failed to get container status \"5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190\": rpc error: code = NotFound desc = could not find container \"5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190\": container with ID starting with 5988437ed98fcebe619ff07574d8d4c230228fbb24dbe559248f0a02451a6190 not found: ID does not exist" Oct 30 22:19:30.199153 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.199122 6162 scope.go:122] "RemoveContainer" containerID="1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e" Oct 30 22:19:30.199309 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:19:30.199293 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e\": container with ID starting with 1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e not found: ID does not exist" containerID="1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e" Oct 30 22:19:30.199347 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.199313 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e"} err="failed to get container status \"1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e\": rpc error: code = NotFound desc = could not find container \"1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e\": container with ID starting with 1b1ecc5110394f45da4922a0598bd4ef7772a0a116a910b7f1f5d459d52a215e not found: ID does not exist" Oct 30 22:19:30.199347 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.199327 6162 scope.go:122] "RemoveContainer" containerID="e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b" Oct 30 22:19:30.199588 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:19:30.199570 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b\": container with ID starting with e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b not found: ID does not exist" containerID="e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b" Oct 30 22:19:30.199639 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.199603 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b"} err="failed to get container status \"e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b\": rpc error: code = NotFound desc = could not find container \"e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b\": container with ID starting with e2d2ac14b5ecd2491eb81fea73a977b95a92a4b8b1f7bf359ea0916066b0124b not found: ID does not exist" Oct 30 22:19:30.246765 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.246740 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht"] Oct 30 22:19:30.259584 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:30.259562 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-create-v2-predictor-968874b64-pgvht"] Oct 30 22:19:31.595464 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:31.595432 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" path="/var/lib/kubelet/pods/6dd3b9ea-5fc8-48da-bca0-8eb926d01166/volumes" Oct 30 22:19:33.042396 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042363 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896"] Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042669 6162 cpu_manager.go:414] "containerMap: removing container" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042680 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042692 6162 cpu_manager.go:414] "containerMap: removing container" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="storage-initializer" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042697 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="storage-initializer" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042704 6162 cpu_manager.go:414] "containerMap: removing container" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kube-rbac-proxy" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042708 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kube-rbac-proxy" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042716 6162 cpu_manager.go:414] "containerMap: removing container" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042721 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042731 6162 cpu_manager.go:414] "containerMap: removing container" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kube-rbac-proxy" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042736 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kube-rbac-proxy" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042746 6162 cpu_manager.go:414] "containerMap: removing container" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="storage-initializer" Oct 30 22:19:33.042755 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042751 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="storage-initializer" Oct 30 22:19:33.043148 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042805 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kserve-container" Oct 30 22:19:33.043148 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042826 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kube-rbac-proxy" Oct 30 22:19:33.043148 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042832 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="6dd3b9ea-5fc8-48da-bca0-8eb926d01166" containerName="kserve-container" Oct 30 22:19:33.043148 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.042839 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="22bcd4ea-0a9b-4555-af4c-b2eb8d0feb8f" containerName="kube-rbac-proxy" Oct 30 22:19:33.047401 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.047384 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.076806 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.076779 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:19:33.076806 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.076794 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"seaweedfs-s3-creds\"" Oct 30 22:19:33.077008 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.076783 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"kube-root-ca.crt\"" Oct 30 22:19:33.077008 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.076779 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"openshift-service-ca.crt\"" Oct 30 22:19:33.077008 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.076848 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\"" Oct 30 22:19:33.077899 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.077879 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896"] Oct 30 22:19:33.079914 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.079898 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-promote-predictor-serving-cert\"" Oct 30 22:19:33.079914 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.079902 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"default-dockercfg-d9bw2\"" Oct 30 22:19:33.204009 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.203986 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.204115 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.204015 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84c5t\" (UniqueName: \"kubernetes.io/projected/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-api-access-84c5t\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.204115 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.204062 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kserve-provision-location\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.204185 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.204145 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-proxy-tls\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.204221 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.204183 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-cabundle-cert\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.305366 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.305300 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kserve-provision-location\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.305366 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.305340 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-proxy-tls\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.305366 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.305368 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-cabundle-cert\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.305574 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.305392 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.305574 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.305549 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84c5t\" (UniqueName: \"kubernetes.io/projected/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-api-access-84c5t\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.305750 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.305732 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kserve-provision-location\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.306174 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.306151 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-cabundle-cert\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.306272 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.306151 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.307732 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.307712 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-proxy-tls\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.327294 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.327271 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84c5t\" (UniqueName: \"kubernetes.io/projected/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-api-access-84c5t\") pod \"isvc-canary-promote-predictor-7f778847bc-hw896\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.364134 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.364108 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:33.675647 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:33.675623 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896"] Oct 30 22:19:33.677655 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:19:33.677622 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f7fd86_2cb1_4d16_9d5f_aaef52c5fd8b.slice/crio-e9a70bd46d6b61bbe554b4f413cf91b4bb74660ef91fc7d531f54a5174b5964f WatchSource:0}: Error finding container e9a70bd46d6b61bbe554b4f413cf91b4bb74660ef91fc7d531f54a5174b5964f: Status 404 returned error can't find the container with id e9a70bd46d6b61bbe554b4f413cf91b4bb74660ef91fc7d531f54a5174b5964f Oct 30 22:19:34.195287 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:34.195255 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" event={"ID":"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b","Type":"ContainerStarted","Data":"fd41e74e1e23f796c02de02520b64b5d9dc900cc4a2ab11060704cf7dc80fe97"} Oct 30 22:19:34.195656 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:34.195313 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" event={"ID":"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b","Type":"ContainerStarted","Data":"e9a70bd46d6b61bbe554b4f413cf91b4bb74660ef91fc7d531f54a5174b5964f"} Oct 30 22:19:38.213590 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:38.213558 6162 generic.go:356] "Generic (PLEG): container finished" podID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerID="fd41e74e1e23f796c02de02520b64b5d9dc900cc4a2ab11060704cf7dc80fe97" exitCode=0 Oct 30 22:19:38.214012 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:38.213633 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" event={"ID":"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b","Type":"ContainerDied","Data":"fd41e74e1e23f796c02de02520b64b5d9dc900cc4a2ab11060704cf7dc80fe97"} Oct 30 22:19:39.219880 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:39.219848 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" event={"ID":"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b","Type":"ContainerStarted","Data":"cf1920dd05f9a5c4ac5e09b4657bce51fd9f78b05556ef771e8568542d1eb9dc"} Oct 30 22:19:39.220328 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:39.219912 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" event={"ID":"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b","Type":"ContainerStarted","Data":"9ddd568a38c1e548a85aa4a041ace749afcdc3a0dbc2e2d403df9a5f75d30a1f"} Oct 30 22:19:39.220385 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:39.220337 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:39.220509 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:39.220491 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:39.221483 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:39.221462 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:19:39.268944 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:39.268901 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podStartSLOduration=2.65970614 podStartE2EDuration="6.268886712s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.609180572s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:39.267865371 +0000 UTC m=+1491.777736931" watchObservedRunningTime="2026-10-30 22:19:39.268886712 +0000 UTC m=+1491.778758272" Oct 30 22:19:40.223789 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:40.223753 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:19:45.229581 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:45.229553 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:19:45.230059 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:45.230033 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:19:47.713392 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:47.713364 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 22:19:47.719399 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:47.719379 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 22:19:54.096095 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:19:54.096053 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:19:55.230451 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:19:55.230409 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:20:05.230376 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:20:05.230341 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:20:15.230432 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:20:15.230395 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:20:24.095272 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:20:24.095234 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:20:25.230338 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:20:25.230300 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:20:35.230735 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:20:35.230659 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:20:45.230630 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:20:45.230593 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:20:54.095977 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:20:54.095942 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:20:55.231690 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:20:55.231663 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:21:02.941512 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:02.941470 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896"] Oct 30 22:21:02.941975 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:02.941753 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" containerID="cri-o://9ddd568a38c1e548a85aa4a041ace749afcdc3a0dbc2e2d403df9a5f75d30a1f" gracePeriod=30 Oct 30 22:21:02.941975 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:02.941789 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kube-rbac-proxy" containerID="cri-o://cf1920dd05f9a5c4ac5e09b4657bce51fd9f78b05556ef771e8568542d1eb9dc" gracePeriod=30 Oct 30 22:21:03.037427 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.037393 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx"] Oct 30 22:21:03.040850 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.040807 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.060624 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.060605 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2e5a75ca98\"/\"isvc-canary-promote-v2-predictor-serving-cert\"" Oct 30 22:21:03.064763 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.064738 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx"] Oct 30 22:21:03.084162 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.084143 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.084263 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.084198 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3ef86aa3-b74c-435d-8249-04577360a7f9-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.084311 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.084270 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.084311 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.084302 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ef86aa3-b74c-435d-8249-04577360a7f9-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.084390 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.084326 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxp95\" (UniqueName: \"kubernetes.io/projected/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-api-access-sxp95\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.184972 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.184939 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.185110 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.185078 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3ef86aa3-b74c-435d-8249-04577360a7f9-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.185110 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.185101 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.185193 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.185122 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ef86aa3-b74c-435d-8249-04577360a7f9-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.185193 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.185146 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxp95\" (UniqueName: \"kubernetes.io/projected/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-api-access-sxp95\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.185440 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.185418 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3ef86aa3-b74c-435d-8249-04577360a7f9-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.185599 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.185578 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.185721 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.185704 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.187578 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.187556 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ef86aa3-b74c-435d-8249-04577360a7f9-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.207207 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.207156 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxp95\" (UniqueName: \"kubernetes.io/projected/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-api-access-sxp95\") pod \"isvc-canary-promote-v2-predictor-f9569456-jzvdx\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.357514 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.357477 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:03.548986 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.548908 6162 generic.go:356] "Generic (PLEG): container finished" podID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerID="cf1920dd05f9a5c4ac5e09b4657bce51fd9f78b05556ef771e8568542d1eb9dc" exitCode=0 Oct 30 22:21:03.549127 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.548982 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" event={"ID":"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b","Type":"ContainerDied","Data":"cf1920dd05f9a5c4ac5e09b4657bce51fd9f78b05556ef771e8568542d1eb9dc"} Oct 30 22:21:03.665095 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:03.665064 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx"] Oct 30 22:21:03.668160 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:21:03.668132 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef86aa3_b74c_435d_8249_04577360a7f9.slice/crio-dac72b13bbafc07a31289827d1aaf1b81ee274541024d91a9ef53a67b5677ee0 WatchSource:0}: Error finding container dac72b13bbafc07a31289827d1aaf1b81ee274541024d91a9ef53a67b5677ee0: Status 404 returned error can't find the container with id dac72b13bbafc07a31289827d1aaf1b81ee274541024d91a9ef53a67b5677ee0 Oct 30 22:21:04.555049 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:04.555010 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" event={"ID":"3ef86aa3-b74c-435d-8249-04577360a7f9","Type":"ContainerStarted","Data":"de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77"} Oct 30 22:21:04.555452 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:04.555071 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" event={"ID":"3ef86aa3-b74c-435d-8249-04577360a7f9","Type":"ContainerStarted","Data":"dac72b13bbafc07a31289827d1aaf1b81ee274541024d91a9ef53a67b5677ee0"} Oct 30 22:21:05.224321 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:05.224285 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.32:8643/healthz\": dial tcp 10.133.0.32:8643: connect: connection refused" Oct 30 22:21:05.230611 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:05.230588 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:21:07.568424 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.568394 6162 generic.go:356] "Generic (PLEG): container finished" podID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerID="9ddd568a38c1e548a85aa4a041ace749afcdc3a0dbc2e2d403df9a5f75d30a1f" exitCode=0 Oct 30 22:21:07.568799 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.568469 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" event={"ID":"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b","Type":"ContainerDied","Data":"9ddd568a38c1e548a85aa4a041ace749afcdc3a0dbc2e2d403df9a5f75d30a1f"} Oct 30 22:21:07.591554 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.591528 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:21:07.619880 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.619844 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-rbac-proxy-sar-config\") pod \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " Oct 30 22:21:07.619973 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.619923 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-api-access-84c5t\" (UniqueName: \"kubernetes.io/projected/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-api-access-84c5t\") pod \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " Oct 30 22:21:07.619973 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.619957 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-cabundle-cert\") pod \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " Oct 30 22:21:07.620091 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.620055 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-proxy-tls\") pod \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " Oct 30 22:21:07.620091 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.620084 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kserve-provision-location\") pod \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\" (UID: \"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b\") " Oct 30 22:21:07.620197 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.620139 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-rbac-proxy-sar-config" pod "b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" (UID: "b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:21:07.620333 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.620310 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:21:07.620423 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.620327 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-cabundle-cert" pod "b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" (UID: "b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:21:07.620490 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.620454 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kserve-provision-location" pod "b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" (UID: "b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:21:07.621990 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.621952 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-api-access-84c5t" pod "b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" (UID: "b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b"). InnerVolumeSpecName "kube-api-access-84c5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:21:07.622183 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.622163 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-proxy-tls" pod "b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" (UID: "b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:21:07.721500 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.721476 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:21:07.721500 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.721501 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:21:07.721662 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.721510 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84c5t\" (UniqueName: \"kubernetes.io/projected/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-kube-api-access-84c5t\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:21:07.721662 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:07.721520 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:21:08.573833 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:08.573787 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" Oct 30 22:21:08.573833 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:08.573802 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896" event={"ID":"b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b","Type":"ContainerDied","Data":"e9a70bd46d6b61bbe554b4f413cf91b4bb74660ef91fc7d531f54a5174b5964f"} Oct 30 22:21:08.574369 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:08.573893 6162 scope.go:122] "RemoveContainer" containerID="cf1920dd05f9a5c4ac5e09b4657bce51fd9f78b05556ef771e8568542d1eb9dc" Oct 30 22:21:08.575422 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:08.575399 6162 generic.go:356] "Generic (PLEG): container finished" podID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerID="de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77" exitCode=0 Oct 30 22:21:08.575535 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:08.575472 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" event={"ID":"3ef86aa3-b74c-435d-8249-04577360a7f9","Type":"ContainerDied","Data":"de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77"} Oct 30 22:21:08.586650 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:08.586628 6162 scope.go:122] "RemoveContainer" containerID="9ddd568a38c1e548a85aa4a041ace749afcdc3a0dbc2e2d403df9a5f75d30a1f" Oct 30 22:21:08.594547 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:08.594525 6162 scope.go:122] "RemoveContainer" containerID="fd41e74e1e23f796c02de02520b64b5d9dc900cc4a2ab11060704cf7dc80fe97" Oct 30 22:21:08.685830 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:08.685792 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896"] Oct 30 22:21:08.690555 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:08.690534 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-predictor-7f778847bc-hw896"] Oct 30 22:21:09.582276 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:09.582242 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" event={"ID":"3ef86aa3-b74c-435d-8249-04577360a7f9","Type":"ContainerStarted","Data":"17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823"} Oct 30 22:21:09.582654 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:09.582305 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" event={"ID":"3ef86aa3-b74c-435d-8249-04577360a7f9","Type":"ContainerStarted","Data":"60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2"} Oct 30 22:21:09.582654 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:09.582504 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:09.594113 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:09.594091 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" path="/var/lib/kubelet/pods/b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b/volumes" Oct 30 22:21:09.643567 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:09.643522 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podStartSLOduration=2.715227291 podStartE2EDuration="6.643511058s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.928283767s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:09.642739685 +0000 UTC m=+1582.152611246" watchObservedRunningTime="2026-10-30 22:21:09.643511058 +0000 UTC m=+1582.153382619" Oct 30 22:21:10.586395 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:10.586365 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:10.587604 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:10.587578 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:21:11.589995 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:11.589953 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:21:16.594990 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:16.594959 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:21:16.595468 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:16.595409 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:21:24.095867 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:21:24.095830 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:21:26.595429 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:26.595394 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:21:36.595796 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:36.595756 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:21:46.595999 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:46.595962 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:21:54.095950 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:21:54.095916 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:21:56.595457 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:21:56.595413 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:22:06.595702 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:06.595622 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:22:16.595756 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:16.595715 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:22:24.096585 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:22:24.096549 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:22:26.595989 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:26.595961 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:22:33.559391 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:33.559362 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx"] Oct 30 22:22:33.559779 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:33.559577 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" containerID="cri-o://60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2" gracePeriod=30 Oct 30 22:22:33.559779 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:33.559609 6162 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kube-rbac-proxy" containerID="cri-o://17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823" gracePeriod=30 Oct 30 22:22:33.922992 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:33.922961 6162 generic.go:356] "Generic (PLEG): container finished" podID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerID="17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823" exitCode=0 Oct 30 22:22:33.923179 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:33.923034 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" event={"ID":"3ef86aa3-b74c-435d-8249-04577360a7f9","Type":"ContainerDied","Data":"17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823"} Oct 30 22:22:36.590979 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:36.590932 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 30 22:22:36.596339 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:36.596314 6162 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:22:38.207129 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.207104 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:22:38.318448 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.318386 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-cabundle-cert\") pod \"3ef86aa3-b74c-435d-8249-04577360a7f9\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " Oct 30 22:22:38.318448 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.318434 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-rbac-proxy-sar-config\") pod \"3ef86aa3-b74c-435d-8249-04577360a7f9\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " Oct 30 22:22:38.318626 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.318476 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3ef86aa3-b74c-435d-8249-04577360a7f9-proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ef86aa3-b74c-435d-8249-04577360a7f9-proxy-tls\") pod \"3ef86aa3-b74c-435d-8249-04577360a7f9\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " Oct 30 22:22:38.318626 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.318502 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ef86aa3-b74c-435d-8249-04577360a7f9-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3ef86aa3-b74c-435d-8249-04577360a7f9-kserve-provision-location\") pod \"3ef86aa3-b74c-435d-8249-04577360a7f9\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " Oct 30 22:22:38.318626 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.318544 6162 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-api-access-sxp95\" (UniqueName: \"kubernetes.io/projected/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-api-access-sxp95\") pod \"3ef86aa3-b74c-435d-8249-04577360a7f9\" (UID: \"3ef86aa3-b74c-435d-8249-04577360a7f9\") " Oct 30 22:22:38.318863 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.318803 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-cabundle-cert" pod "3ef86aa3-b74c-435d-8249-04577360a7f9" (UID: "3ef86aa3-b74c-435d-8249-04577360a7f9"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:22:38.318916 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.318860 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef86aa3-b74c-435d-8249-04577360a7f9-kserve-provision-location" pod "3ef86aa3-b74c-435d-8249-04577360a7f9" (UID: "3ef86aa3-b74c-435d-8249-04577360a7f9"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:22:38.318916 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.318869 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-rbac-proxy-sar-config" pod "3ef86aa3-b74c-435d-8249-04577360a7f9" (UID: "3ef86aa3-b74c-435d-8249-04577360a7f9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:22:38.320475 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.320457 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ef86aa3-b74c-435d-8249-04577360a7f9-proxy-tls" pod "3ef86aa3-b74c-435d-8249-04577360a7f9" (UID: "3ef86aa3-b74c-435d-8249-04577360a7f9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:22:38.320585 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.320567 6162 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-api-access-sxp95" pod "3ef86aa3-b74c-435d-8249-04577360a7f9" (UID: "3ef86aa3-b74c-435d-8249-04577360a7f9"). InnerVolumeSpecName "kube-api-access-sxp95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:22:38.419189 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.419166 6162 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:22:38.419189 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.419186 6162 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ef86aa3-b74c-435d-8249-04577360a7f9-proxy-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:22:38.419316 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.419195 6162 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3ef86aa3-b74c-435d-8249-04577360a7f9-kserve-provision-location\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:22:38.419316 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.419204 6162 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxp95\" (UniqueName: \"kubernetes.io/projected/3ef86aa3-b74c-435d-8249-04577360a7f9-kube-api-access-sxp95\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:22:38.419316 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.419213 6162 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3ef86aa3-b74c-435d-8249-04577360a7f9-cabundle-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Oct 30 22:22:38.944074 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.944041 6162 generic.go:356] "Generic (PLEG): container finished" podID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerID="60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2" exitCode=0 Oct 30 22:22:38.944254 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.944099 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" event={"ID":"3ef86aa3-b74c-435d-8249-04577360a7f9","Type":"ContainerDied","Data":"60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2"} Oct 30 22:22:38.944254 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.944106 6162 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" Oct 30 22:22:38.944254 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.944154 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx" event={"ID":"3ef86aa3-b74c-435d-8249-04577360a7f9","Type":"ContainerDied","Data":"dac72b13bbafc07a31289827d1aaf1b81ee274541024d91a9ef53a67b5677ee0"} Oct 30 22:22:38.944254 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.944182 6162 scope.go:122] "RemoveContainer" containerID="17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823" Oct 30 22:22:38.952472 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.952456 6162 scope.go:122] "RemoveContainer" containerID="60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2" Oct 30 22:22:38.959421 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.959401 6162 scope.go:122] "RemoveContainer" containerID="de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77" Oct 30 22:22:38.966014 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.965995 6162 scope.go:122] "RemoveContainer" containerID="17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823" Oct 30 22:22:38.966245 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:22:38.966228 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823\": container with ID starting with 17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823 not found: ID does not exist" containerID="17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823" Oct 30 22:22:38.966298 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.966254 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823"} err="failed to get container status \"17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823\": rpc error: code = NotFound desc = could not find container \"17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823\": container with ID starting with 17bfa0ac693260377bf120155148f4fa8e215d82105c9c063c4117b9549af823 not found: ID does not exist" Oct 30 22:22:38.966298 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.966271 6162 scope.go:122] "RemoveContainer" containerID="60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2" Oct 30 22:22:38.966453 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:22:38.966438 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2\": container with ID starting with 60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2 not found: ID does not exist" containerID="60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2" Oct 30 22:22:38.966493 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.966458 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2"} err="failed to get container status \"60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2\": rpc error: code = NotFound desc = could not find container \"60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2\": container with ID starting with 60ba23f8be92322b8e6801344d9054c59b0c088e29247360769ba0140d21c1b2 not found: ID does not exist" Oct 30 22:22:38.966493 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.966471 6162 scope.go:122] "RemoveContainer" containerID="de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77" Oct 30 22:22:38.966725 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:22:38.966707 6162 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77\": container with ID starting with de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77 not found: ID does not exist" containerID="de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77" Oct 30 22:22:38.966786 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:38.966727 6162 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77"} err="failed to get container status \"de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77\": rpc error: code = NotFound desc = could not find container \"de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77\": container with ID starting with de14a38a6c15b8fbf99c11012f2eb76ad4f6bb5ec9b4728e79938f79ea532a77 not found: ID does not exist" Oct 30 22:22:39.012990 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:39.012965 6162 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx"] Oct 30 22:22:39.025645 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:39.025616 6162 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2e5a75ca98/isvc-canary-promote-v2-predictor-f9569456-jzvdx"] Oct 30 22:22:39.594161 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:22:39.594134 6162 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" path="/var/lib/kubelet/pods/3ef86aa3-b74c-435d-8249-04577360a7f9/volumes" Oct 30 22:22:54.095928 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:22:54.095888 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:23:24.096115 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:23:24.096082 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:23:54.096516 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:23:54.096478 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:24:24.095323 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:24:24.095287 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:24:47.736029 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:24:47.735991 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 22:24:47.742720 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:24:47.742700 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x949s_8cc3c0a2-4c96-4df3-8bdc-f32eb10c2410/ovn-acl-logging/0.log" Oct 30 22:24:54.095263 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:24:54.095230 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:25:24.095395 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:25:24.095358 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:25:54.095537 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:25:54.095498 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:26:15.099923 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:15.099888 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p9l8h_c97dc8b9-40b5-4277-93b5-2c31bad3c352/global-pull-secret-syncer/0.log" Oct 30 22:26:16.162957 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:16.162927 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s5hdv_770590b4-fbb4-4f6d-9187-09ceb5ba873b/konnectivity-agent/0.log" Oct 30 22:26:16.439052 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:16.438957 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-200.ec2.internal_e328aa15a0f90aee4513670f92d54212/haproxy/0.log" Oct 30 22:26:21.258580 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:21.258554 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55aff1da-7717-4b60-af65-6d36e43ec956/alertmanager/0.log" Oct 30 22:26:21.387863 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:21.387833 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55aff1da-7717-4b60-af65-6d36e43ec956/config-reloader/0.log" Oct 30 22:26:21.515306 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:21.515245 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55aff1da-7717-4b60-af65-6d36e43ec956/kube-rbac-proxy-web/0.log" Oct 30 22:26:21.647226 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:21.647201 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55aff1da-7717-4b60-af65-6d36e43ec956/kube-rbac-proxy/0.log" Oct 30 22:26:21.779745 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:21.779655 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55aff1da-7717-4b60-af65-6d36e43ec956/kube-rbac-proxy-metric/0.log" Oct 30 22:26:21.912608 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:21.912583 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55aff1da-7717-4b60-af65-6d36e43ec956/prom-label-proxy/0.log" Oct 30 22:26:22.043047 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:22.042950 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_55aff1da-7717-4b60-af65-6d36e43ec956/init-config-reloader/0.log" Oct 30 22:26:22.691736 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:22.691685 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86bf5f57db-g2647_8883c3b4-99a3-4933-942c-e8e7fc999348/metrics-server/0.log" Oct 30 22:26:22.950000 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:22.949916 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8b4rc_87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/node-exporter/0.log" Oct 30 22:26:23.080468 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:23.080442 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8b4rc_87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/kube-rbac-proxy/0.log" Oct 30 22:26:23.213068 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:23.212994 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8b4rc_87fb0a2b-cee5-4133-b84f-b7c9b22f6aa1/init-textfile/0.log" Oct 30 22:26:24.096134 ip-10-0-135-200 kubenswrapper[6162]: E1030 22:26:24.096100 6162 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ttjm8" containerName="extractor" Oct 30 22:26:24.203632 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.203597 6162 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c"] Oct 30 22:26:24.203932 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.203919 6162 cpu_manager.go:414] "containerMap: removing container" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="storage-initializer" Oct 30 22:26:24.203986 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.203936 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="storage-initializer" Oct 30 22:26:24.203986 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.203958 6162 cpu_manager.go:414] "containerMap: removing container" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kube-rbac-proxy" Oct 30 22:26:24.203986 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.203964 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kube-rbac-proxy" Oct 30 22:26:24.203986 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.203971 6162 cpu_manager.go:414] "containerMap: removing container" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kube-rbac-proxy" Oct 30 22:26:24.203986 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.203977 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kube-rbac-proxy" Oct 30 22:26:24.203986 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.203986 6162 cpu_manager.go:414] "containerMap: removing container" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" Oct 30 22:26:24.204173 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.203991 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" Oct 30 22:26:24.204173 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.204007 6162 cpu_manager.go:414] "containerMap: removing container" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="storage-initializer" Oct 30 22:26:24.204173 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.204012 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="storage-initializer" Oct 30 22:26:24.204173 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.204022 6162 cpu_manager.go:414] "containerMap: removing container" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" Oct 30 22:26:24.204173 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.204030 6162 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" Oct 30 22:26:24.204173 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.204072 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kserve-container" Oct 30 22:26:24.204173 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.204081 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kube-rbac-proxy" Oct 30 22:26:24.204173 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.204087 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ef86aa3-b74c-435d-8249-04577360a7f9" containerName="kube-rbac-proxy" Oct 30 22:26:24.204173 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.204094 6162 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1f7fd86-2cb1-4d16-9d5f-aaef52c5fd8b" containerName="kserve-container" Oct 30 22:26:24.207084 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.207066 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.227972 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.227947 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c"] Oct 30 22:26:24.280187 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.280154 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-proc\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.280187 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.280188 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-sys\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.280477 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.280209 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-podres\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.280477 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.280324 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qtmc\" (UniqueName: \"kubernetes.io/projected/a8843833-271d-4685-85d9-b56d9ccee21d-kube-api-access-4qtmc\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.280477 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.280365 6162 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-lib-modules\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.310021 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.309994 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rsvfp\"/\"openshift-service-ca.crt\"" Oct 30 22:26:24.310021 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.310012 6162 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rsvfp\"/\"kube-root-ca.crt\"" Oct 30 22:26:24.310229 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.310213 6162 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rsvfp\"/\"default-dockercfg-8wgdx\"" Oct 30 22:26:24.381090 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.381068 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-proc\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.381244 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.381097 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-sys\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.381244 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.381118 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-podres\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.381244 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.381151 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qtmc\" (UniqueName: \"kubernetes.io/projected/a8843833-271d-4685-85d9-b56d9ccee21d-kube-api-access-4qtmc\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.381244 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.381187 6162 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-lib-modules\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.381244 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.381201 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-sys\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.381244 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.381215 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-podres\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.381244 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.381201 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-proc\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.381461 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.381268 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8843833-271d-4685-85d9-b56d9ccee21d-lib-modules\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.402186 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.402158 6162 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qtmc\" (UniqueName: \"kubernetes.io/projected/a8843833-271d-4685-85d9-b56d9ccee21d-kube-api-access-4qtmc\") pod \"perf-node-gather-daemonset-92j2c\" (UID: \"a8843833-271d-4685-85d9-b56d9ccee21d\") " pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.519428 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.519392 6162 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:24.811402 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:24.811331 6162 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c"] Oct 30 22:26:24.814623 ip-10-0-135-200 kubenswrapper[6162]: W1030 22:26:24.814600 6162 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda8843833_271d_4685_85d9_b56d9ccee21d.slice/crio-3f4ba38e2e3f35d9f2b175670a513f5620d743dfbafe9ce0876e28e80f2a8698 WatchSource:0}: Error finding container 3f4ba38e2e3f35d9f2b175670a513f5620d743dfbafe9ce0876e28e80f2a8698: Status 404 returned error can't find the container with id 3f4ba38e2e3f35d9f2b175670a513f5620d743dfbafe9ce0876e28e80f2a8698 Oct 30 22:26:25.772061 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:25.772036 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f49cd584c-q44h7_0d137e6f-4945-4476-8d93-feb093738387/telemeter-client/0.log" Oct 30 22:26:25.788247 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:25.788223 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" event={"ID":"a8843833-271d-4685-85d9-b56d9ccee21d","Type":"ContainerStarted","Data":"c993a22f05206cd98f2f2a547c909846c248ca77f312b1e13f41c3eda864aa45"} Oct 30 22:26:25.788372 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:25.788262 6162 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" event={"ID":"a8843833-271d-4685-85d9-b56d9ccee21d","Type":"ContainerStarted","Data":"3f4ba38e2e3f35d9f2b175670a513f5620d743dfbafe9ce0876e28e80f2a8698"} Oct 30 22:26:25.788372 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:25.788329 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:25.903157 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:25.903117 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f49cd584c-q44h7_0d137e6f-4945-4476-8d93-feb093738387/reload/0.log" Oct 30 22:26:26.032754 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:26.032684 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f49cd584c-q44h7_0d137e6f-4945-4476-8d93-feb093738387/kube-rbac-proxy/0.log" Oct 30 22:26:31.801732 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:31.801654 6162 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" Oct 30 22:26:31.843387 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:31.843338 6162 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-rsvfp/perf-node-gather-daemonset-92j2c" podStartSLOduration=7.843326643 podStartE2EDuration="7.843326643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:26:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:26:25.835395843 +0000 UTC m=+1898.345267404" watchObservedRunningTime="2026-10-30 22:26:31.843326643 +0000 UTC m=+1904.353198202" Oct 30 22:26:33.692908 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:33.692885 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2mffv_70a9e9bc-0057-4e34-9bf2-396832ce4e76/dns/0.log" Oct 30 22:26:33.820097 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:33.820066 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2mffv_70a9e9bc-0057-4e34-9bf2-396832ce4e76/kube-rbac-proxy/0.log" Oct 30 22:26:34.466647 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:34.466616 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ksczz_d0eae92f-5b3d-408a-9049-39e00d341085/dns-node-resolver/0.log" Oct 30 22:26:36.048600 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:36.048571 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5gsg6_f49231a6-2242-467f-85c2-c526cafef9cb/node-ca/0.log" Oct 30 22:26:39.269784 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:39.269751 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-89856_2801dd83-9869-447f-8e3f-6e70d12b7d21/serve-healthcheck-canary/0.log" Oct 30 22:26:41.236714 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:41.236683 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttjm8_7d07c193-84b5-44e2-bf42-fb645c2f0f35/kube-rbac-proxy/0.log" Oct 30 22:26:41.363102 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:41.363071 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttjm8_7d07c193-84b5-44e2-bf42-fb645c2f0f35/exporter/0.log" Oct 30 22:26:41.491602 ip-10-0-135-200 kubenswrapper[6162]: I1030 22:26:41.491529 6162 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttjm8_7d07c193-84b5-44e2-bf42-fb645c2f0f35/extractor/0.log"