Sep 10 12:06:00.051816 ip-10-0-128-140 systemd[1]: Starting Kubernetes Kubelet... Sep 10 12:06:00.437885 ip-10-0-128-140 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:06:00.437885 ip-10-0-128-140 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 12:06:00.437885 ip-10-0-128-140 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:06:00.437885 ip-10-0-128-140 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 12:06:00.437885 ip-10-0-128-140 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:06:00.439320 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.439240 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 12:06:00.444938 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444923 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:06:00.444938 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444938 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444942 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444945 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444948 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444952 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444956 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444959 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444962 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444967 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444971 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444975 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444978 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444982 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444985 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444988 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444991 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444993 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444996 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.444999 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:06:00.445006 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445001 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445004 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445007 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445010 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445013 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445015 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445018 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445021 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445024 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445027 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445029 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445032 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445035 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445037 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445040 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445043 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445046 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445048 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445051 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445053 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:06:00.445460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445056 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445058 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445061 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445063 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445066 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445068 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445072 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445074 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445077 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445081 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445084 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445087 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445089 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445092 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445096 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445098 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445101 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445104 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445107 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445109 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:06:00.446149 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445112 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445114 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445117 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445120 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445122 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445125 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445128 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445133 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445137 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445140 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445143 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445145 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445148 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445151 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445154 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445156 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445159 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445161 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445164 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:06:00.446754 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445167 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445169 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445173 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445177 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445179 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445182 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445186 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445189 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445192 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445194 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445197 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445200 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445202 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445205 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445208 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445210 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445213 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445216 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445218 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:06:00.447213 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.445221 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447407 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447418 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447422 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447425 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447430 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447434 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447438 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447441 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447444 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447447 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447450 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447453 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447456 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447459 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447462 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447465 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447468 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447473 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:06:00.447684 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447477 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447481 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447484 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447487 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447490 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447492 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447495 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447497 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447500 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447503 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447505 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447508 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447510 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447513 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447516 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447519 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447522 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447524 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447527 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447530 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:06:00.448191 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447533 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447536 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447539 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447541 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447544 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447546 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447549 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447551 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447554 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447556 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447579 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447592 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447596 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447599 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447602 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447604 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447607 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447610 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447613 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447616 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:06:00.448697 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447619 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447621 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447624 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447626 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447629 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447632 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447635 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447638 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447641 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447644 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447647 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447650 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447653 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447655 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447658 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447661 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447664 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447667 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447670 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:06:00.449211 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447672 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447675 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447680 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447682 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447685 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447688 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447691 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447694 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447697 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447699 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447702 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447704 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447707 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447710 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447712 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447715 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447717 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447720 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447722 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447725 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:06:00.449694 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447728 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.447730 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448081 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448093 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448097 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448099 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448102 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448105 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448107 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448110 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448112 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448116 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448121 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448124 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448129 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448132 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448135 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448138 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448142 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:06:00.450186 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448145 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448147 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448150 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448152 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448155 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448158 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448161 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448163 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448166 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448169 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448172 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448176 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448179 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448182 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448185 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448187 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448190 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448193 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448196 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448199 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:06:00.450661 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448202 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448204 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448207 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448209 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448212 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448214 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448217 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448221 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448224 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448226 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448229 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448231 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448235 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448238 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448240 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448243 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448246 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448249 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448251 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448254 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:06:00.451151 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448256 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448259 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448261 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448264 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448267 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448270 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448272 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448275 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448278 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448280 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448283 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448285 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448288 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448290 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448294 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448296 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448299 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448301 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448304 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448307 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:06:00.451665 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448310 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448312 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448315 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448317 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448320 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448323 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448325 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448328 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448330 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448333 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448336 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448338 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448341 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448343 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448345 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448348 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448350 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448354 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448356 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448359 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:06:00.452170 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448361 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.448364 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448436 2555 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448470 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448477 2555 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448481 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448485 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448488 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448492 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448496 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448499 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448502 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448506 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448509 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448512 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448515 2555 flags.go:64] FLAG: --cgroup-root="" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448517 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448520 2555 flags.go:64] FLAG: --client-ca-file="" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448524 2555 flags.go:64] FLAG: --cloud-provider="external" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448526 2555 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448530 2555 flags.go:64] FLAG: --cluster-domain="" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448533 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448536 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448539 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 12:06:00.452662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448542 2555 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448546 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448548 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448551 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448555 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448573 2555 flags.go:64] FLAG: --contention-profiling="false" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448578 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448582 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448585 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448588 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448592 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448595 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448598 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448601 2555 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448604 2555 flags.go:64] FLAG: --enable-server="true" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448607 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448612 2555 flags.go:64] FLAG: --event-burst="100" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448615 2555 flags.go:64] FLAG: --event-qps="50" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448620 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448623 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448626 2555 flags.go:64] FLAG: --eviction-hard="" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448630 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448633 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448636 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448639 2555 flags.go:64] FLAG: --eviction-soft="" Sep 10 12:06:00.453280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448642 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448645 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448649 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448652 2555 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448655 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448658 2555 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448661 2555 flags.go:64] FLAG: --feature-gates="" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448665 2555 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448668 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448671 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448674 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448677 2555 flags.go:64] FLAG: --healthz-port="10248" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448680 2555 flags.go:64] FLAG: --help="false" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448683 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448686 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448689 2555 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448692 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448695 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448699 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448702 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448706 2555 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448709 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448712 2555 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 12:06:00.453914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448715 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448718 2555 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448723 2555 flags.go:64] FLAG: --kube-reserved="" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448726 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448729 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448732 2555 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448735 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448738 2555 flags.go:64] FLAG: --lock-file="" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448741 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448744 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448747 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448753 2555 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448756 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448759 2555 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448762 2555 flags.go:64] FLAG: --logging-format="text" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448765 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448768 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448771 2555 flags.go:64] FLAG: --manifest-url="" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448774 2555 flags.go:64] FLAG: --manifest-url-header="" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448778 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448781 2555 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448785 2555 flags.go:64] FLAG: --max-pods="110" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448788 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448791 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448794 2555 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 12:06:00.454507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448797 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448800 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448802 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448805 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448812 2555 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448815 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448818 2555 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448821 2555 flags.go:64] FLAG: --pod-cidr="" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448824 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448831 2555 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448834 2555 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448837 2555 flags.go:64] FLAG: --pods-per-core="0" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448840 2555 flags.go:64] FLAG: --port="10250" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448843 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448846 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c9b1506a58f08635" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448849 2555 flags.go:64] FLAG: --qos-reserved="" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448852 2555 flags.go:64] FLAG: --read-only-port="10255" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448855 2555 flags.go:64] FLAG: --register-node="true" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448858 2555 flags.go:64] FLAG: --register-with-taints="" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448861 2555 flags.go:64] FLAG: --registry-burst="10" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448865 2555 flags.go:64] FLAG: --registry-qps="5" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448867 2555 flags.go:64] FLAG: --reserved-cpus="" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448870 2555 flags.go:64] FLAG: --reserved-memory="" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448874 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448877 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 12:06:00.455205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448880 2555 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448883 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448885 2555 flags.go:64] FLAG: --runonce="false" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448888 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448893 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448896 2555 flags.go:64] FLAG: --seccomp-default="false" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448899 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448902 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448905 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448908 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448911 2555 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448914 2555 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448916 2555 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448919 2555 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448922 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448925 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448929 2555 flags.go:64] FLAG: --system-cgroups="" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448932 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448938 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448941 2555 flags.go:64] FLAG: --tls-cert-file="" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448943 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448947 2555 flags.go:64] FLAG: --tls-min-version="" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448950 2555 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448953 2555 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448956 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 12:06:00.455873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448959 2555 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448962 2555 flags.go:64] FLAG: --v="2" Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448966 2555 flags.go:64] FLAG: --version="false" Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448970 2555 flags.go:64] FLAG: --vmodule="" Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448979 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.448982 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449094 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449098 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449101 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449104 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449106 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449110 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449113 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449116 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449118 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449121 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449124 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449126 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449129 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449131 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449134 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:06:00.456517 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449137 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449140 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449143 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449146 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449148 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449151 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449154 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449156 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449159 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449162 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449164 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449167 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449170 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449172 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449175 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449178 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449180 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449183 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449186 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449188 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:06:00.457055 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449190 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449193 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449197 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449199 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449202 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449205 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449207 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449210 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449212 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449215 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449218 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449220 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449223 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449226 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449230 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449233 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449236 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449239 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449241 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449244 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:06:00.457541 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449246 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449249 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449252 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449254 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449257 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449259 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449262 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449264 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449267 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449270 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449272 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449275 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449277 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449280 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449284 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449287 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449290 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449292 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449295 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449297 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:06:00.458063 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449300 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449304 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449308 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449311 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449314 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449317 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449321 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449325 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449329 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449332 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449335 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449338 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449340 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449343 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449348 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449351 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449354 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449356 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:06:00.458550 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449359 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:06:00.458997 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449362 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:06:00.458997 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449365 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:06:00.458997 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449368 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:06:00.458997 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449371 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:06:00.458997 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.449373 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:06:00.458997 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.450074 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:06:00.458997 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.457055 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 12:06:00.458997 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.457070 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 12:06:00.459304 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.459293 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 12:06:00.459332 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.459304 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 12:06:00.459373 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459365 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459374 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459378 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459381 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459384 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459387 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459391 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459394 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459397 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459400 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459403 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:06:00.459401 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459406 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459410 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459413 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459416 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459419 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459421 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459424 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459427 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459429 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459432 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459435 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459439 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459442 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459445 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459447 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459450 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459453 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459455 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459459 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459461 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:06:00.459701 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459464 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459466 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459469 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459472 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459475 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459477 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459480 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459483 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459486 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459488 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459491 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459494 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459496 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459499 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459502 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459505 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459508 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459511 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459514 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459516 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:06:00.460228 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459519 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459523 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459526 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459529 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459532 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459535 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459538 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459540 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459543 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459546 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459548 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459551 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459554 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459570 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459574 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459577 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459579 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459582 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459585 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:06:00.460736 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459587 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459590 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459593 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459595 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459598 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459601 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459604 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459607 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459610 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459613 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459616 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459618 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459621 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459623 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459626 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459629 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459631 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459634 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459637 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459639 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:06:00.461194 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459642 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459645 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459647 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459650 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459653 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459656 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459658 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459661 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459663 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.459668 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459780 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459785 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459789 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459792 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:06:00.461704 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459795 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459798 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459801 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459805 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459809 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459812 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459815 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459818 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459821 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459824 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459826 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459830 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459832 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459835 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459838 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459840 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459843 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459846 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459848 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:06:00.462037 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459851 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459853 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459856 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459859 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459861 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459864 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459867 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459870 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459872 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459875 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459877 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459880 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459882 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459885 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459887 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459890 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459892 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459895 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459898 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459901 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:06:00.462513 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459903 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459906 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459909 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459911 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459914 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459917 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459919 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459922 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459925 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459927 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459931 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459934 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459937 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459941 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459944 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459946 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459949 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459952 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459955 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:06:00.463015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459957 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459960 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459963 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459965 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459968 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459971 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459973 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459975 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459978 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459980 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459983 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459986 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459989 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459991 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459994 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459997 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.459999 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460002 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460004 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460007 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:06:00.463478 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460010 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460012 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460015 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460017 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460020 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460022 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460025 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460027 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460030 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460033 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460035 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460038 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460041 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460043 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460046 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460048 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:06:00.464110 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:00.460051 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:06:00.464493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.460055 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:06:00.464493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.460160 2555 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 12:06:00.464493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.462167 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 12:06:00.464493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.463070 2555 server.go:1019] "Starting client certificate rotation" Sep 10 12:06:00.464493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.463174 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:06:00.464493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.463213 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:06:00.465340 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.465327 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:06:00.466619 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.466597 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:06:00.477210 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.477192 2555 log.go:25] "Validated CRI v1 runtime API" Sep 10 12:06:00.480042 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.480025 2555 log.go:25] "Validated CRI v1 image API" Sep 10 12:06:00.480889 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.480874 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 12:06:00.485017 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.484997 2555 fs.go:135] Filesystem UUIDs: map[0252c2cc-d1ef-46c3-88e2-357e286bf03d:/dev/nvme0n1p4 6025d1c4-262b-472d-ba1a-4ff4e10116e5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 10 12:06:00.485082 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.485015 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 12:06:00.489875 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.489772 2555 manager.go:216] Machine: {Timestamp:2026-09-10 12:06:00.488490195 +0000 UTC m=+0.324472772 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101252 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ad43f232102a86f547750ecb5e52 SystemUUID:ec28ad43-f232-102a-86f5-47750ecb5e52 BootID:b2486022-be0f-4cb8-bf6c-1eed82fe2b5a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:41:fe:c7:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:41:fe:c7:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:48:49:d6:03:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 12:06:00.489875 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.489874 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 12:06:00.489994 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.489970 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 12:06:00.492762 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.492736 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 12:06:00.492895 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.492764 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-140.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 12:06:00.493427 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.493418 2555 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 12:06:00.493462 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.493430 2555 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 12:06:00.493462 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.493437 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:06:00.494237 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.494225 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:06:00.495665 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.495655 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 12:06:00.499639 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.499624 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:06:00.499922 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.499910 2555 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:06:00.500034 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.500025 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 12:06:00.500118 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.500055 2555 kubelet.go:486] "Attempting to sync node with API server" Sep 10 12:06:00.500118 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.500070 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 12:06:00.500118 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.500092 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 12:06:00.500118 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.500102 2555 kubelet.go:398] "Adding apiserver pod source" Sep 10 12:06:00.500118 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.500110 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 12:06:00.500462 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.500449 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:06:00.500512 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.500468 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:06:00.502326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.502308 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 12:06:00.504476 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.504463 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 12:06:00.504536 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.504492 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 12:06:00.504653 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.504643 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 12:06:00.504689 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.504657 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 12:06:00.504689 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.504664 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 12:06:00.504689 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.504669 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 12:06:00.504689 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.504689 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 12:06:00.504831 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.504695 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 12:06:00.505107 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.505098 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 12:06:00.505107 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.505106 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 12:06:00.505160 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.505112 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 12:06:00.505160 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.505118 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 12:06:00.505160 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.505130 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 12:06:00.505160 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.505138 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 12:06:00.505857 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.505847 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 12:06:00.505857 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.505857 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 12:06:00.509462 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.509448 2555 server.go:1268] "Started kubelet" Sep 10 12:06:00.509724 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.509695 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 12:06:00.509833 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.509705 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 12:06:00.509833 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.509781 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 12:06:00.510202 ip-10-0-128-140 systemd[1]: Started Kubernetes Kubelet. Sep 10 12:06:00.511175 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.510964 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 12:06:00.515311 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.515286 2555 server.go:310] "Adding debug handlers to kubelet server" Sep 10 12:06:00.515677 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.515644 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 12:06:00.516531 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.516345 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-140.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 12:06:00.516745 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.516665 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 12:06:00.517923 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.517900 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 12:06:00.519170 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.519155 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 12:06:00.519244 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.519169 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 12:06:00.519244 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.519227 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:00.519644 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.518743 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-140.ec2.internal.18d3f42f306ebc47 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-140.ec2.internal,UID:ip-10-0-128-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-140.ec2.internal,},FirstTimestamp:2026-09-10 12:06:00.509422663 +0000 UTC m=+0.345405240,LastTimestamp:2026-09-10 12:06:00.509422663 +0000 UTC m=+0.345405240,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-140.ec2.internal,}" Sep 10 12:06:00.519789 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.519774 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 12:06:00.519878 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.519788 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 12:06:00.519950 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.519879 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 12:06:00.519988 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.519963 2555 reconstruct.go:97] "Volume reconstruction finished" Sep 10 12:06:00.519988 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.519971 2555 reconciler.go:29] "Reconciler: start to sync state" Sep 10 12:06:00.520100 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.520075 2555 factory.go:55] Registering systemd factory Sep 10 12:06:00.520161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.520126 2555 factory.go:223] Registration of the systemd container factory successfully Sep 10 12:06:00.520302 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.520288 2555 factory.go:153] Registering CRI-O factory Sep 10 12:06:00.520352 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.520307 2555 factory.go:223] Registration of the crio container factory successfully Sep 10 12:06:00.520398 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.520354 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 12:06:00.520398 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.520370 2555 factory.go:103] Registering Raw factory Sep 10 12:06:00.520398 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.520384 2555 manager.go:1196] Started watching for new ooms in manager Sep 10 12:06:00.521401 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.521384 2555 manager.go:349] Starting recovery of all containers Sep 10 12:06:00.531632 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.531613 2555 manager.go:354] Recovery completed Sep 10 12:06:00.533057 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.533027 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 12:06:00.533132 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.533086 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 12:06:00.537508 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.537495 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:06:00.539513 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.539496 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:06:00.539610 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.539527 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:06:00.539610 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.539540 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:06:00.540226 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.540212 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 12:06:00.540226 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.540220 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:06:00.540226 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.540226 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 12:06:00.540401 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.540243 2555 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:06:00.540874 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.540856 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:06:00.540934 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.540887 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:06:00.540934 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.540900 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:06:00.549409 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.549343 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-140.ec2.internal.18d3f42f3239dd28 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-140.ec2.internal,UID:ip-10-0-128-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-140.ec2.internal,},FirstTimestamp:2026-09-10 12:06:00.539512104 +0000 UTC m=+0.375494681,LastTimestamp:2026-09-10 12:06:00.539512104 +0000 UTC m=+0.375494681,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-140.ec2.internal,}" Sep 10 12:06:00.552544 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.552486 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-140.ec2.internal.18d3f42f323a332a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-140.ec2.internal,UID:ip-10-0-128-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-140.ec2.internal,},FirstTimestamp:2026-09-10 12:06:00.539534122 +0000 UTC m=+0.375516699,LastTimestamp:2026-09-10 12:06:00.539534122 +0000 UTC m=+0.375516699,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-140.ec2.internal,}" Sep 10 12:06:00.559363 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.559307 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-140.ec2.internal.18d3f42f323a5bb5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-140.ec2.internal,UID:ip-10-0-128-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-140.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-140.ec2.internal,},FirstTimestamp:2026-09-10 12:06:00.539544501 +0000 UTC m=+0.375527079,LastTimestamp:2026-09-10 12:06:00.539544501 +0000 UTC m=+0.375527079,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-140.ec2.internal,}" Sep 10 12:06:00.569546 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.569485 2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-140.ec2.internal.18d3f42f3239dd28\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-140.ec2.internal.18d3f42f3239dd28 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-140.ec2.internal,UID:ip-10-0-128-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-140.ec2.internal,},FirstTimestamp:2026-09-10 12:06:00.539512104 +0000 UTC m=+0.375494681,LastTimestamp:2026-09-10 12:06:00.540871919 +0000 UTC m=+0.376854497,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-140.ec2.internal,}" Sep 10 12:06:00.682613 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.571716 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x6g9p" Sep 10 12:06:00.682613 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.577979 2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-140.ec2.internal.18d3f42f323a332a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-140.ec2.internal.18d3f42f323a332a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-140.ec2.internal,UID:ip-10-0-128-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-140.ec2.internal,},FirstTimestamp:2026-09-10 12:06:00.539534122 +0000 UTC m=+0.375516699,LastTimestamp:2026-09-10 12:06:00.540893631 +0000 UTC m=+0.376876208,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-140.ec2.internal,}" Sep 10 12:06:00.682613 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.584890 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x6g9p" Sep 10 12:06:00.682613 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.587378 2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-140.ec2.internal.18d3f42f323a5bb5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-140.ec2.internal.18d3f42f323a5bb5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-140.ec2.internal,UID:ip-10-0-128-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-140.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-140.ec2.internal,},FirstTimestamp:2026-09-10 12:06:00.539544501 +0000 UTC m=+0.375527079,LastTimestamp:2026-09-10 12:06:00.540903507 +0000 UTC m=+0.376886084,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-140.ec2.internal,}" Sep 10 12:06:00.682613 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.619330 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:00.682613 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.682095 2555 policy_none.go:49] "None policy: Start" Sep 10 12:06:00.682613 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.682131 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 12:06:00.682613 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.682144 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 12:06:00.683430 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.683414 2555 policy_none.go:47] "Start" Sep 10 12:06:00.718135 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.718120 2555 manager.go:337] "Starting Device Plugin manager" Sep 10 12:06:00.718232 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.718156 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 12:06:00.718232 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.718166 2555 server.go:87] "Starting device plugin registration server" Sep 10 12:06:00.718451 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.718439 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 12:06:00.718511 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.718454 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 12:06:00.718579 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.718533 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 12:06:00.718635 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.718627 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 12:06:00.718683 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.718637 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 12:06:00.719235 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.719212 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 12:06:00.719306 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.719272 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:00.749734 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.749715 2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-140.ec2.internal\" not found" node="ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.760176 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.760149 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 12:06:00.761276 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.761257 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 12:06:00.761341 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.761302 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 12:06:00.761341 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.761325 2555 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 12:06:00.761433 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.761407 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 12:06:00.766242 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.766220 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:06:00.819621 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.819604 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:06:00.820391 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.820377 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:06:00.820466 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.820407 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:06:00.820466 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.820451 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:06:00.820584 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.820481 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.830720 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.830702 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.830807 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.830724 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-140.ec2.internal\": node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:00.861726 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.861705 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal"] Sep 10 12:06:00.861813 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.861776 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:06:00.862509 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.862495 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:06:00.862575 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.862522 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:06:00.862575 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.862534 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:06:00.863858 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.863847 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:06:00.864006 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.863993 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.864040 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.864022 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:06:00.864501 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.864486 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:06:00.864540 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.864508 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:06:00.864540 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.864519 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:06:00.864540 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.864527 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:06:00.864684 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.864547 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:06:00.864684 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.864556 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:06:00.865876 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.865863 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.865924 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.865884 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:06:00.866515 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.866499 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:06:00.866610 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.866524 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:06:00.866610 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.866534 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:06:00.874905 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.874888 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:00.881070 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.881053 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-140.ec2.internal\" not found" node="ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.885117 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.885103 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-140.ec2.internal\" not found" node="ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.921330 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.921314 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6df7a7611388ae31505ad66be2dace6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-140.ec2.internal\" (UID: \"b6df7a7611388ae31505ad66be2dace6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.921408 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.921338 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f5f458828324eb4edf2c91aefaa68b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal\" (UID: \"6f5f458828324eb4edf2c91aefaa68b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.921408 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:00.921356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f5f458828324eb4edf2c91aefaa68b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal\" (UID: \"6f5f458828324eb4edf2c91aefaa68b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" Sep 10 12:06:00.975189 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:00.975143 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:01.021642 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.021628 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f5f458828324eb4edf2c91aefaa68b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal\" (UID: \"6f5f458828324eb4edf2c91aefaa68b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" Sep 10 12:06:01.021709 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.021651 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f5f458828324eb4edf2c91aefaa68b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal\" (UID: \"6f5f458828324eb4edf2c91aefaa68b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" Sep 10 12:06:01.021709 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.021673 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6df7a7611388ae31505ad66be2dace6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-140.ec2.internal\" (UID: \"b6df7a7611388ae31505ad66be2dace6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal" Sep 10 12:06:01.021771 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.021709 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6df7a7611388ae31505ad66be2dace6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-140.ec2.internal\" (UID: \"b6df7a7611388ae31505ad66be2dace6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal" Sep 10 12:06:01.021771 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.021733 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f5f458828324eb4edf2c91aefaa68b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal\" (UID: \"6f5f458828324eb4edf2c91aefaa68b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" Sep 10 12:06:01.021771 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.021733 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f5f458828324eb4edf2c91aefaa68b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal\" (UID: \"6f5f458828324eb4edf2c91aefaa68b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" Sep 10 12:06:01.075829 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:01.075802 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:01.176263 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:01.176236 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:01.184391 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.184377 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" Sep 10 12:06:01.189203 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.189188 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal" Sep 10 12:06:01.277499 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:01.277290 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:01.340146 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.340122 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:06:01.380099 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:01.380076 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:01.464743 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.464710 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 12:06:01.465407 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.464862 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:06:01.465407 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.464876 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:06:01.480705 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:01.480683 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:01.483942 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.483927 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:06:01.580834 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:01.580743 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:01.666008 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.665967 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:06:01.667192 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.667171 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:06:01.667303 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.667208 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:06:01.667303 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.667224 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:06:01.680822 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:01.680796 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:01.682956 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.682926 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 12:01:01 +0000 UTC" deadline="2028-03-28 14:28:37.939415043 +0000 UTC" Sep 10 12:06:01.683011 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.682958 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13562h22m36.256461613s" Sep 10 12:06:01.782006 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:01.781979 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-140.ec2.internal\" not found" Sep 10 12:06:01.826426 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.826402 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:06:01.920375 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.920286 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" Sep 10 12:06:01.937708 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.937685 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:06:01.938706 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.938691 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal" Sep 10 12:06:01.949878 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:01.949860 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:06:02.086111 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.086081 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5f458828324eb4edf2c91aefaa68b9.slice/crio-5d109f1895f331c5a57e2ff2c17d4c4d2c4f7bf09c08b01cfa18b6c87c432e90 WatchSource:0}: Error finding container 5d109f1895f331c5a57e2ff2c17d4c4d2c4f7bf09c08b01cfa18b6c87c432e90: Status 404 returned error can't find the container with id 5d109f1895f331c5a57e2ff2c17d4c4d2c4f7bf09c08b01cfa18b6c87c432e90 Sep 10 12:06:02.086394 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.086373 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6df7a7611388ae31505ad66be2dace6.slice/crio-8ee4224923dbc79e727b92a3e2b41bbf1aba169843a4ec09b466f9c08d423bbc WatchSource:0}: Error finding container 8ee4224923dbc79e727b92a3e2b41bbf1aba169843a4ec09b466f9c08d423bbc: Status 404 returned error can't find the container with id 8ee4224923dbc79e727b92a3e2b41bbf1aba169843a4ec09b466f9c08d423bbc Sep 10 12:06:02.091459 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.091434 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:06:02.502749 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.502723 2555 apiserver.go:52] "Watching apiserver" Sep 10 12:06:02.507393 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.507374 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:06:02.513375 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.513346 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 12:06:02.514904 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.514374 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-xr9ms","openshift-dns/node-resolver-8c75j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal","openshift-multus/multus-additional-cni-plugins-whvn7","openshift-network-operator/iptables-alerter-4mm2q","openshift-ovn-kubernetes/ovnkube-node-sjvhr","kube-system/global-pull-secret-syncer-bj8j2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv","openshift-image-registry/node-ca-sqwkr","openshift-multus/multus-znrvr","openshift-multus/network-metrics-daemon-mnkdw","openshift-network-diagnostics/network-check-target-dznv6","kube-system/konnectivity-agent-9tms9","kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal"] Sep 10 12:06:02.516929 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.516901 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.518269 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.518248 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:02.519418 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.519398 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 12:06:02.519573 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.519554 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:02.519701 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.519660 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:02.521019 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.520999 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.522112 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.522093 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.523283 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.523264 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.524045 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.524027 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 12:06:02.524130 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.524079 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 12:06:02.524130 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.524093 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 12:06:02.524231 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.524215 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 12:06:02.524631 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.524618 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.526123 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.526107 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:02.526212 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.526195 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:02.527430 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.527414 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hp4tw\"" Sep 10 12:06:02.527654 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.527630 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.528958 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.528941 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.530119 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-cnibin\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530213 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530132 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-cni-dir\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530213 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530148 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:02.530213 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-run-netns\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530213 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530187 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-var-lib-cni-multus\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530217 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-daemon-config\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.530224 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530241 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-cnibin\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530260 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-system-cni-dir\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530282 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-run-k8s-cni-cncf-io\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530298 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-system-cni-dir\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530314 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-socket-dir-parent\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530334 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-hostroot\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fccf390a-2f70-4c11-81a7-d0c709132636-konnectivity-ca\") pod \"konnectivity-agent-9tms9\" (UID: \"fccf390a-2f70-4c11-81a7-d0c709132636\") " pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-cni-binary-copy\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530400 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.530423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530416 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79f46949-17e0-4192-8a73-c0a0aaee0f07-cni-binary-copy\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530466 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-var-lib-kubelet\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530484 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fccf390a-2f70-4c11-81a7-d0c709132636-agent-certs\") pod \"konnectivity-agent-9tms9\" (UID: \"fccf390a-2f70-4c11-81a7-d0c709132636\") " pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4w47\" (UniqueName: \"kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47\") pod \"network-check-target-dznv6\" (UID: \"2155a7db-7555-4c34-9898-82c3de1c8ad7\") " pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530529 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530551 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-conf-dir\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530567 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-etc-kubernetes\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530590 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp4qr\" (UniqueName: \"kubernetes.io/projected/79f46949-17e0-4192-8a73-c0a0aaee0f07-kube-api-access-sp4qr\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztwkw\" (UniqueName: \"kubernetes.io/projected/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-kube-api-access-ztwkw\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530654 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-var-lib-cni-bin\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530673 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-run-multus-certs\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.530927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.530715 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.531550 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.531532 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.534444 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.534424 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 12:06:02.534727 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.534708 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xrx52\"" Sep 10 12:06:02.534803 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.534713 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 12:06:02.534803 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.534760 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:06:02.534803 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.534763 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 12:06:02.534970 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.534858 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 12:06:02.535504 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.535486 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 12:06:02.536341 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.536322 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 12:06:02.536418 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.536386 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 12:06:02.536862 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.536843 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 12:06:02.536945 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.536843 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 12:06:02.536945 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.536846 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 12:06:02.537768 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.537750 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 12:06:02.537768 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.537763 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 12:06:02.537923 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.537776 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 12:06:02.537923 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.537798 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 12:06:02.537923 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.537812 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 12:06:02.538459 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.538437 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 12:06:02.538553 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.538483 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:06:02.538621 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.538550 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jn5ff\"" Sep 10 12:06:02.538621 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.538567 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 12:06:02.538718 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.538647 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 12:06:02.539366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.539138 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w74g8\"" Sep 10 12:06:02.539366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.539149 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 12:06:02.539366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.539161 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vm2p4\"" Sep 10 12:06:02.539366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.539183 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tx475\"" Sep 10 12:06:02.539366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.539188 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wth2h\"" Sep 10 12:06:02.539366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.539162 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cp2sj\"" Sep 10 12:06:02.539366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.539138 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k4l5n\"" Sep 10 12:06:02.539366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.539252 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 12:06:02.539366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.539168 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 12:06:02.546504 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.546486 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:06:02.574961 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.574945 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bc9q5" Sep 10 12:06:02.588234 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.588213 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bc9q5" Sep 10 12:06:02.621516 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.621493 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 12:06:02.631045 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631020 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-modprobe-d\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.631134 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-run\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.631134 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-sys\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.631134 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631080 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ckn4\" (UniqueName: \"kubernetes.io/projected/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-kube-api-access-8ckn4\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.631134 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-kubelet\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.631134 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631127 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-log-socket\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.631370 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631174 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-var-lib-cni-bin\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631370 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631232 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-var-lib-cni-bin\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631370 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-node-log\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.631370 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631266 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bacf78da-ac45-4109-89bb-2c10cd692b76-host-slash\") pod \"iptables-alerter-4mm2q\" (UID: \"bacf78da-ac45-4109-89bb-2c10cd692b76\") " pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.631370 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631291 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-cni-dir\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631370 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631307 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-var-lib-cni-multus\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631370 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631357 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-cni-dir\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631398 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrnw6\" (UniqueName: \"kubernetes.io/projected/43c48f08-c122-48e4-8f44-b47250e2fdd5-kube-api-access-xrnw6\") pod \"node-resolver-8c75j\" (UID: \"43c48f08-c122-48e4-8f44-b47250e2fdd5\") " pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631404 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-var-lib-cni-multus\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631433 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk6j5\" (UniqueName: \"kubernetes.io/projected/bacf78da-ac45-4109-89bb-2c10cd692b76-kube-api-access-qk6j5\") pod \"iptables-alerter-4mm2q\" (UID: \"bacf78da-ac45-4109-89bb-2c10cd692b76\") " pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631453 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631485 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-system-cni-dir\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631502 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-system-cni-dir\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631517 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-socket-dir-parent\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631533 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-hostroot\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631588 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-system-cni-dir\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631598 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-systemd\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631611 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-socket-dir-parent\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631622 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-hostroot\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/677825a5-038d-449f-9240-d5c10e329ae8-kubelet-config\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631637 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-system-cni-dir\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631661 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-device-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.631686 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-etc-selinux\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631698 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6facd31d-dff2-4394-b5bf-300dc1190634-ovnkube-config\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631720 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-var-lib-kubelet\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631749 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fccf390a-2f70-4c11-81a7-d0c709132636-agent-certs\") pod \"konnectivity-agent-9tms9\" (UID: \"fccf390a-2f70-4c11-81a7-d0c709132636\") " pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631770 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-sysctl-conf\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631751 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-var-lib-kubelet\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631803 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-lib-modules\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631819 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d733d7a3-21a9-41a1-a4c4-ffbf87537283-serviceca\") pod \"node-ca-sqwkr\" (UID: \"d733d7a3-21a9-41a1-a4c4-ffbf87537283\") " pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89n8t\" (UniqueName: \"kubernetes.io/projected/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-kube-api-access-89n8t\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631867 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-slash\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631890 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-etc-kubernetes\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631906 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztwkw\" (UniqueName: \"kubernetes.io/projected/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-kube-api-access-ztwkw\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631921 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-var-lib-kubelet\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631943 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-socket-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631967 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-run-ovn\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631969 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-etc-kubernetes\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.631993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc4hc\" (UniqueName: \"kubernetes.io/projected/6facd31d-dff2-4394-b5bf-300dc1190634-kube-api-access-qc4hc\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.632328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bacf78da-ac45-4109-89bb-2c10cd692b76-iptables-alerter-script\") pod \"iptables-alerter-4mm2q\" (UID: \"bacf78da-ac45-4109-89bb-2c10cd692b76\") " pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632034 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d733d7a3-21a9-41a1-a4c4-ffbf87537283-host\") pod \"node-ca-sqwkr\" (UID: \"d733d7a3-21a9-41a1-a4c4-ffbf87537283\") " pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c48f08-c122-48e4-8f44-b47250e2fdd5-tmp-dir\") pod \"node-resolver-8c75j\" (UID: \"43c48f08-c122-48e4-8f44-b47250e2fdd5\") " pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632070 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6facd31d-dff2-4394-b5bf-300dc1190634-ovnkube-script-lib\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632096 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-run-multus-certs\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632126 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632148 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632189 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-run-netns\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-etc-openvswitch\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-cni-netd\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632246 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkpfw\" (UniqueName: \"kubernetes.io/projected/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-kube-api-access-mkpfw\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632272 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-cnibin\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632306 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43c48f08-c122-48e4-8f44-b47250e2fdd5-hosts-file\") pod \"node-resolver-8c75j\" (UID: \"43c48f08-c122-48e4-8f44-b47250e2fdd5\") " pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632306 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-run-multus-certs\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632345 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-cnibin\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632371 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrvq9\" (UniqueName: \"kubernetes.io/projected/d733d7a3-21a9-41a1-a4c4-ffbf87537283-kube-api-access-vrvq9\") pod \"node-ca-sqwkr\" (UID: \"d733d7a3-21a9-41a1-a4c4-ffbf87537283\") " pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632397 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-sys-fs\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.633182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632444 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632468 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-run-netns\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632500 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-run-netns\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632511 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-daemon-config\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-cnibin\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632548 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-sysconfig\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632585 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-tmp\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632599 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-cnibin\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-run-systemd\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632651 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-run-k8s-cni-cncf-io\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632676 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-sysctl-d\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632696 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-host\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632722 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632739 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-registration-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632755 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-systemd-units\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632752 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-host-run-k8s-cni-cncf-io\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6facd31d-dff2-4394-b5bf-300dc1190634-env-overrides\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.633837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632756 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fccf390a-2f70-4c11-81a7-d0c709132636-konnectivity-ca\") pod \"konnectivity-agent-9tms9\" (UID: \"fccf390a-2f70-4c11-81a7-d0c709132636\") " pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632834 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632849 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-cni-binary-copy\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632883 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-kubernetes\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632931 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-tuned\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-var-lib-openvswitch\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.632984 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79f46949-17e0-4192-8a73-c0a0aaee0f07-cni-binary-copy\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633028 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w47\" (UniqueName: \"kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47\") pod \"network-check-target-dznv6\" (UID: \"2155a7db-7555-4c34-9898-82c3de1c8ad7\") " pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633093 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/677825a5-038d-449f-9240-d5c10e329ae8-dbus\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-cni-bin\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633152 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-daemon-config\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633179 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-conf-dir\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.634411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633262 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp4qr\" (UniqueName: \"kubernetes.io/projected/79f46949-17e0-4192-8a73-c0a0aaee0f07-kube-api-access-sp4qr\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.634985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633336 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79f46949-17e0-4192-8a73-c0a0aaee0f07-multus-conf-dir\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.634985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633365 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-run-openvswitch\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.634985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633381 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-cni-binary-copy\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.634985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633415 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6facd31d-dff2-4394-b5bf-300dc1190634-ovn-node-metrics-cert\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.634985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633475 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79f46949-17e0-4192-8a73-c0a0aaee0f07-cni-binary-copy\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.634985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633598 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.634985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.633854 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fccf390a-2f70-4c11-81a7-d0c709132636-konnectivity-ca\") pod \"konnectivity-agent-9tms9\" (UID: \"fccf390a-2f70-4c11-81a7-d0c709132636\") " pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:02.636195 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.636178 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fccf390a-2f70-4c11-81a7-d0c709132636-agent-certs\") pod \"konnectivity-agent-9tms9\" (UID: \"fccf390a-2f70-4c11-81a7-d0c709132636\") " pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:02.640016 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.639998 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:06:02.640016 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.640017 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:06:02.640144 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.640027 2555 projected.go:196] Error preparing data for projected volume kube-api-access-b4w47 for pod openshift-network-diagnostics/network-check-target-dznv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:02.640144 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.640099 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47 podName:2155a7db-7555-4c34-9898-82c3de1c8ad7 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:03.1400718 +0000 UTC m=+2.976054366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b4w47" (UniqueName: "kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47") pod "network-check-target-dznv6" (UID: "2155a7db-7555-4c34-9898-82c3de1c8ad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:02.642132 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.642113 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp4qr\" (UniqueName: \"kubernetes.io/projected/79f46949-17e0-4192-8a73-c0a0aaee0f07-kube-api-access-sp4qr\") pod \"multus-znrvr\" (UID: \"79f46949-17e0-4192-8a73-c0a0aaee0f07\") " pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.643290 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.643273 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztwkw\" (UniqueName: \"kubernetes.io/projected/91fb1004-c0e8-4a27-8a30-9cdc9c80a7db-kube-api-access-ztwkw\") pod \"multus-additional-cni-plugins-whvn7\" (UID: \"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db\") " pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.733721 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733699 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-sysconfig\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.733813 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733725 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-tmp\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.733813 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733748 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-run-systemd\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.733813 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733765 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-sysctl-d\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.733813 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733780 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-host\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.733813 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733795 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-registration-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733834 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-run-systemd\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733834 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-sysconfig\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-systemd-units\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733880 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-host\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733889 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-registration-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733884 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-systemd-units\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733900 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6facd31d-dff2-4394-b5bf-300dc1190634-env-overrides\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733923 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733944 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-kubernetes\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733951 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-sysctl-d\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733965 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-tuned\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.733984 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-var-lib-openvswitch\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/677825a5-038d-449f-9240-d5c10e329ae8-dbus\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:02.734033 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734038 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-cni-bin\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734057 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734070 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-kubernetes\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734078 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-run-openvswitch\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734090 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-var-lib-openvswitch\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6facd31d-dff2-4394-b5bf-300dc1190634-ovn-node-metrics-cert\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734124 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-cni-bin\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734176 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-run-openvswitch\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.734186 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734198 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/677825a5-038d-449f-9240-d5c10e329ae8-dbus\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734235 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-modprobe-d\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.734271 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs podName:7c538f6f-2768-4746-877a-8c7e2cb2ecc2 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:03.234248721 +0000 UTC m=+3.070231305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs") pod "network-metrics-daemon-mnkdw" (UID: "7c538f6f-2768-4746-877a-8c7e2cb2ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734312 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-run\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734327 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-modprobe-d\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734337 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-sys\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734365 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ckn4\" (UniqueName: \"kubernetes.io/projected/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-kube-api-access-8ckn4\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734369 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6facd31d-dff2-4394-b5bf-300dc1190634-env-overrides\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.734810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734386 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-run\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734391 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-kubelet\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734419 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-log-socket\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734434 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-sys\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734448 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-node-log\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734458 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-kubelet\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734489 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-log-socket\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734503 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-node-log\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734513 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bacf78da-ac45-4109-89bb-2c10cd692b76-host-slash\") pod \"iptables-alerter-4mm2q\" (UID: \"bacf78da-ac45-4109-89bb-2c10cd692b76\") " pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734535 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrnw6\" (UniqueName: \"kubernetes.io/projected/43c48f08-c122-48e4-8f44-b47250e2fdd5-kube-api-access-xrnw6\") pod \"node-resolver-8c75j\" (UID: \"43c48f08-c122-48e4-8f44-b47250e2fdd5\") " pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734561 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bacf78da-ac45-4109-89bb-2c10cd692b76-host-slash\") pod \"iptables-alerter-4mm2q\" (UID: \"bacf78da-ac45-4109-89bb-2c10cd692b76\") " pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734561 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk6j5\" (UniqueName: \"kubernetes.io/projected/bacf78da-ac45-4109-89bb-2c10cd692b76-kube-api-access-qk6j5\") pod \"iptables-alerter-4mm2q\" (UID: \"bacf78da-ac45-4109-89bb-2c10cd692b76\") " pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734594 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734645 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-systemd\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734671 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/677825a5-038d-449f-9240-d5c10e329ae8-kubelet-config\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734725 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734734 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/677825a5-038d-449f-9240-d5c10e329ae8-kubelet-config\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:02.735673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734784 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-device-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734797 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-systemd\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734815 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-etc-selinux\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734825 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-device-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734851 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6facd31d-dff2-4394-b5bf-300dc1190634-ovnkube-config\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734882 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-sysctl-conf\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-lib-modules\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734883 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-etc-selinux\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734936 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d733d7a3-21a9-41a1-a4c4-ffbf87537283-serviceca\") pod \"node-ca-sqwkr\" (UID: \"d733d7a3-21a9-41a1-a4c4-ffbf87537283\") " pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.734994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89n8t\" (UniqueName: \"kubernetes.io/projected/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-kube-api-access-89n8t\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735019 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-sysctl-conf\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735031 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-lib-modules\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735035 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-slash\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-var-lib-kubelet\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735089 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-socket-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735116 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-run-ovn\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735142 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc4hc\" (UniqueName: \"kubernetes.io/projected/6facd31d-dff2-4394-b5bf-300dc1190634-kube-api-access-qc4hc\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.736413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735153 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-var-lib-kubelet\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735169 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bacf78da-ac45-4109-89bb-2c10cd692b76-iptables-alerter-script\") pod \"iptables-alerter-4mm2q\" (UID: \"bacf78da-ac45-4109-89bb-2c10cd692b76\") " pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735195 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-slash\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735238 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-run-ovn\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735312 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-socket-dir\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735195 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d733d7a3-21a9-41a1-a4c4-ffbf87537283-host\") pod \"node-ca-sqwkr\" (UID: \"d733d7a3-21a9-41a1-a4c4-ffbf87537283\") " pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735357 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c48f08-c122-48e4-8f44-b47250e2fdd5-tmp-dir\") pod \"node-resolver-8c75j\" (UID: \"43c48f08-c122-48e4-8f44-b47250e2fdd5\") " pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735373 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d733d7a3-21a9-41a1-a4c4-ffbf87537283-serviceca\") pod \"node-ca-sqwkr\" (UID: \"d733d7a3-21a9-41a1-a4c4-ffbf87537283\") " pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735384 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6facd31d-dff2-4394-b5bf-300dc1190634-ovnkube-script-lib\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735408 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d733d7a3-21a9-41a1-a4c4-ffbf87537283-host\") pod \"node-ca-sqwkr\" (UID: \"d733d7a3-21a9-41a1-a4c4-ffbf87537283\") " pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735425 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735454 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-run-netns\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735480 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-etc-openvswitch\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735512 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-cni-netd\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735540 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkpfw\" (UniqueName: \"kubernetes.io/projected/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-kube-api-access-mkpfw\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735567 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43c48f08-c122-48e4-8f44-b47250e2fdd5-hosts-file\") pod \"node-resolver-8c75j\" (UID: \"43c48f08-c122-48e4-8f44-b47250e2fdd5\") " pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735593 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrvq9\" (UniqueName: \"kubernetes.io/projected/d733d7a3-21a9-41a1-a4c4-ffbf87537283-kube-api-access-vrvq9\") pod \"node-ca-sqwkr\" (UID: \"d733d7a3-21a9-41a1-a4c4-ffbf87537283\") " pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.736974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735641 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-sys-fs\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735669 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735713 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c48f08-c122-48e4-8f44-b47250e2fdd5-tmp-dir\") pod \"node-resolver-8c75j\" (UID: \"43c48f08-c122-48e4-8f44-b47250e2fdd5\") " pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735745 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.735821 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735834 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bacf78da-ac45-4109-89bb-2c10cd692b76-iptables-alerter-script\") pod \"iptables-alerter-4mm2q\" (UID: \"bacf78da-ac45-4109-89bb-2c10cd692b76\") " pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735822 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43c48f08-c122-48e4-8f44-b47250e2fdd5-hosts-file\") pod \"node-resolver-8c75j\" (UID: \"43c48f08-c122-48e4-8f44-b47250e2fdd5\") " pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:02.735872 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret podName:677825a5-038d-449f-9240-d5c10e329ae8 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:03.235856161 +0000 UTC m=+3.071838747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret") pod "global-pull-secret-syncer-bj8j2" (UID: "677825a5-038d-449f-9240-d5c10e329ae8") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735892 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6facd31d-dff2-4394-b5bf-300dc1190634-ovnkube-script-lib\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735929 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-etc-openvswitch\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735933 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-sys-fs\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735941 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-cni-netd\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.735977 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6facd31d-dff2-4394-b5bf-300dc1190634-host-run-netns\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.736374 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6facd31d-dff2-4394-b5bf-300dc1190634-ovnkube-config\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.736474 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-etc-tuned\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.736499 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-tmp\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.737461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.736580 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6facd31d-dff2-4394-b5bf-300dc1190634-ovn-node-metrics-cert\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.752076 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.752056 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk6j5\" (UniqueName: \"kubernetes.io/projected/bacf78da-ac45-4109-89bb-2c10cd692b76-kube-api-access-qk6j5\") pod \"iptables-alerter-4mm2q\" (UID: \"bacf78da-ac45-4109-89bb-2c10cd692b76\") " pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.765389 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.765334 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89n8t\" (UniqueName: \"kubernetes.io/projected/e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14-kube-api-access-89n8t\") pod \"aws-ebs-csi-driver-node-w52rv\" (UID: \"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.766792 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.766752 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" event={"ID":"6f5f458828324eb4edf2c91aefaa68b9","Type":"ContainerStarted","Data":"5d109f1895f331c5a57e2ff2c17d4c4d2c4f7bf09c08b01cfa18b6c87c432e90"} Sep 10 12:06:02.768049 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.768011 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal" event={"ID":"b6df7a7611388ae31505ad66be2dace6","Type":"ContainerStarted","Data":"8ee4224923dbc79e727b92a3e2b41bbf1aba169843a4ec09b466f9c08d423bbc"} Sep 10 12:06:02.769573 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.769535 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrvq9\" (UniqueName: \"kubernetes.io/projected/d733d7a3-21a9-41a1-a4c4-ffbf87537283-kube-api-access-vrvq9\") pod \"node-ca-sqwkr\" (UID: \"d733d7a3-21a9-41a1-a4c4-ffbf87537283\") " pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.770075 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.770052 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ckn4\" (UniqueName: \"kubernetes.io/projected/6b016ef6-29f4-4b3f-a8cb-d587c969ca96-kube-api-access-8ckn4\") pod \"tuned-xr9ms\" (UID: \"6b016ef6-29f4-4b3f-a8cb-d587c969ca96\") " pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.770860 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.770839 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkpfw\" (UniqueName: \"kubernetes.io/projected/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-kube-api-access-mkpfw\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:02.771548 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.771532 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc4hc\" (UniqueName: \"kubernetes.io/projected/6facd31d-dff2-4394-b5bf-300dc1190634-kube-api-access-qc4hc\") pod \"ovnkube-node-sjvhr\" (UID: \"6facd31d-dff2-4394-b5bf-300dc1190634\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.771605 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.771544 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrnw6\" (UniqueName: \"kubernetes.io/projected/43c48f08-c122-48e4-8f44-b47250e2fdd5-kube-api-access-xrnw6\") pod \"node-resolver-8c75j\" (UID: \"43c48f08-c122-48e4-8f44-b47250e2fdd5\") " pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.827883 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.827859 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-znrvr" Sep 10 12:06:02.833866 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.833846 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:02.837402 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.837381 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f46949_17e0_4192_8a73_c0a0aaee0f07.slice/crio-b540b079c0069007da6ac6e23778a0b0b44aaac721f41ab999a7dd90dc494afd WatchSource:0}: Error finding container b540b079c0069007da6ac6e23778a0b0b44aaac721f41ab999a7dd90dc494afd: Status 404 returned error can't find the container with id b540b079c0069007da6ac6e23778a0b0b44aaac721f41ab999a7dd90dc494afd Sep 10 12:06:02.841532 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.841516 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-whvn7" Sep 10 12:06:02.841902 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.841881 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccf390a_2f70_4c11_81a7_d0c709132636.slice/crio-a82ced27179bc7ec271424c236526741f4b808aedba0698c7cfe8bede46b2001 WatchSource:0}: Error finding container a82ced27179bc7ec271424c236526741f4b808aedba0698c7cfe8bede46b2001: Status 404 returned error can't find the container with id a82ced27179bc7ec271424c236526741f4b808aedba0698c7cfe8bede46b2001 Sep 10 12:06:02.847342 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.847324 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4mm2q" Sep 10 12:06:02.849828 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.849808 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91fb1004_c0e8_4a27_8a30_9cdc9c80a7db.slice/crio-e1b3356bacb507ed51da70c8b581cf37d0c1d275fa2c927b6fb79bd183fa165e WatchSource:0}: Error finding container e1b3356bacb507ed51da70c8b581cf37d0c1d275fa2c927b6fb79bd183fa165e: Status 404 returned error can't find the container with id e1b3356bacb507ed51da70c8b581cf37d0c1d275fa2c927b6fb79bd183fa165e Sep 10 12:06:02.853327 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.853309 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:02.855508 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.855487 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbacf78da_ac45_4109_89bb_2c10cd692b76.slice/crio-ab62bc633850c7f8cb60314323acea5a549aaef8453b5b0a8b8554516830ad3f WatchSource:0}: Error finding container ab62bc633850c7f8cb60314323acea5a549aaef8453b5b0a8b8554516830ad3f: Status 404 returned error can't find the container with id ab62bc633850c7f8cb60314323acea5a549aaef8453b5b0a8b8554516830ad3f Sep 10 12:06:02.859180 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.859163 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sqwkr" Sep 10 12:06:02.860903 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.860884 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6facd31d_dff2_4394_b5bf_300dc1190634.slice/crio-e9496169b1b9ba7de6eeb97d0dbc3f9cffb655d4405d32ddf28f8c63a12777e4 WatchSource:0}: Error finding container e9496169b1b9ba7de6eeb97d0dbc3f9cffb655d4405d32ddf28f8c63a12777e4: Status 404 returned error can't find the container with id e9496169b1b9ba7de6eeb97d0dbc3f9cffb655d4405d32ddf28f8c63a12777e4 Sep 10 12:06:02.864131 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.864110 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8c75j" Sep 10 12:06:02.866906 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.866886 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd733d7a3_21a9_41a1_a4c4_ffbf87537283.slice/crio-69062f60fe6ea2d6cd7924c82f902d789b09db2c132fd0970a174172aa920460 WatchSource:0}: Error finding container 69062f60fe6ea2d6cd7924c82f902d789b09db2c132fd0970a174172aa920460: Status 404 returned error can't find the container with id 69062f60fe6ea2d6cd7924c82f902d789b09db2c132fd0970a174172aa920460 Sep 10 12:06:02.871738 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.871720 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" Sep 10 12:06:02.872026 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.872007 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c48f08_c122_48e4_8f44_b47250e2fdd5.slice/crio-a9bbaca604f83d8b28d2fd0deb3df8ba17e7b37c4945344919d3dc88018a5fee WatchSource:0}: Error finding container a9bbaca604f83d8b28d2fd0deb3df8ba17e7b37c4945344919d3dc88018a5fee: Status 404 returned error can't find the container with id a9bbaca604f83d8b28d2fd0deb3df8ba17e7b37c4945344919d3dc88018a5fee Sep 10 12:06:02.875873 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:02.875793 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" Sep 10 12:06:02.881092 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.881072 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b016ef6_29f4_4b3f_a8cb_d587c969ca96.slice/crio-cc74399785c022e1db487a0901be650a96d067e6bdc8abae225670cfc9857e5d WatchSource:0}: Error finding container cc74399785c022e1db487a0901be650a96d067e6bdc8abae225670cfc9857e5d: Status 404 returned error can't find the container with id cc74399785c022e1db487a0901be650a96d067e6bdc8abae225670cfc9857e5d Sep 10 12:06:02.883015 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:02.882994 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b75f5e_b9c7_4bb6_a3aa_b0a4ab615f14.slice/crio-942671cd108703a48f4d026cdba8dc90f805d3eb5331061c56e909ee9cd3189e WatchSource:0}: Error finding container 942671cd108703a48f4d026cdba8dc90f805d3eb5331061c56e909ee9cd3189e: Status 404 returned error can't find the container with id 942671cd108703a48f4d026cdba8dc90f805d3eb5331061c56e909ee9cd3189e Sep 10 12:06:03.238260 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.238168 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:03.238260 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.238224 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w47\" (UniqueName: \"kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47\") pod \"network-check-target-dznv6\" (UID: \"2155a7db-7555-4c34-9898-82c3de1c8ad7\") " pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:03.238260 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.238253 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:03.238536 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:03.238371 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:03.238536 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:03.238430 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs podName:7c538f6f-2768-4746-877a-8c7e2cb2ecc2 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:04.238410897 +0000 UTC m=+4.074393479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs") pod "network-metrics-daemon-mnkdw" (UID: "7c538f6f-2768-4746-877a-8c7e2cb2ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:03.238829 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:03.238797 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:06:03.238829 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:03.238816 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:03.238829 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:03.238830 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:06:03.239078 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:03.238845 2555 projected.go:196] Error preparing data for projected volume kube-api-access-b4w47 for pod openshift-network-diagnostics/network-check-target-dznv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:03.239078 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:03.238887 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret podName:677825a5-038d-449f-9240-d5c10e329ae8 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:04.238869065 +0000 UTC m=+4.074851637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret") pod "global-pull-secret-syncer-bj8j2" (UID: "677825a5-038d-449f-9240-d5c10e329ae8") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:03.239078 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:03.238910 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47 podName:2155a7db-7555-4c34-9898-82c3de1c8ad7 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:04.238898437 +0000 UTC m=+4.074881016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4w47" (UniqueName: "kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47") pod "network-check-target-dznv6" (UID: "2155a7db-7555-4c34-9898-82c3de1c8ad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:03.591074 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.590989 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:01:03 +0000 UTC" deadline="2028-02-26 04:47:06.999057587 +0000 UTC" Sep 10 12:06:03.591074 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.591022 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12808h41m3.408040432s" Sep 10 12:06:03.761912 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.761776 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:03.762112 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:03.761913 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:03.773571 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.773469 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" event={"ID":"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14","Type":"ContainerStarted","Data":"942671cd108703a48f4d026cdba8dc90f805d3eb5331061c56e909ee9cd3189e"} Sep 10 12:06:03.777121 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.777090 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" event={"ID":"6facd31d-dff2-4394-b5bf-300dc1190634","Type":"ContainerStarted","Data":"e9496169b1b9ba7de6eeb97d0dbc3f9cffb655d4405d32ddf28f8c63a12777e4"} Sep 10 12:06:03.779107 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.779080 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whvn7" event={"ID":"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db","Type":"ContainerStarted","Data":"e1b3356bacb507ed51da70c8b581cf37d0c1d275fa2c927b6fb79bd183fa165e"} Sep 10 12:06:03.781059 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.781032 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9tms9" event={"ID":"fccf390a-2f70-4c11-81a7-d0c709132636","Type":"ContainerStarted","Data":"a82ced27179bc7ec271424c236526741f4b808aedba0698c7cfe8bede46b2001"} Sep 10 12:06:03.782847 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.782787 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-znrvr" event={"ID":"79f46949-17e0-4192-8a73-c0a0aaee0f07","Type":"ContainerStarted","Data":"b540b079c0069007da6ac6e23778a0b0b44aaac721f41ab999a7dd90dc494afd"} Sep 10 12:06:03.784236 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.784208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" event={"ID":"6b016ef6-29f4-4b3f-a8cb-d587c969ca96","Type":"ContainerStarted","Data":"cc74399785c022e1db487a0901be650a96d067e6bdc8abae225670cfc9857e5d"} Sep 10 12:06:03.785965 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.785940 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8c75j" event={"ID":"43c48f08-c122-48e4-8f44-b47250e2fdd5","Type":"ContainerStarted","Data":"a9bbaca604f83d8b28d2fd0deb3df8ba17e7b37c4945344919d3dc88018a5fee"} Sep 10 12:06:03.787807 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.787486 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sqwkr" event={"ID":"d733d7a3-21a9-41a1-a4c4-ffbf87537283","Type":"ContainerStarted","Data":"69062f60fe6ea2d6cd7924c82f902d789b09db2c132fd0970a174172aa920460"} Sep 10 12:06:03.789442 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.789001 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4mm2q" event={"ID":"bacf78da-ac45-4109-89bb-2c10cd692b76","Type":"ContainerStarted","Data":"ab62bc633850c7f8cb60314323acea5a549aaef8453b5b0a8b8554516830ad3f"} Sep 10 12:06:03.843806 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:03.843716 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:06:04.247188 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:04.247104 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w47\" (UniqueName: \"kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47\") pod \"network-check-target-dznv6\" (UID: \"2155a7db-7555-4c34-9898-82c3de1c8ad7\") " pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:04.247188 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:04.247159 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:04.247400 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:04.247219 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:04.247400 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:04.247347 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:04.247519 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:04.247439 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret podName:677825a5-038d-449f-9240-d5c10e329ae8 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:06.247419532 +0000 UTC m=+6.083402113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret") pod "global-pull-secret-syncer-bj8j2" (UID: "677825a5-038d-449f-9240-d5c10e329ae8") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:04.247932 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:04.247910 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:06:04.248022 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:04.247938 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:06:04.248022 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:04.247952 2555 projected.go:196] Error preparing data for projected volume kube-api-access-b4w47 for pod openshift-network-diagnostics/network-check-target-dznv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:04.248022 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:04.247999 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47 podName:2155a7db-7555-4c34-9898-82c3de1c8ad7 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:06.247983066 +0000 UTC m=+6.083965631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4w47" (UniqueName: "kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47") pod "network-check-target-dznv6" (UID: "2155a7db-7555-4c34-9898-82c3de1c8ad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:04.248205 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:04.248066 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:04.248205 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:04.248102 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs podName:7c538f6f-2768-4746-877a-8c7e2cb2ecc2 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:06.248090226 +0000 UTC m=+6.084072802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs") pod "network-metrics-daemon-mnkdw" (UID: "7c538f6f-2768-4746-877a-8c7e2cb2ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:04.592233 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:04.592127 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:01:03 +0000 UTC" deadline="2028-04-22 06:58:45.573845757 +0000 UTC" Sep 10 12:06:04.592233 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:04.592179 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14154h52m40.981671979s" Sep 10 12:06:04.765060 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:04.765029 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:04.765238 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:04.765175 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:04.765603 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:04.765583 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:04.765733 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:04.765711 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:05.762046 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:05.762014 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:05.762513 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:05.762153 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:06.265515 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:06.265476 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w47\" (UniqueName: \"kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47\") pod \"network-check-target-dznv6\" (UID: \"2155a7db-7555-4c34-9898-82c3de1c8ad7\") " pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:06.265724 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:06.265534 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:06.265724 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:06.265624 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:06.265853 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:06.265761 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:06:06.265853 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:06.265778 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:06.265853 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:06.265789 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:06:06.265853 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:06.265809 2555 projected.go:196] Error preparing data for projected volume kube-api-access-b4w47 for pod openshift-network-diagnostics/network-check-target-dznv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:06.265853 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:06.265849 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret podName:677825a5-038d-449f-9240-d5c10e329ae8 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:10.265827769 +0000 UTC m=+10.101810337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret") pod "global-pull-secret-syncer-bj8j2" (UID: "677825a5-038d-449f-9240-d5c10e329ae8") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:06.266105 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:06.265855 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:06.266105 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:06.265876 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47 podName:2155a7db-7555-4c34-9898-82c3de1c8ad7 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:10.265855519 +0000 UTC m=+10.101838106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4w47" (UniqueName: "kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47") pod "network-check-target-dznv6" (UID: "2155a7db-7555-4c34-9898-82c3de1c8ad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:06.266105 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:06.265896 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs podName:7c538f6f-2768-4746-877a-8c7e2cb2ecc2 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:10.265884437 +0000 UTC m=+10.101867021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs") pod "network-metrics-daemon-mnkdw" (UID: "7c538f6f-2768-4746-877a-8c7e2cb2ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:06.765013 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:06.764925 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:06.765469 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:06.765078 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:06.765538 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:06.765467 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:06.765599 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:06.765572 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:07.761941 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:07.761900 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:07.762142 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:07.762038 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:08.762461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:08.762426 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:08.762461 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:08.762467 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:08.763014 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:08.762595 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:08.763014 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:08.762644 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:09.762505 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:09.762469 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:09.763011 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:09.762625 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:10.302022 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:10.301983 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:10.302253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:10.302049 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w47\" (UniqueName: \"kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47\") pod \"network-check-target-dznv6\" (UID: \"2155a7db-7555-4c34-9898-82c3de1c8ad7\") " pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:10.302253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:10.302077 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:10.302253 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:10.302171 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:10.302253 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:10.302210 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:10.302253 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:10.302248 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:06:10.302527 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:10.302275 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:06:10.302527 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:10.302290 2555 projected.go:196] Error preparing data for projected volume kube-api-access-b4w47 for pod openshift-network-diagnostics/network-check-target-dznv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:10.302527 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:10.302251 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret podName:677825a5-038d-449f-9240-d5c10e329ae8 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:18.302230404 +0000 UTC m=+18.138212998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret") pod "global-pull-secret-syncer-bj8j2" (UID: "677825a5-038d-449f-9240-d5c10e329ae8") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:10.302527 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:10.302349 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs podName:7c538f6f-2768-4746-877a-8c7e2cb2ecc2 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:18.302331938 +0000 UTC m=+18.138314509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs") pod "network-metrics-daemon-mnkdw" (UID: "7c538f6f-2768-4746-877a-8c7e2cb2ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:10.302527 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:10.302361 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47 podName:2155a7db-7555-4c34-9898-82c3de1c8ad7 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:18.302354648 +0000 UTC m=+18.138337213 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4w47" (UniqueName: "kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47") pod "network-check-target-dznv6" (UID: "2155a7db-7555-4c34-9898-82c3de1c8ad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:10.762682 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:10.762603 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:10.763122 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:10.762752 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:10.763122 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:10.762792 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:10.763122 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:10.762910 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:11.761975 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:11.761736 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:11.761975 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:11.761876 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:12.762425 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:12.762393 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:12.762885 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:12.762518 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:12.762885 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:12.762578 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:12.762885 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:12.762675 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:13.762124 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:13.762088 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:13.762305 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:13.762220 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:14.762191 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:14.762158 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:14.762601 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:14.762162 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:14.762601 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:14.762293 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:14.762601 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:14.762384 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:15.762302 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:15.762266 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:15.762804 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:15.762402 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:16.762470 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:16.762439 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:16.762923 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:16.762583 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:16.762923 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:16.762622 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:16.762923 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:16.762729 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:17.762080 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:17.762052 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:17.762304 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:17.762158 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:18.368746 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:18.368716 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:18.369189 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:18.368760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w47\" (UniqueName: \"kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47\") pod \"network-check-target-dznv6\" (UID: \"2155a7db-7555-4c34-9898-82c3de1c8ad7\") " pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:18.369189 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:18.368778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:18.369189 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:18.368866 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:18.369189 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:18.368875 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:18.369189 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:18.368912 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs podName:7c538f6f-2768-4746-877a-8c7e2cb2ecc2 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:34.368899376 +0000 UTC m=+34.204881940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs") pod "network-metrics-daemon-mnkdw" (UID: "7c538f6f-2768-4746-877a-8c7e2cb2ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:18.369189 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:18.368940 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret podName:677825a5-038d-449f-9240-d5c10e329ae8 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:34.368921465 +0000 UTC m=+34.204904037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret") pod "global-pull-secret-syncer-bj8j2" (UID: "677825a5-038d-449f-9240-d5c10e329ae8") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:18.369189 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:18.368882 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:06:18.369189 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:18.368966 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:06:18.369189 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:18.368980 2555 projected.go:196] Error preparing data for projected volume kube-api-access-b4w47 for pod openshift-network-diagnostics/network-check-target-dznv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:18.369189 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:18.369023 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47 podName:2155a7db-7555-4c34-9898-82c3de1c8ad7 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:34.369011242 +0000 UTC m=+34.204993808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4w47" (UniqueName: "kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47") pod "network-check-target-dznv6" (UID: "2155a7db-7555-4c34-9898-82c3de1c8ad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:18.765162 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:18.765087 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:18.765315 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:18.765216 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:18.765315 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:18.765270 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:18.765416 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:18.765381 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:19.762103 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:19.762069 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:19.762537 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:19.762187 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:20.762769 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:20.762649 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:20.763150 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:20.762772 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:20.763150 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:20.762838 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:20.763150 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:20.762938 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:21.761897 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:21.761483 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:21.761897 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:21.761691 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:21.839312 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:21.839269 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-znrvr" event={"ID":"79f46949-17e0-4192-8a73-c0a0aaee0f07","Type":"ContainerStarted","Data":"845a4e9c11410c444c8c51a40d63f7248a57fa2702089e5fb3cfa14b4314a618"} Sep 10 12:06:21.858377 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:21.858247 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" event={"ID":"6b016ef6-29f4-4b3f-a8cb-d587c969ca96","Type":"ContainerStarted","Data":"69ec23661bf67b76d75a6b40c9a29102ea81b01b754505c86f677171d79506bb"} Sep 10 12:06:21.860726 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:21.860675 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal" event={"ID":"b6df7a7611388ae31505ad66be2dace6","Type":"ContainerStarted","Data":"ae7acaebe8ba60e62bb476a3ad5a452edabebbaed30669baf78658e3e48cbbc4"} Sep 10 12:06:21.867986 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:21.867673 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" event={"ID":"6facd31d-dff2-4394-b5bf-300dc1190634","Type":"ContainerStarted","Data":"9a7ce7e2cf49e2345268fb2c46db6f880ebda269ccb5279f2593423b1a75611d"} Sep 10 12:06:21.871577 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:21.871510 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-znrvr" podStartSLOduration=1.991988436 podStartE2EDuration="20.871497593s" totalImagesPullingTime="18.879509157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:21.870611521 +0000 UTC m=+21.706594108" watchObservedRunningTime="2026-09-10 12:06:21.871497593 +0000 UTC m=+21.707480178" Sep 10 12:06:21.900076 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:21.899901 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xr9ms" podStartSLOduration=2.118898544 podStartE2EDuration="20.899881033s" totalImagesPullingTime="18.780982489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:21.899702075 +0000 UTC m=+21.735684661" watchObservedRunningTime="2026-09-10 12:06:21.899881033 +0000 UTC m=+21.735863619" Sep 10 12:06:21.923437 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:21.923388 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-140.ec2.internal" podStartSLOduration=19.923370591 podStartE2EDuration="19.923370591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:21.923240713 +0000 UTC m=+21.759223300" watchObservedRunningTime="2026-09-10 12:06:21.923370591 +0000 UTC m=+21.759353174" Sep 10 12:06:22.762841 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.762344 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:22.762841 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.762348 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:22.762841 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:22.762454 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:22.762841 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:22.762542 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:22.872451 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.872416 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" event={"ID":"6facd31d-dff2-4394-b5bf-300dc1190634","Type":"ContainerStarted","Data":"c4ddaeebe0806fce0e9f7b66d79e0e2d9ba2c8283c7b747a4df6d3929adc2484"} Sep 10 12:06:22.872841 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.872491 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" event={"ID":"6facd31d-dff2-4394-b5bf-300dc1190634","Type":"ContainerStarted","Data":"67f409f36070ab2c24ac4e4d84642c49753f08fc7640424e382c5147f3c91d62"} Sep 10 12:06:22.872841 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.872551 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" event={"ID":"6facd31d-dff2-4394-b5bf-300dc1190634","Type":"ContainerStarted","Data":"ad7d27d813f054d241ea38db7ddaad28367c8bfc802336a3e9198a406313b188"} Sep 10 12:06:22.872841 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.872614 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" event={"ID":"6facd31d-dff2-4394-b5bf-300dc1190634","Type":"ContainerStarted","Data":"c94aa86a2e42c9a1e7b5f8b733e7fbb11d21e14059c5fe4d4e5888eea9ef6fe9"} Sep 10 12:06:22.872841 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.872664 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" event={"ID":"6facd31d-dff2-4394-b5bf-300dc1190634","Type":"ContainerStarted","Data":"1e7a6376bc153d6a6ff92608bb88b7d561caa5898ccfb7ebe53c395beae6457b"} Sep 10 12:06:22.873937 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.873916 2555 generic.go:356] "Generic (PLEG): container finished" podID="91fb1004-c0e8-4a27-8a30-9cdc9c80a7db" containerID="a3aaef7f6026d62edf52ef13536a01d8f1c0c163c14ffe3dc38ecea3ded6212e" exitCode=0 Sep 10 12:06:22.874042 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.873979 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whvn7" event={"ID":"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db","Type":"ContainerDied","Data":"a3aaef7f6026d62edf52ef13536a01d8f1c0c163c14ffe3dc38ecea3ded6212e"} Sep 10 12:06:22.875573 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.875539 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9tms9" event={"ID":"fccf390a-2f70-4c11-81a7-d0c709132636","Type":"ContainerStarted","Data":"2e98ff54db05451492611d8d3c25746a626e3ed9dccb29c230966382fabb1bec"} Sep 10 12:06:22.877037 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.877019 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8c75j" event={"ID":"43c48f08-c122-48e4-8f44-b47250e2fdd5","Type":"ContainerStarted","Data":"d23305a6c45e9019c47f091d313a60affa9c253a8facd3001531f43fe67086e4"} Sep 10 12:06:22.881276 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.881248 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sqwkr" event={"ID":"d733d7a3-21a9-41a1-a4c4-ffbf87537283","Type":"ContainerStarted","Data":"0978cd2954d186b018c3cb2ff01db1a08faf60ccc51bb254192fceb8b9c87415"} Sep 10 12:06:22.882847 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.882826 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4mm2q" event={"ID":"bacf78da-ac45-4109-89bb-2c10cd692b76","Type":"ContainerStarted","Data":"60f4ec121550cfc49ad2332b507400c2ddb8c7573d80ee42eff4d018f5d6525b"} Sep 10 12:06:22.884320 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.884299 2555 generic.go:356] "Generic (PLEG): container finished" podID="6f5f458828324eb4edf2c91aefaa68b9" containerID="269ffad7053efc107459ea04277b6bfbd29e15352333fff2db585f3bc7838955" exitCode=0 Sep 10 12:06:22.884394 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.884368 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" event={"ID":"6f5f458828324eb4edf2c91aefaa68b9","Type":"ContainerDied","Data":"269ffad7053efc107459ea04277b6bfbd29e15352333fff2db585f3bc7838955"} Sep 10 12:06:22.885814 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.885790 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" event={"ID":"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14","Type":"ContainerStarted","Data":"8aa99294490ad79082b0666bfb1f0eaaf656f5330c3ac7a3ee917e2025faf80c"} Sep 10 12:06:22.923178 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.923142 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4mm2q" podStartSLOduration=3.117424371 podStartE2EDuration="21.923130929s" totalImagesPullingTime="18.805706558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:22.922943983 +0000 UTC m=+22.758926580" watchObservedRunningTime="2026-09-10 12:06:22.923130929 +0000 UTC m=+22.759113515" Sep 10 12:06:22.943994 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.943919 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sqwkr" podStartSLOduration=3.151081272 podStartE2EDuration="21.943906757s" totalImagesPullingTime="18.792825485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:22.943516596 +0000 UTC m=+22.779499184" watchObservedRunningTime="2026-09-10 12:06:22.943906757 +0000 UTC m=+22.779889342" Sep 10 12:06:22.960182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.960148 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8c75j" podStartSLOduration=3.168727182 podStartE2EDuration="21.960136354s" totalImagesPullingTime="18.791409172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:22.959945401 +0000 UTC m=+22.795927988" watchObservedRunningTime="2026-09-10 12:06:22.960136354 +0000 UTC m=+22.796118940" Sep 10 12:06:22.994775 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:22.994734 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9tms9" podStartSLOduration=3.19636098 podStartE2EDuration="21.994722467s" totalImagesPullingTime="18.798361487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:22.994005391 +0000 UTC m=+22.829987998" watchObservedRunningTime="2026-09-10 12:06:22.994722467 +0000 UTC m=+22.830705053" Sep 10 12:06:23.333540 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:23.333402 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 12:06:23.730610 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:23.730469 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T12:06:23.333537389Z","UUID":"f7d64390-1933-4610-8b28-44363f4f02a3","Handler":null,"Name":"","Endpoint":""} Sep 10 12:06:23.732126 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:23.732098 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 12:06:23.732126 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:23.732129 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 12:06:23.761931 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:23.761906 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:23.762055 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:23.762024 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:23.890769 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:23.890736 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" event={"ID":"6f5f458828324eb4edf2c91aefaa68b9","Type":"ContainerStarted","Data":"87e8c5c05f807e64ea69e475086b16428593c85c089c0dca03cdcd03e12bb9c4"} Sep 10 12:06:23.893490 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:23.893452 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" event={"ID":"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14","Type":"ContainerStarted","Data":"4dae85629398c94b27d35f8e320d658d65ad7b59d57f12a1868669d090c24c20"} Sep 10 12:06:23.908738 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:23.908691 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-140.ec2.internal" podStartSLOduration=21.908672683 podStartE2EDuration="21.908672683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:23.908477108 +0000 UTC m=+23.744459694" watchObservedRunningTime="2026-09-10 12:06:23.908672683 +0000 UTC m=+23.744655270" Sep 10 12:06:24.762172 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:24.762142 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:24.762297 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:24.762269 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:24.762361 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:24.762319 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:24.762845 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:24.762814 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:24.898424 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:24.898389 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" event={"ID":"e6b75f5e-b9c7-4bb6-a3aa-b0a4ab615f14","Type":"ContainerStarted","Data":"d35d0cab6573275cbafa46c76ea214787e5d616fb8b3ea9a2522387c39cb6344"} Sep 10 12:06:24.902692 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:24.902665 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" event={"ID":"6facd31d-dff2-4394-b5bf-300dc1190634","Type":"ContainerStarted","Data":"4897b10482c7b811ef53be9e195fe70f68f313117af95a3c9a7433de4725084c"} Sep 10 12:06:24.921291 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:24.921248 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w52rv" podStartSLOduration=1.676486359 podStartE2EDuration="22.921233019s" totalImagesPullingTime="21.24474666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:24.92083275 +0000 UTC m=+24.756815352" watchObservedRunningTime="2026-09-10 12:06:24.921233019 +0000 UTC m=+24.757215604" Sep 10 12:06:25.557668 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:25.557631 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:25.761645 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:25.761617 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:25.761789 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:25.761719 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:26.762697 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:26.762510 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:26.763075 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:26.762510 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:26.763075 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:26.762782 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:26.763075 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:26.762851 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:26.905846 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:26.905808 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:26.906550 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:26.906530 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:26.910730 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:26.910707 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" event={"ID":"6facd31d-dff2-4394-b5bf-300dc1190634","Type":"ContainerStarted","Data":"5b72c24c0f8dd155e758054af9f09a1c1129173b0969bda8ac1b6acc4eee6dac"} Sep 10 12:06:26.910977 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:26.910954 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:26.911063 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:26.911023 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:26.928045 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:26.928025 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:26.956215 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:26.956172 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" podStartSLOduration=7.097955619 podStartE2EDuration="25.956156416s" totalImagesPullingTime="18.858200797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:26.955791459 +0000 UTC m=+26.791774044" watchObservedRunningTime="2026-09-10 12:06:26.956156416 +0000 UTC m=+26.792139001" Sep 10 12:06:27.761984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:27.761948 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:27.762159 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:27.762070 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:27.913542 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:27.913493 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:27.913985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:27.913650 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9tms9" Sep 10 12:06:27.928921 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:27.928888 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:06:28.592295 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:28.592262 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dznv6"] Sep 10 12:06:28.592541 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:28.592378 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:28.592541 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:28.592492 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:28.597356 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:28.597181 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bj8j2"] Sep 10 12:06:28.597356 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:28.597290 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:28.597538 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:28.597385 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:28.598028 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:28.598005 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mnkdw"] Sep 10 12:06:28.598130 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:28.598118 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:28.598253 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:28.598232 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:29.762361 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:29.762169 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:29.762662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:29.762204 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:29.762662 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:29.762404 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:29.762662 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:29.762477 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:29.918105 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:29.918076 2555 generic.go:356] "Generic (PLEG): container finished" podID="91fb1004-c0e8-4a27-8a30-9cdc9c80a7db" containerID="a66aa0e3c04fa4d0ebf3cf501f38f9591eada243bfe9fe557332d1bc90a772c5" exitCode=0 Sep 10 12:06:29.918200 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:29.918142 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whvn7" event={"ID":"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db","Type":"ContainerDied","Data":"a66aa0e3c04fa4d0ebf3cf501f38f9591eada243bfe9fe557332d1bc90a772c5"} Sep 10 12:06:30.763134 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:30.763109 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:30.763608 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:30.763188 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:31.761757 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:31.761730 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:31.761757 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:31.761766 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:31.761941 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:31.761856 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:31.761993 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:31.761963 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:31.924887 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:31.924855 2555 generic.go:356] "Generic (PLEG): container finished" podID="91fb1004-c0e8-4a27-8a30-9cdc9c80a7db" containerID="6fe30efaea7326d4f7375134a92be6930eeec889e9dcb6d3421137d69fcfbbf0" exitCode=0 Sep 10 12:06:31.925493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:31.924894 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whvn7" event={"ID":"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db","Type":"ContainerDied","Data":"6fe30efaea7326d4f7375134a92be6930eeec889e9dcb6d3421137d69fcfbbf0"} Sep 10 12:06:32.762007 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:32.761976 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:32.762165 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:32.762096 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bj8j2" podUID="677825a5-038d-449f-9240-d5c10e329ae8" Sep 10 12:06:33.762618 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:33.762426 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:33.763011 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:33.762478 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:33.763011 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:33.762693 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnkdw" podUID="7c538f6f-2768-4746-877a-8c7e2cb2ecc2" Sep 10 12:06:33.763011 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:33.762757 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dznv6" podUID="2155a7db-7555-4c34-9898-82c3de1c8ad7" Sep 10 12:06:33.931302 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:33.931274 2555 generic.go:356] "Generic (PLEG): container finished" podID="91fb1004-c0e8-4a27-8a30-9cdc9c80a7db" containerID="a62050add22c0ce21d96337c9962256710a7a6f2a62837d43aaec15aa55a720b" exitCode=0 Sep 10 12:06:33.931450 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:33.931321 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whvn7" event={"ID":"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db","Type":"ContainerDied","Data":"a62050add22c0ce21d96337c9962256710a7a6f2a62837d43aaec15aa55a720b"} Sep 10 12:06:34.388206 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.388171 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w47\" (UniqueName: \"kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47\") pod \"network-check-target-dznv6\" (UID: \"2155a7db-7555-4c34-9898-82c3de1c8ad7\") " pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:34.388206 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.388207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:34.388451 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.388239 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:34.388451 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.388321 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:34.388451 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.388344 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:06:34.388451 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.388364 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:06:34.388451 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.388368 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret podName:677825a5-038d-449f-9240-d5c10e329ae8 nodeName:}" failed. No retries permitted until 2026-09-10 12:07:06.388355213 +0000 UTC m=+66.224337776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret") pod "global-pull-secret-syncer-bj8j2" (UID: "677825a5-038d-449f-9240-d5c10e329ae8") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:06:34.388451 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.388373 2555 projected.go:196] Error preparing data for projected volume kube-api-access-b4w47 for pod openshift-network-diagnostics/network-check-target-dznv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:34.388451 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.388377 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:34.388451 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.388412 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47 podName:2155a7db-7555-4c34-9898-82c3de1c8ad7 nodeName:}" failed. No retries permitted until 2026-09-10 12:07:06.388399972 +0000 UTC m=+66.224382536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4w47" (UniqueName: "kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47") pod "network-check-target-dznv6" (UID: "2155a7db-7555-4c34-9898-82c3de1c8ad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:06:34.388451 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.388425 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs podName:7c538f6f-2768-4746-877a-8c7e2cb2ecc2 nodeName:}" failed. No retries permitted until 2026-09-10 12:07:06.388418672 +0000 UTC m=+66.224401236 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs") pod "network-metrics-daemon-mnkdw" (UID: "7c538f6f-2768-4746-877a-8c7e2cb2ecc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:06:34.417022 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.417004 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-140.ec2.internal" event="NodeReady" Sep 10 12:06:34.417121 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.417091 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 12:06:34.464620 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.464520 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5544b76fcb-gcvqq"] Sep 10 12:06:34.486763 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.486743 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-j4xzv"] Sep 10 12:06:34.486871 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.486853 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.492394 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.492373 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 12:06:34.492816 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.492797 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 12:06:34.493660 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.493428 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c52mp\"" Sep 10 12:06:34.495530 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.494399 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 12:06:34.500685 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.500667 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 12:06:34.507083 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.507059 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn"] Sep 10 12:06:34.507210 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.507191 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.510913 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.510896 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 10 12:06:34.511131 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.511115 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 12:06:34.511345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.511328 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 10 12:06:34.511639 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.511622 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g6qg2\"" Sep 10 12:06:34.511942 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.511925 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 12:06:34.532734 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.532708 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-gqr7z"] Sep 10 12:06:34.532861 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.532847 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:34.533047 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.533031 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 10 12:06:34.536378 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.536361 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 12:06:34.536518 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.536501 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 10 12:06:34.539528 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.539511 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 10 12:06:34.539528 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.539513 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 12:06:34.539722 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.539595 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4xb9h\"" Sep 10 12:06:34.554878 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.554860 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg"] Sep 10 12:06:34.554999 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.554982 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.558518 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.558499 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5wwf5\"" Sep 10 12:06:34.558751 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.558731 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:06:34.558854 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.558788 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 10 12:06:34.559087 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.559070 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 10 12:06:34.559261 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.559226 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 10 12:06:34.565884 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.565823 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn"] Sep 10 12:06:34.568414 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.566422 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.569705 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.568787 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 10 12:06:34.569996 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.569981 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 10 12:06:34.570205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.570188 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 10 12:06:34.570580 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.570297 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j5bms\"" Sep 10 12:06:34.570580 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.570307 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:06:34.570580 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.570528 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 10 12:06:34.571516 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.571489 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:34.586065 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.586045 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c76cccf54-qpjb6"] Sep 10 12:06:34.586160 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.586147 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn" Sep 10 12:06:34.590116 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-bound-sa-token\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.590116 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590095 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 10 12:06:34.590310 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-trusted-ca\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.590310 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590220 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82e21dee-d039-4ad6-8bee-56da40618432-serving-cert\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.590310 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-ca-trust-extracted\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.590310 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxd7q\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-kube-api-access-kxd7q\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590330 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e21dee-d039-4ad6-8bee-56da40618432-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590369 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-certificates\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590416 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-image-registry-private-configuration\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590442 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/82e21dee-d039-4ad6-8bee-56da40618432-snapshots\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590446 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590468 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e21dee-d039-4ad6-8bee-56da40618432-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590492 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-installation-pull-secrets\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590519 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e21dee-d039-4ad6-8bee-56da40618432-tmp\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590524 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6856p\"" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjt9p\" (UniqueName: \"kubernetes.io/projected/82e21dee-d039-4ad6-8bee-56da40618432-kube-api-access-rjt9p\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.590628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.590620 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.596241 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.596218 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7"] Sep 10 12:06:34.596354 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.596327 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.599671 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.599652 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 12:06:34.599896 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.599881 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 12:06:34.599896 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.599892 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 12:06:34.599985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.599945 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 12:06:34.600579 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.600550 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 12:06:34.600895 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.600877 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cl4wl\"" Sep 10 12:06:34.600966 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.600899 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 12:06:34.606247 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.606232 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2"] Sep 10 12:06:34.606365 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.606350 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:34.609947 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.609926 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 12:06:34.610018 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.609962 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:06:34.610575 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.610545 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z242c\"" Sep 10 12:06:34.610575 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.610570 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 12:06:34.622456 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.622440 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2"] Sep 10 12:06:34.622545 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.622464 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f2r2p"] Sep 10 12:06:34.622632 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.622580 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.627116 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.627098 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zk8mj\"" Sep 10 12:06:34.627393 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.627373 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 12:06:34.627611 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.627484 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 12:06:34.627679 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.627634 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 12:06:34.627679 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.627672 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:06:34.632611 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.632595 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-gqr7z"] Sep 10 12:06:34.632702 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.632624 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zxzxj"] Sep 10 12:06:34.632758 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.632714 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.635168 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.635152 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 12:06:34.635351 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.635337 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4wjzz\"" Sep 10 12:06:34.635409 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.635338 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 12:06:34.646625 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.646605 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg"] Sep 10 12:06:34.646701 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.646631 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zxzxj" Sep 10 12:06:34.646701 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.646638 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5544b76fcb-gcvqq"] Sep 10 12:06:34.646701 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.646679 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-j4xzv"] Sep 10 12:06:34.646701 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.646694 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zxzxj"] Sep 10 12:06:34.646859 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.646708 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7"] Sep 10 12:06:34.646859 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.646723 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c76cccf54-qpjb6"] Sep 10 12:06:34.646859 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.646735 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn"] Sep 10 12:06:34.646859 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.646746 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn"] Sep 10 12:06:34.646859 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.646761 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f2r2p"] Sep 10 12:06:34.649318 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.649303 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 12:06:34.649452 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.649428 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 12:06:34.649691 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.649678 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tf7wk\"" Sep 10 12:06:34.649779 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.649679 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 12:06:34.691005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.690909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/82e21dee-d039-4ad6-8bee-56da40618432-snapshots\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.691005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.690942 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e21dee-d039-4ad6-8bee-56da40618432-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.691005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.690970 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e21dee-d039-4ad6-8bee-56da40618432-tmp\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.691005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.690997 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xltx8\" (UniqueName: \"kubernetes.io/projected/425cdd5b-5159-418c-953b-24784915bafc-kube-api-access-xltx8\") pod \"service-ca-operator-859f94c4b-pszqg\" (UID: \"425cdd5b-5159-418c-953b-24784915bafc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.691253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691029 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjt9p\" (UniqueName: \"kubernetes.io/projected/82e21dee-d039-4ad6-8bee-56da40618432-kube-api-access-rjt9p\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.691253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691082 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.691253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsrkz\" (UniqueName: \"kubernetes.io/projected/360d3ff8-fa49-49c1-a64c-cc210ba95119-kube-api-access-vsrkz\") pod \"volume-data-source-validator-695c895bd6-g8fhn\" (UID: \"360d3ff8-fa49-49c1-a64c-cc210ba95119\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn" Sep 10 12:06:34.691253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691159 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5dbp\" (UniqueName: \"kubernetes.io/projected/ac90c9b6-ead8-494f-95b6-8afc5abb5239-kube-api-access-n5dbp\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.691253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9665\" (UniqueName: \"kubernetes.io/projected/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-kube-api-access-v9665\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:34.691253 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.691196 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:06:34.691253 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.691213 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5544b76fcb-gcvqq: secret "image-registry-tls" not found Sep 10 12:06:34.691253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691211 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/425cdd5b-5159-418c-953b-24784915bafc-serving-cert\") pod \"service-ca-operator-859f94c4b-pszqg\" (UID: \"425cdd5b-5159-418c-953b-24784915bafc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.691590 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.691268 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls podName:4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:35.191251204 +0000 UTC m=+35.027233794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls") pod "image-registry-5544b76fcb-gcvqq" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9") : secret "image-registry-tls" not found Sep 10 12:06:34.691590 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691316 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-certificates\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.691590 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691350 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e21dee-d039-4ad6-8bee-56da40618432-tmp\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.691590 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691353 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:34.691590 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691393 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-installation-pull-secrets\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.691590 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691417 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.691590 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691450 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/425cdd5b-5159-418c-953b-24784915bafc-config\") pod \"service-ca-operator-859f94c4b-pszqg\" (UID: \"425cdd5b-5159-418c-953b-24784915bafc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.691590 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691490 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.691590 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-bound-sa-token\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.691590 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ca0350c-c2c0-4510-a165-4924c1b0e626-config\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-stats-auth\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691623 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-default-certificate\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691653 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-trusted-ca\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691675 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/82e21dee-d039-4ad6-8bee-56da40618432-snapshots\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691677 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691739 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgqvq\" (UniqueName: \"kubernetes.io/projected/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-kube-api-access-pgqvq\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691786 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82e21dee-d039-4ad6-8bee-56da40618432-serving-cert\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691812 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-ca-trust-extracted\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxd7q\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-kube-api-access-kxd7q\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691866 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zww7b\" (UniqueName: \"kubernetes.io/projected/4ca0350c-c2c0-4510-a165-4924c1b0e626-kube-api-access-zww7b\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691893 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e21dee-d039-4ad6-8bee-56da40618432-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ca0350c-c2c0-4510-a165-4924c1b0e626-trusted-ca\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.691941 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-certificates\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.692084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.692013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-image-registry-private-configuration\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.692698 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.692044 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e21dee-d039-4ad6-8bee-56da40618432-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.692698 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.692097 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ca0350c-c2c0-4510-a165-4924c1b0e626-serving-cert\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.692698 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.692459 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-ca-trust-extracted\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.692698 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.692510 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-trusted-ca\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.692698 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.692533 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e21dee-d039-4ad6-8bee-56da40618432-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.695748 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.695731 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82e21dee-d039-4ad6-8bee-56da40618432-serving-cert\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.695748 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.695739 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-image-registry-private-configuration\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.695866 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.695810 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-installation-pull-secrets\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.706059 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.706042 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxd7q\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-kube-api-access-kxd7q\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.706309 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.706294 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-bound-sa-token\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:34.707881 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.707861 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjt9p\" (UniqueName: \"kubernetes.io/projected/82e21dee-d039-4ad6-8bee-56da40618432-kube-api-access-rjt9p\") pod \"insights-operator-76bcd6ccf5-j4xzv\" (UID: \"82e21dee-d039-4ad6-8bee-56da40618432\") " pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.733304 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.733248 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:34.761752 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.761732 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:06:34.766936 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.766915 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:06:34.792666 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792647 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:34.792736 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792673 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc9957b0-fbe5-44df-9fd4-d799df941d86-cert\") pod \"ingress-canary-zxzxj\" (UID: \"dc9957b0-fbe5-44df-9fd4-d799df941d86\") " pod="openshift-ingress-canary/ingress-canary-zxzxj" Sep 10 12:06:34.792736 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792692 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.792736 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792708 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/425cdd5b-5159-418c-953b-24784915bafc-config\") pod \"service-ca-operator-859f94c4b-pszqg\" (UID: \"425cdd5b-5159-418c-953b-24784915bafc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.792893 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f98jh\" (UniqueName: \"kubernetes.io/projected/d4608600-2ca0-4cb8-a59a-19db4433938e-kube-api-access-f98jh\") pod \"kube-storage-version-migrator-operator-8d7dd4675-w2tt2\" (UID: \"d4608600-2ca0-4cb8-a59a-19db4433938e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.792893 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.792893 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792777 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ca0350c-c2c0-4510-a165-4924c1b0e626-config\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.792893 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.792777 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:06:34.792893 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792827 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-stats-auth\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.792893 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.792846 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:35.292826156 +0000 UTC m=+35.128808749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : configmap references non-existent config key: service-ca.crt Sep 10 12:06:34.792893 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.792847 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:06:34.792893 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792885 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-default-certificate\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.792893 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.792894 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls podName:2e0fe6b0-6ac8-467d-a817-a664c7f1a266 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:35.29287719 +0000 UTC m=+35.128859777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jqrd7" (UID: "2e0fe6b0-6ac8-467d-a817-a664c7f1a266") : secret "samples-operator-tls" not found Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792934 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4608600-2ca0-4cb8-a59a-19db4433938e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-w2tt2\" (UID: \"d4608600-2ca0-4cb8-a59a-19db4433938e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.792939 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:35.292925253 +0000 UTC m=+35.128907831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : secret "router-metrics-certs-default" not found Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792970 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.792994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgqvq\" (UniqueName: \"kubernetes.io/projected/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-kube-api-access-pgqvq\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4608600-2ca0-4cb8-a59a-19db4433938e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-w2tt2\" (UID: \"d4608600-2ca0-4cb8-a59a-19db4433938e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zww7b\" (UniqueName: \"kubernetes.io/projected/4ca0350c-c2c0-4510-a165-4924c1b0e626-kube-api-access-zww7b\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793079 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ca0350c-c2c0-4510-a165-4924c1b0e626-trusted-ca\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.793083 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793140 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ca0350c-c2c0-4510-a165-4924c1b0e626-serving-cert\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793181 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xltx8\" (UniqueName: \"kubernetes.io/projected/425cdd5b-5159-418c-953b-24784915bafc-kube-api-access-xltx8\") pod \"service-ca-operator-859f94c4b-pszqg\" (UID: \"425cdd5b-5159-418c-953b-24784915bafc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793226 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrkz\" (UniqueName: \"kubernetes.io/projected/360d3ff8-fa49-49c1-a64c-cc210ba95119-kube-api-access-vsrkz\") pod \"volume-data-source-validator-695c895bd6-g8fhn\" (UID: \"360d3ff8-fa49-49c1-a64c-cc210ba95119\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793257 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5dcs\" (UniqueName: \"kubernetes.io/projected/06882160-6a41-4d36-af22-75132d2644c1-kube-api-access-n5dcs\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793298 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.793359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793326 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5dbp\" (UniqueName: \"kubernetes.io/projected/ac90c9b6-ead8-494f-95b6-8afc5abb5239-kube-api-access-n5dbp\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.794161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793337 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/425cdd5b-5159-418c-953b-24784915bafc-config\") pod \"service-ca-operator-859f94c4b-pszqg\" (UID: \"425cdd5b-5159-418c-953b-24784915bafc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.794161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793356 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9665\" (UniqueName: \"kubernetes.io/projected/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-kube-api-access-v9665\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:34.794161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793382 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/425cdd5b-5159-418c-953b-24784915bafc-serving-cert\") pod \"service-ca-operator-859f94c4b-pszqg\" (UID: \"425cdd5b-5159-418c-953b-24784915bafc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.794161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793409 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-689zr\" (UniqueName: \"kubernetes.io/projected/dc9957b0-fbe5-44df-9fd4-d799df941d86-kube-api-access-689zr\") pod \"ingress-canary-zxzxj\" (UID: \"dc9957b0-fbe5-44df-9fd4-d799df941d86\") " pod="openshift-ingress-canary/ingress-canary-zxzxj" Sep 10 12:06:34.794161 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.793432 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls podName:b7efda6d-7e77-4bfe-845b-6e766a94b3ba nodeName:}" failed. No retries permitted until 2026-09-10 12:06:35.293416136 +0000 UTC m=+35.129398715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-c59nn" (UID: "b7efda6d-7e77-4bfe-845b-6e766a94b3ba") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:34.794161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793493 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ca0350c-c2c0-4510-a165-4924c1b0e626-config\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.794161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06882160-6a41-4d36-af22-75132d2644c1-tmp-dir\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.794161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.793930 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ca0350c-c2c0-4510-a165-4924c1b0e626-trusted-ca\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.794161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.794127 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:34.794161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.794137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/06882160-6a41-4d36-af22-75132d2644c1-config-volume\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.795366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.795340 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-default-certificate\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.795628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.795612 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ca0350c-c2c0-4510-a165-4924c1b0e626-serving-cert\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.795715 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.795699 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-stats-auth\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.796006 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.795993 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/425cdd5b-5159-418c-953b-24784915bafc-serving-cert\") pod \"service-ca-operator-859f94c4b-pszqg\" (UID: \"425cdd5b-5159-418c-953b-24784915bafc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.805481 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.805457 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgqvq\" (UniqueName: \"kubernetes.io/projected/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-kube-api-access-pgqvq\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:34.806948 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.806924 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zww7b\" (UniqueName: \"kubernetes.io/projected/4ca0350c-c2c0-4510-a165-4924c1b0e626-kube-api-access-zww7b\") pod \"console-operator-85b454874b-gqr7z\" (UID: \"4ca0350c-c2c0-4510-a165-4924c1b0e626\") " pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.808152 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.808133 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5dbp\" (UniqueName: \"kubernetes.io/projected/ac90c9b6-ead8-494f-95b6-8afc5abb5239-kube-api-access-n5dbp\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:34.808743 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.808724 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9665\" (UniqueName: \"kubernetes.io/projected/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-kube-api-access-v9665\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:34.808871 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.808841 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xltx8\" (UniqueName: \"kubernetes.io/projected/425cdd5b-5159-418c-953b-24784915bafc-kube-api-access-xltx8\") pod \"service-ca-operator-859f94c4b-pszqg\" (UID: \"425cdd5b-5159-418c-953b-24784915bafc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.815736 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.815716 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsrkz\" (UniqueName: \"kubernetes.io/projected/360d3ff8-fa49-49c1-a64c-cc210ba95119-kube-api-access-vsrkz\") pod \"volume-data-source-validator-695c895bd6-g8fhn\" (UID: \"360d3ff8-fa49-49c1-a64c-cc210ba95119\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn" Sep 10 12:06:34.815861 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.815850 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" Sep 10 12:06:34.869000 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.868952 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:34.876465 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.876439 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" Sep 10 12:06:34.893766 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.893584 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.895062 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5dcs\" (UniqueName: \"kubernetes.io/projected/06882160-6a41-4d36-af22-75132d2644c1-kube-api-access-n5dcs\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.895114 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.895148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-689zr\" (UniqueName: \"kubernetes.io/projected/dc9957b0-fbe5-44df-9fd4-d799df941d86-kube-api-access-689zr\") pod \"ingress-canary-zxzxj\" (UID: \"dc9957b0-fbe5-44df-9fd4-d799df941d86\") " pod="openshift-ingress-canary/ingress-canary-zxzxj" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.895173 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06882160-6a41-4d36-af22-75132d2644c1-tmp-dir\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.895215 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/06882160-6a41-4d36-af22-75132d2644c1-config-volume\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.895249 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc9957b0-fbe5-44df-9fd4-d799df941d86-cert\") pod \"ingress-canary-zxzxj\" (UID: \"dc9957b0-fbe5-44df-9fd4-d799df941d86\") " pod="openshift-ingress-canary/ingress-canary-zxzxj" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.895292 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f98jh\" (UniqueName: \"kubernetes.io/projected/d4608600-2ca0-4cb8-a59a-19db4433938e-kube-api-access-f98jh\") pod \"kube-storage-version-migrator-operator-8d7dd4675-w2tt2\" (UID: \"d4608600-2ca0-4cb8-a59a-19db4433938e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.895342 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4608600-2ca0-4cb8-a59a-19db4433938e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-w2tt2\" (UID: \"d4608600-2ca0-4cb8-a59a-19db4433938e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.895397 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4608600-2ca0-4cb8-a59a-19db4433938e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-w2tt2\" (UID: \"d4608600-2ca0-4cb8-a59a-19db4433938e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.896372 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06882160-6a41-4d36-af22-75132d2644c1-tmp-dir\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.896791 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:06:34.897984 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:34.896852 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls podName:06882160-6a41-4d36-af22-75132d2644c1 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:35.396832638 +0000 UTC m=+35.232815219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls") pod "dns-default-f2r2p" (UID: "06882160-6a41-4d36-af22-75132d2644c1") : secret "dns-default-metrics-tls" not found Sep 10 12:06:34.898717 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.898623 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/06882160-6a41-4d36-af22-75132d2644c1-config-volume\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.899184 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.899143 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4608600-2ca0-4cb8-a59a-19db4433938e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-w2tt2\" (UID: \"d4608600-2ca0-4cb8-a59a-19db4433938e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.901361 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.901336 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4608600-2ca0-4cb8-a59a-19db4433938e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-w2tt2\" (UID: \"d4608600-2ca0-4cb8-a59a-19db4433938e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.902495 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.902473 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc9957b0-fbe5-44df-9fd4-d799df941d86-cert\") pod \"ingress-canary-zxzxj\" (UID: \"dc9957b0-fbe5-44df-9fd4-d799df941d86\") " pod="openshift-ingress-canary/ingress-canary-zxzxj" Sep 10 12:06:34.910995 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.910593 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5dcs\" (UniqueName: \"kubernetes.io/projected/06882160-6a41-4d36-af22-75132d2644c1-kube-api-access-n5dcs\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:34.914383 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.914209 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-689zr\" (UniqueName: \"kubernetes.io/projected/dc9957b0-fbe5-44df-9fd4-d799df941d86-kube-api-access-689zr\") pod \"ingress-canary-zxzxj\" (UID: \"dc9957b0-fbe5-44df-9fd4-d799df941d86\") " pod="openshift-ingress-canary/ingress-canary-zxzxj" Sep 10 12:06:34.915157 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.915113 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f98jh\" (UniqueName: \"kubernetes.io/projected/d4608600-2ca0-4cb8-a59a-19db4433938e-kube-api-access-f98jh\") pod \"kube-storage-version-migrator-operator-8d7dd4675-w2tt2\" (UID: \"d4608600-2ca0-4cb8-a59a-19db4433938e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.930126 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.930014 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" Sep 10 12:06:34.954216 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:34.954080 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zxzxj" Sep 10 12:06:35.119711 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.119652 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-j4xzv"] Sep 10 12:06:35.122988 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:35.122963 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e21dee_d039_4ad6_8bee_56da40618432.slice/crio-fb69451ecb45e5dbe742246cb81246e16b85fd704f9f18f5dc442bfdcfd04a52 WatchSource:0}: Error finding container fb69451ecb45e5dbe742246cb81246e16b85fd704f9f18f5dc442bfdcfd04a52: Status 404 returned error can't find the container with id fb69451ecb45e5dbe742246cb81246e16b85fd704f9f18f5dc442bfdcfd04a52 Sep 10 12:06:35.170948 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.170925 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-gqr7z"] Sep 10 12:06:35.173602 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.173580 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg"] Sep 10 12:06:35.174292 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:35.174263 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca0350c_c2c0_4510_a165_4924c1b0e626.slice/crio-96039e8b841927fa7fe1048f13d57ab55e5ee23d878d0ba33ec4112b37b9f959 WatchSource:0}: Error finding container 96039e8b841927fa7fe1048f13d57ab55e5ee23d878d0ba33ec4112b37b9f959: Status 404 returned error can't find the container with id 96039e8b841927fa7fe1048f13d57ab55e5ee23d878d0ba33ec4112b37b9f959 Sep 10 12:06:35.177502 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:35.177484 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425cdd5b_5159_418c_953b_24784915bafc.slice/crio-5e0f0476fdfbdd3c8e1a5bd9b602b99f66bdcdbaa909b89dd467454c59b959cd WatchSource:0}: Error finding container 5e0f0476fdfbdd3c8e1a5bd9b602b99f66bdcdbaa909b89dd467454c59b959cd: Status 404 returned error can't find the container with id 5e0f0476fdfbdd3c8e1a5bd9b602b99f66bdcdbaa909b89dd467454c59b959cd Sep 10 12:06:35.197882 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.197858 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:35.198014 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.197998 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:06:35.198078 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.198017 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5544b76fcb-gcvqq: secret "image-registry-tls" not found Sep 10 12:06:35.198078 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.198067 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls podName:4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:36.198052084 +0000 UTC m=+36.034034651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls") pod "image-registry-5544b76fcb-gcvqq" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9") : secret "image-registry-tls" not found Sep 10 12:06:35.200058 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.200039 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn"] Sep 10 12:06:35.202387 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:35.202370 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360d3ff8_fa49_49c1_a64c_cc210ba95119.slice/crio-2798436df22334127b1ed92d143ed7136d126bb9a1f37ac4400c2785381ff2bb WatchSource:0}: Error finding container 2798436df22334127b1ed92d143ed7136d126bb9a1f37ac4400c2785381ff2bb: Status 404 returned error can't find the container with id 2798436df22334127b1ed92d143ed7136d126bb9a1f37ac4400c2785381ff2bb Sep 10 12:06:35.233350 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.233328 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2"] Sep 10 12:06:35.236163 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:35.236144 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4608600_2ca0_4cb8_a59a_19db4433938e.slice/crio-87a07213cd6b6d35f24bfb6b3cff272c7cc2a16b1d54d763d3d3c98ee3607a50 WatchSource:0}: Error finding container 87a07213cd6b6d35f24bfb6b3cff272c7cc2a16b1d54d763d3d3c98ee3607a50: Status 404 returned error can't find the container with id 87a07213cd6b6d35f24bfb6b3cff272c7cc2a16b1d54d763d3d3c98ee3607a50 Sep 10 12:06:35.263071 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.263046 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zxzxj"] Sep 10 12:06:35.266220 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:35.266197 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9957b0_fbe5_44df_9fd4_d799df941d86.slice/crio-ef5537b07b79f7398f198a6578d6a38bc184b3944cfd30cf7c2e2162bab52a1c WatchSource:0}: Error finding container ef5537b07b79f7398f198a6578d6a38bc184b3944cfd30cf7c2e2162bab52a1c: Status 404 returned error can't find the container with id ef5537b07b79f7398f198a6578d6a38bc184b3944cfd30cf7c2e2162bab52a1c Sep 10 12:06:35.299140 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.299107 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:35.299244 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.299148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:35.299244 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.299181 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:35.299244 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.299217 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:06:35.299406 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.299269 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls podName:2e0fe6b0-6ac8-467d-a817-a664c7f1a266 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:36.299252791 +0000 UTC m=+36.135235378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jqrd7" (UID: "2e0fe6b0-6ac8-467d-a817-a664c7f1a266") : secret "samples-operator-tls" not found Sep 10 12:06:35.299406 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.299277 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:35.299406 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.299302 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:36.299286717 +0000 UTC m=+36.135269285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : configmap references non-existent config key: service-ca.crt Sep 10 12:06:35.299406 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.299323 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls podName:b7efda6d-7e77-4bfe-845b-6e766a94b3ba nodeName:}" failed. No retries permitted until 2026-09-10 12:06:36.299316416 +0000 UTC m=+36.135298980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-c59nn" (UID: "b7efda6d-7e77-4bfe-845b-6e766a94b3ba") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:35.299406 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.299215 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:35.299406 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.299341 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:06:35.299406 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.299372 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:36.299359472 +0000 UTC m=+36.135342041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : secret "router-metrics-certs-default" not found Sep 10 12:06:35.400750 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.400721 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:35.400908 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.400885 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:06:35.400966 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:35.400954 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls podName:06882160-6a41-4d36-af22-75132d2644c1 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:36.4009348 +0000 UTC m=+36.236917377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls") pod "dns-default-f2r2p" (UID: "06882160-6a41-4d36-af22-75132d2644c1") : secret "dns-default-metrics-tls" not found Sep 10 12:06:35.762430 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.762397 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:06:35.762556 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.762409 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:06:35.766435 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.766412 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:06:35.767908 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.767881 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:06:35.768338 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.767918 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:06:35.768338 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.767918 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llnv7\"" Sep 10 12:06:35.768338 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.767953 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vr5lb\"" Sep 10 12:06:35.941877 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.941843 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" event={"ID":"d4608600-2ca0-4cb8-a59a-19db4433938e","Type":"ContainerStarted","Data":"87a07213cd6b6d35f24bfb6b3cff272c7cc2a16b1d54d763d3d3c98ee3607a50"} Sep 10 12:06:35.944252 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.944204 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn" event={"ID":"360d3ff8-fa49-49c1-a64c-cc210ba95119","Type":"ContainerStarted","Data":"2798436df22334127b1ed92d143ed7136d126bb9a1f37ac4400c2785381ff2bb"} Sep 10 12:06:35.945849 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.945812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" event={"ID":"82e21dee-d039-4ad6-8bee-56da40618432","Type":"ContainerStarted","Data":"fb69451ecb45e5dbe742246cb81246e16b85fd704f9f18f5dc442bfdcfd04a52"} Sep 10 12:06:35.947425 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.947401 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" event={"ID":"425cdd5b-5159-418c-953b-24784915bafc","Type":"ContainerStarted","Data":"5e0f0476fdfbdd3c8e1a5bd9b602b99f66bdcdbaa909b89dd467454c59b959cd"} Sep 10 12:06:35.949424 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.949401 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" event={"ID":"4ca0350c-c2c0-4510-a165-4924c1b0e626","Type":"ContainerStarted","Data":"96039e8b841927fa7fe1048f13d57ab55e5ee23d878d0ba33ec4112b37b9f959"} Sep 10 12:06:35.951747 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:35.951724 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zxzxj" event={"ID":"dc9957b0-fbe5-44df-9fd4-d799df941d86","Type":"ContainerStarted","Data":"ef5537b07b79f7398f198a6578d6a38bc184b3944cfd30cf7c2e2162bab52a1c"} Sep 10 12:06:36.210202 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:36.209590 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:36.210202 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.209785 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:06:36.210202 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.209800 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5544b76fcb-gcvqq: secret "image-registry-tls" not found Sep 10 12:06:36.210202 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.209856 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls podName:4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:38.209838359 +0000 UTC m=+38.045820948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls") pod "image-registry-5544b76fcb-gcvqq" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9") : secret "image-registry-tls" not found Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:36.311152 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:36.311420 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:36.311462 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:36.311513 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.311350 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.311703 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls podName:2e0fe6b0-6ac8-467d-a817-a664c7f1a266 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:38.311684948 +0000 UTC m=+38.147667534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jqrd7" (UID: "2e0fe6b0-6ac8-467d-a817-a664c7f1a266") : secret "samples-operator-tls" not found Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.312111 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:38.312095666 +0000 UTC m=+38.148078236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : configmap references non-existent config key: service-ca.crt Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.312181 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.312217 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:38.312205771 +0000 UTC m=+38.148188342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : secret "router-metrics-certs-default" not found Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.311641 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:36.312326 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.312250 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls podName:b7efda6d-7e77-4bfe-845b-6e766a94b3ba nodeName:}" failed. No retries permitted until 2026-09-10 12:06:38.312241014 +0000 UTC m=+38.148223583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-c59nn" (UID: "b7efda6d-7e77-4bfe-845b-6e766a94b3ba") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:36.412028 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:36.411992 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:36.412683 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.412238 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:06:36.412683 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:36.412311 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls podName:06882160-6a41-4d36-af22-75132d2644c1 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:38.412292416 +0000 UTC m=+38.248274985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls") pod "dns-default-f2r2p" (UID: "06882160-6a41-4d36-af22-75132d2644c1") : secret "dns-default-metrics-tls" not found Sep 10 12:06:37.964289 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:37.964188 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn" event={"ID":"360d3ff8-fa49-49c1-a64c-cc210ba95119","Type":"ContainerStarted","Data":"941a78d90326beb6fa3b71283982f098e64e7ea0dc4794e71a12da7b97bba0e8"} Sep 10 12:06:38.082245 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:38.082187 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:38.230881 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:38.230805 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:38.231025 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.230978 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:06:38.231025 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.230999 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5544b76fcb-gcvqq: secret "image-registry-tls" not found Sep 10 12:06:38.231139 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.231070 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls podName:4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:42.231049568 +0000 UTC m=+42.067032155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls") pod "image-registry-5544b76fcb-gcvqq" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9") : secret "image-registry-tls" not found Sep 10 12:06:38.275422 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:38.275377 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:38.331998 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:38.331944 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:38.332165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:38.332004 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:38.332165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:38.332040 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:38.332165 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.332065 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:06:38.332165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:38.332084 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:38.332165 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.332125 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls podName:2e0fe6b0-6ac8-467d-a817-a664c7f1a266 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:42.332109869 +0000 UTC m=+42.168092440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jqrd7" (UID: "2e0fe6b0-6ac8-467d-a817-a664c7f1a266") : secret "samples-operator-tls" not found Sep 10 12:06:38.332439 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.332183 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:42.33216342 +0000 UTC m=+42.168145988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : configmap references non-existent config key: service-ca.crt Sep 10 12:06:38.332439 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.332225 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:38.332439 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.332233 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:06:38.332439 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.332283 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:42.332267611 +0000 UTC m=+42.168250193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : secret "router-metrics-certs-default" not found Sep 10 12:06:38.332439 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.332318 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls podName:b7efda6d-7e77-4bfe-845b-6e766a94b3ba nodeName:}" failed. No retries permitted until 2026-09-10 12:06:42.332306399 +0000 UTC m=+42.168288963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-c59nn" (UID: "b7efda6d-7e77-4bfe-845b-6e766a94b3ba") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:38.433929 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:38.433870 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:38.434096 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.434011 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:06:38.434150 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:38.434102 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls podName:06882160-6a41-4d36-af22-75132d2644c1 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:42.434081673 +0000 UTC m=+42.270064254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls") pod "dns-default-f2r2p" (UID: "06882160-6a41-4d36-af22-75132d2644c1") : secret "dns-default-metrics-tls" not found Sep 10 12:06:39.792413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:39.792384 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:39.869047 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:39.869021 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:40.786244 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:40.786144 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:40.887682 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:40.887633 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:41.966367 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:41.966305 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g8fhn" podStartSLOduration=8.92545982 podStartE2EDuration="10.966284626s" totalImagesPullingTime="2.040824806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:37.984445336 +0000 UTC m=+37.820427935" watchObservedRunningTime="2026-09-10 12:06:41.966284626 +0000 UTC m=+41.802267219" Sep 10 12:06:41.967242 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:41.967222 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hxpnq"] Sep 10 12:06:41.992553 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:41.992526 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hxpnq"] Sep 10 12:06:41.992697 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:41.992640 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-hxpnq" Sep 10 12:06:41.995484 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:41.995455 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ch8lz\"" Sep 10 12:06:42.066292 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.066263 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vdsh\" (UniqueName: \"kubernetes.io/projected/b323b121-1b1d-4a05-ac31-6c9bbd93bb40-kube-api-access-8vdsh\") pod \"network-check-source-685456655f-hxpnq\" (UID: \"b323b121-1b1d-4a05-ac31-6c9bbd93bb40\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hxpnq" Sep 10 12:06:42.166960 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.166926 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vdsh\" (UniqueName: \"kubernetes.io/projected/b323b121-1b1d-4a05-ac31-6c9bbd93bb40-kube-api-access-8vdsh\") pod \"network-check-source-685456655f-hxpnq\" (UID: \"b323b121-1b1d-4a05-ac31-6c9bbd93bb40\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hxpnq" Sep 10 12:06:42.171602 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.171573 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:42.183311 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.183284 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vdsh\" (UniqueName: \"kubernetes.io/projected/b323b121-1b1d-4a05-ac31-6c9bbd93bb40-kube-api-access-8vdsh\") pod \"network-check-source-685456655f-hxpnq\" (UID: \"b323b121-1b1d-4a05-ac31-6c9bbd93bb40\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hxpnq" Sep 10 12:06:42.267605 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.267521 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:42.267719 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.267667 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:06:42.267719 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.267682 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5544b76fcb-gcvqq: secret "image-registry-tls" not found Sep 10 12:06:42.267811 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.267735 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls podName:4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:50.267718213 +0000 UTC m=+50.103700788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls") pod "image-registry-5544b76fcb-gcvqq" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9") : secret "image-registry-tls" not found Sep 10 12:06:42.303545 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.303521 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-hxpnq" Sep 10 12:06:42.368366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.368335 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:42.368479 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.368386 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:42.368479 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.368421 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:42.368479 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.368461 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:42.368621 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.368499 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:06:42.368621 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.368573 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:06:42.368717 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.368646 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:42.368717 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.368580 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls podName:2e0fe6b0-6ac8-467d-a817-a664c7f1a266 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:50.368539165 +0000 UTC m=+50.204521729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jqrd7" (UID: "2e0fe6b0-6ac8-467d-a817-a664c7f1a266") : secret "samples-operator-tls" not found Sep 10 12:06:42.368717 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.368688 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:50.368669365 +0000 UTC m=+50.204651944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : secret "router-metrics-certs-default" not found Sep 10 12:06:42.368717 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.368705 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls podName:b7efda6d-7e77-4bfe-845b-6e766a94b3ba nodeName:}" failed. No retries permitted until 2026-09-10 12:06:50.368694966 +0000 UTC m=+50.204677535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-c59nn" (UID: "b7efda6d-7e77-4bfe-845b-6e766a94b3ba") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:42.368894 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.368730 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:50.368714555 +0000 UTC m=+50.204697134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : configmap references non-existent config key: service-ca.crt Sep 10 12:06:42.468809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.468784 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:42.468953 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.468930 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:06:42.469080 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:42.468997 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls podName:06882160-6a41-4d36-af22-75132d2644c1 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:50.46898043 +0000 UTC m=+50.304963012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls") pod "dns-default-f2r2p" (UID: "06882160-6a41-4d36-af22-75132d2644c1") : secret "dns-default-metrics-tls" not found Sep 10 12:06:42.572745 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.572670 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:42.651238 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:42.651198 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:43.146224 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.146196 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:43.246683 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.246634 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:43.571781 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.571724 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hxpnq"] Sep 10 12:06:43.604814 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:06:43.604763 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb323b121_1b1d_4a05_ac31_6c9bbd93bb40.slice/crio-198b81780510279d224c617a66e85a13b2642c43baefa83fb743ddf953c93c5b WatchSource:0}: Error finding container 198b81780510279d224c617a66e85a13b2642c43baefa83fb743ddf953c93c5b: Status 404 returned error can't find the container with id 198b81780510279d224c617a66e85a13b2642c43baefa83fb743ddf953c93c5b Sep 10 12:06:43.986022 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.985989 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" event={"ID":"d4608600-2ca0-4cb8-a59a-19db4433938e","Type":"ContainerStarted","Data":"25ef8c626ae2ba39ecf3714cdb0c230f452acbed4e437105205b364fb6c624ba"} Sep 10 12:06:43.987304 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.987280 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-hxpnq" event={"ID":"b323b121-1b1d-4a05-ac31-6c9bbd93bb40","Type":"ContainerStarted","Data":"198b81780510279d224c617a66e85a13b2642c43baefa83fb743ddf953c93c5b"} Sep 10 12:06:43.990241 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.990216 2555 generic.go:356] "Generic (PLEG): container finished" podID="91fb1004-c0e8-4a27-8a30-9cdc9c80a7db" containerID="3983f381c2c0200e0463871fd5451a40cc558827ac51d209c41a57f9217d0987" exitCode=0 Sep 10 12:06:43.990388 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.990289 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whvn7" event={"ID":"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db","Type":"ContainerDied","Data":"3983f381c2c0200e0463871fd5451a40cc558827ac51d209c41a57f9217d0987"} Sep 10 12:06:43.992059 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.992037 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" event={"ID":"82e21dee-d039-4ad6-8bee-56da40618432","Type":"ContainerStarted","Data":"acf8034c24a43f09ad78511f54da21553b6538e525cb9a0e2632f5fcb5c728d3"} Sep 10 12:06:43.993673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.993651 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" event={"ID":"425cdd5b-5159-418c-953b-24784915bafc","Type":"ContainerStarted","Data":"d8a160bd14d9709a9aff9be7e1e7db1944590dfdf0c6393cb9bd1e1819502458"} Sep 10 12:06:43.995408 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.995380 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/0.log" Sep 10 12:06:43.995490 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.995427 2555 generic.go:356] "Generic (PLEG): container finished" podID="4ca0350c-c2c0-4510-a165-4924c1b0e626" containerID="cbfb9e73b4e60ab5218b7bfd0184f9cbd99169878fc6f2c46b2835a75c582222" exitCode=255 Sep 10 12:06:43.995546 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.995515 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" event={"ID":"4ca0350c-c2c0-4510-a165-4924c1b0e626","Type":"ContainerDied","Data":"cbfb9e73b4e60ab5218b7bfd0184f9cbd99169878fc6f2c46b2835a75c582222"} Sep 10 12:06:43.995712 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.995691 2555 scope.go:117] "RemoveContainer" containerID="cbfb9e73b4e60ab5218b7bfd0184f9cbd99169878fc6f2c46b2835a75c582222" Sep 10 12:06:43.997665 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:43.997643 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zxzxj" event={"ID":"dc9957b0-fbe5-44df-9fd4-d799df941d86","Type":"ContainerStarted","Data":"f4465d79c8cb2e4efc9b8ba3844b330960f97d57a9653f0418893e84858be617"} Sep 10 12:06:44.018786 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:44.018743 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" podStartSLOduration=4.955223042 podStartE2EDuration="13.018716749s" totalImagesPullingTime="8.063493707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:44.01866055 +0000 UTC m=+43.854643135" watchObservedRunningTime="2026-09-10 12:06:44.018716749 +0000 UTC m=+43.854699337" Sep 10 12:06:44.054348 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:44.054295 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zxzxj" podStartSLOduration=2.021314839 podStartE2EDuration="10.054275524s" totalImagesPullingTime="8.032960685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:44.053089178 +0000 UTC m=+43.889071765" watchObservedRunningTime="2026-09-10 12:06:44.054275524 +0000 UTC m=+43.890258104" Sep 10 12:06:44.149101 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:44.149043 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" podStartSLOduration=14.973398613 podStartE2EDuration="23.149020713s" totalImagesPullingTime="8.1756221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:44.148277517 +0000 UTC m=+43.984260104" watchObservedRunningTime="2026-09-10 12:06:44.149020713 +0000 UTC m=+43.985003299" Sep 10 12:06:44.201379 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:44.201323 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" podStartSLOduration=5.079268725 podStartE2EDuration="13.201303039s" totalImagesPullingTime="8.122034314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:44.197985675 +0000 UTC m=+44.033968261" watchObservedRunningTime="2026-09-10 12:06:44.201303039 +0000 UTC m=+44.037285623" Sep 10 12:06:44.514940 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:44.514906 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:44.613105 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:44.613073 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:44.869601 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:44.869511 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:44.869757 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:44.869597 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:45.005135 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.005103 2555 generic.go:356] "Generic (PLEG): container finished" podID="91fb1004-c0e8-4a27-8a30-9cdc9c80a7db" containerID="4cebd78ede626a68a8cee738c3af424a20cf755c1114cb7ddbbe449124506648" exitCode=0 Sep 10 12:06:45.005304 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.005142 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whvn7" event={"ID":"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db","Type":"ContainerDied","Data":"4cebd78ede626a68a8cee738c3af424a20cf755c1114cb7ddbbe449124506648"} Sep 10 12:06:45.006858 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.006839 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/1.log" Sep 10 12:06:45.007242 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.007228 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/0.log" Sep 10 12:06:45.007332 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.007258 2555 generic.go:356] "Generic (PLEG): container finished" podID="4ca0350c-c2c0-4510-a165-4924c1b0e626" containerID="5c3febc66a8669c07a4efed25b441d0e9a26fc735e09c355a605e4b5e9d5b3bb" exitCode=255 Sep 10 12:06:45.007332 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.007287 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" event={"ID":"4ca0350c-c2c0-4510-a165-4924c1b0e626","Type":"ContainerDied","Data":"5c3febc66a8669c07a4efed25b441d0e9a26fc735e09c355a605e4b5e9d5b3bb"} Sep 10 12:06:45.007494 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.007339 2555 scope.go:117] "RemoveContainer" containerID="cbfb9e73b4e60ab5218b7bfd0184f9cbd99169878fc6f2c46b2835a75c582222" Sep 10 12:06:45.007607 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.007591 2555 scope.go:117] "RemoveContainer" containerID="5c3febc66a8669c07a4efed25b441d0e9a26fc735e09c355a605e4b5e9d5b3bb" Sep 10 12:06:45.007760 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:45.007740 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-gqr7z_openshift-console-operator(4ca0350c-c2c0-4510-a165-4924c1b0e626)\"" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" podUID="4ca0350c-c2c0-4510-a165-4924c1b0e626" Sep 10 12:06:45.428092 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.428007 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:45.474528 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.474497 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8k428"] Sep 10 12:06:45.500144 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.500112 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.506989 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.506909 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 12:06:45.507737 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.507712 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bp4gw\"" Sep 10 12:06:45.511340 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.511315 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 12:06:45.512660 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.512636 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8k428"] Sep 10 12:06:45.593538 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.593502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cfb6379-1e32-4997-b643-6ac043560089-crio-socket\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.593719 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.593601 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cfb6379-1e32-4997-b643-6ac043560089-data-volume\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.593719 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.593639 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.593810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.593758 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b729h\" (UniqueName: \"kubernetes.io/projected/2cfb6379-1e32-4997-b643-6ac043560089-kube-api-access-b729h\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.593854 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.593808 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.602318 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.602280 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:45.694697 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.694612 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b729h\" (UniqueName: \"kubernetes.io/projected/2cfb6379-1e32-4997-b643-6ac043560089-kube-api-access-b729h\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.694697 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.694662 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.694697 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.694709 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cfb6379-1e32-4997-b643-6ac043560089-crio-socket\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.694953 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:45.694835 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:06:45.694953 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.694879 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cfb6379-1e32-4997-b643-6ac043560089-data-volume\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.694953 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:45.694899 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls podName:2cfb6379-1e32-4997-b643-6ac043560089 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:46.194880251 +0000 UTC m=+46.030862842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k428" (UID: "2cfb6379-1e32-4997-b643-6ac043560089") : secret "insights-runtime-extractor-tls" not found Sep 10 12:06:45.694953 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.694904 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cfb6379-1e32-4997-b643-6ac043560089-crio-socket\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.695223 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.694960 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.695223 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:45.695029 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:06:45.695223 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:45.695092 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm podName:2cfb6379-1e32-4997-b643-6ac043560089 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:46.195076295 +0000 UTC m=+46.031058859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8k428" (UID: "2cfb6379-1e32-4997-b643-6ac043560089") : configmap "kube-rbac-proxy" not found Sep 10 12:06:45.695381 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.695251 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cfb6379-1e32-4997-b643-6ac043560089-data-volume\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.708918 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.708892 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b729h\" (UniqueName: \"kubernetes.io/projected/2cfb6379-1e32-4997-b643-6ac043560089-kube-api-access-b729h\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:45.740337 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.740309 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:45.841468 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.841383 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:45.969352 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:45.969281 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:46.012155 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:46.012132 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/1.log" Sep 10 12:06:46.012545 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:46.012522 2555 scope.go:117] "RemoveContainer" containerID="5c3febc66a8669c07a4efed25b441d0e9a26fc735e09c355a605e4b5e9d5b3bb" Sep 10 12:06:46.012761 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:46.012734 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-gqr7z_openshift-console-operator(4ca0350c-c2c0-4510-a165-4924c1b0e626)\"" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" podUID="4ca0350c-c2c0-4510-a165-4924c1b0e626" Sep 10 12:06:46.016156 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:46.016135 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-whvn7" event={"ID":"91fb1004-c0e8-4a27-8a30-9cdc9c80a7db","Type":"ContainerStarted","Data":"ae92b60f534035e4904136724ff1cc3c95c32b7b42ac710332ee489d65ca73a9"} Sep 10 12:06:46.066662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:46.066619 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-whvn7" podStartSLOduration=7.981214889 podStartE2EDuration="45.066606098s" totalImagesPullingTime="37.085391209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:46.065330933 +0000 UTC m=+45.901313518" watchObservedRunningTime="2026-09-10 12:06:46.066606098 +0000 UTC m=+45.902588695" Sep 10 12:06:46.199552 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:46.199524 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:46.199697 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:46.199637 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:06:46.199697 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:46.199659 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:46.199813 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:46.199702 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm podName:2cfb6379-1e32-4997-b643-6ac043560089 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:47.199683249 +0000 UTC m=+47.035665819 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8k428" (UID: "2cfb6379-1e32-4997-b643-6ac043560089") : configmap "kube-rbac-proxy" not found Sep 10 12:06:46.199813 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:46.199761 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:06:46.199907 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:46.199828 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls podName:2cfb6379-1e32-4997-b643-6ac043560089 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:47.199810983 +0000 UTC m=+47.035793561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k428" (UID: "2cfb6379-1e32-4997-b643-6ac043560089") : secret "insights-runtime-extractor-tls" not found Sep 10 12:06:46.210303 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:46.210271 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:46.308169 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:46.308105 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:46.335867 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:46.335844 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8c75j_43c48f08-c122-48e4-8f44-b47250e2fdd5/dns-node-resolver/0.log" Sep 10 12:06:46.451170 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:46.451142 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:47.209730 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:47.209693 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:47.209919 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:47.209825 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:06:47.209919 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:47.209846 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:47.209919 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:47.209897 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm podName:2cfb6379-1e32-4997-b643-6ac043560089 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:49.209876675 +0000 UTC m=+49.045859238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8k428" (UID: "2cfb6379-1e32-4997-b643-6ac043560089") : configmap "kube-rbac-proxy" not found Sep 10 12:06:47.210095 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:47.209974 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:06:47.210095 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:47.210030 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls podName:2cfb6379-1e32-4997-b643-6ac043560089 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:49.210014904 +0000 UTC m=+49.045997474 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k428" (UID: "2cfb6379-1e32-4997-b643-6ac043560089") : secret "insights-runtime-extractor-tls" not found Sep 10 12:06:47.335522 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:47.335492 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sqwkr_d733d7a3-21a9-41a1-a4c4-ffbf87537283/node-ca/0.log" Sep 10 12:06:47.798203 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:47.798164 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:47.869207 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:47.869177 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:47.934128 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:47.934098 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zxzxj_dc9957b0-fbe5-44df-9fd4-d799df941d86/serve-healthcheck-canary/0.log" Sep 10 12:06:49.031204 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:49.031170 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-hxpnq" event={"ID":"b323b121-1b1d-4a05-ac31-6c9bbd93bb40","Type":"ContainerStarted","Data":"833571ced3112aa4e8b0ce98ca2ea184e04545d3d4b9226896634a0ec74153fb"} Sep 10 12:06:49.103706 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:49.103677 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:49.228425 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:49.228389 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:49.228613 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:49.228463 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:49.228613 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:49.228531 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:06:49.228613 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:49.228610 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls podName:2cfb6379-1e32-4997-b643-6ac043560089 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:53.228596663 +0000 UTC m=+53.064579226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k428" (UID: "2cfb6379-1e32-4997-b643-6ac043560089") : secret "insights-runtime-extractor-tls" not found Sep 10 12:06:49.228777 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:49.228533 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:06:49.228777 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:49.228654 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm podName:2cfb6379-1e32-4997-b643-6ac043560089 nodeName:}" failed. No retries permitted until 2026-09-10 12:06:53.228643142 +0000 UTC m=+53.064625706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8k428" (UID: "2cfb6379-1e32-4997-b643-6ac043560089") : configmap "kube-rbac-proxy" not found Sep 10 12:06:50.339083 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:50.339041 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:06:50.339845 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.339806 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:06:50.339845 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.339832 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5544b76fcb-gcvqq: secret "image-registry-tls" not found Sep 10 12:06:50.339991 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.339891 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls podName:4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9 nodeName:}" failed. No retries permitted until 2026-09-10 12:07:06.339873264 +0000 UTC m=+66.175855842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls") pod "image-registry-5544b76fcb-gcvqq" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9") : secret "image-registry-tls" not found Sep 10 12:06:50.440756 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:50.440726 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:06:50.440919 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:50.440773 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:50.440919 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:50.440807 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:06:50.440919 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.440882 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:06:50.441080 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.440884 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:06:50.441080 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.440937 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls podName:2e0fe6b0-6ac8-467d-a817-a664c7f1a266 nodeName:}" failed. No retries permitted until 2026-09-10 12:07:06.440923613 +0000 UTC m=+66.276906180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-jqrd7" (UID: "2e0fe6b0-6ac8-467d-a817-a664c7f1a266") : secret "samples-operator-tls" not found Sep 10 12:06:50.441080 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:50.440966 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:06:50.441080 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.441016 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:07:06.440992078 +0000 UTC m=+66.276974643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : configmap references non-existent config key: service-ca.crt Sep 10 12:06:50.441080 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.441062 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs podName:ac90c9b6-ead8-494f-95b6-8afc5abb5239 nodeName:}" failed. No retries permitted until 2026-09-10 12:07:06.441050494 +0000 UTC m=+66.277033061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs") pod "router-default-5c76cccf54-qpjb6" (UID: "ac90c9b6-ead8-494f-95b6-8afc5abb5239") : secret "router-metrics-certs-default" not found Sep 10 12:06:50.441295 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.441275 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:50.441401 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.441330 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls podName:b7efda6d-7e77-4bfe-845b-6e766a94b3ba nodeName:}" failed. No retries permitted until 2026-09-10 12:07:06.441316233 +0000 UTC m=+66.277298822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-c59nn" (UID: "b7efda6d-7e77-4bfe-845b-6e766a94b3ba") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:06:50.542341 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:50.542315 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:06:50.542444 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.542417 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:06:50.542482 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:50.542459 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls podName:06882160-6a41-4d36-af22-75132d2644c1 nodeName:}" failed. No retries permitted until 2026-09-10 12:07:06.542445357 +0000 UTC m=+66.378427922 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls") pod "dns-default-f2r2p" (UID: "06882160-6a41-4d36-af22-75132d2644c1") : secret "dns-default-metrics-tls" not found Sep 10 12:06:50.586039 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:50.586014 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:51.343585 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:51.343540 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:51.493247 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:51.493215 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:52.570767 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:52.570727 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:52.646101 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:52.646069 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:53.266088 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:53.266057 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:53.266253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:53.266132 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:53.266253 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:53.266205 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:06:53.266351 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:53.266272 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls podName:2cfb6379-1e32-4997-b643-6ac043560089 nodeName:}" failed. No retries permitted until 2026-09-10 12:07:01.266255705 +0000 UTC m=+61.102238268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k428" (UID: "2cfb6379-1e32-4997-b643-6ac043560089") : secret "insights-runtime-extractor-tls" not found Sep 10 12:06:53.266656 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:53.266639 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cfb6379-1e32-4997-b643-6ac043560089-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:06:53.579490 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:53.579406 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:54.442546 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:54.442509 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:54.623861 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:54.623833 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:54.725585 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:54.725483 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:54.869740 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:54.869709 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:54.869907 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:54.869751 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:06:54.870068 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:54.870049 2555 scope.go:117] "RemoveContainer" containerID="5c3febc66a8669c07a4efed25b441d0e9a26fc735e09c355a605e4b5e9d5b3bb" Sep 10 12:06:55.051723 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:55.051699 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/2.log" Sep 10 12:06:55.052110 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:55.052094 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/1.log" Sep 10 12:06:55.052168 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:55.052132 2555 generic.go:356] "Generic (PLEG): container finished" podID="4ca0350c-c2c0-4510-a165-4924c1b0e626" containerID="3f2943fbb48f495d5dc27776488e4886788a9ad38d8d3288124b6e170bab690c" exitCode=255 Sep 10 12:06:55.052219 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:55.052204 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" event={"ID":"4ca0350c-c2c0-4510-a165-4924c1b0e626","Type":"ContainerDied","Data":"3f2943fbb48f495d5dc27776488e4886788a9ad38d8d3288124b6e170bab690c"} Sep 10 12:06:55.052267 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:55.052256 2555 scope.go:117] "RemoveContainer" containerID="5c3febc66a8669c07a4efed25b441d0e9a26fc735e09c355a605e4b5e9d5b3bb" Sep 10 12:06:55.052548 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:55.052529 2555 scope.go:117] "RemoveContainer" containerID="3f2943fbb48f495d5dc27776488e4886788a9ad38d8d3288124b6e170bab690c" Sep 10 12:06:55.052751 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:06:55.052733 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-gqr7z_openshift-console-operator(4ca0350c-c2c0-4510-a165-4924c1b0e626)\"" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" podUID="4ca0350c-c2c0-4510-a165-4924c1b0e626" Sep 10 12:06:55.106545 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:55.106501 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-hxpnq" podStartSLOduration=9.575350186 podStartE2EDuration="14.106486652s" totalImagesPullingTime="4.531136466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:06:49.059236347 +0000 UTC m=+48.895218934" watchObservedRunningTime="2026-09-10 12:06:55.106486652 +0000 UTC m=+54.942469257" Sep 10 12:06:55.646438 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:55.646406 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:55.748230 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:55.748178 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:55.825116 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:55.825080 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:56.056481 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:56.056411 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/2.log" Sep 10 12:06:56.324368 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:56.324286 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:56.529017 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:56.528967 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:56.726683 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:56.726652 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:56.916257 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:56.916226 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:57.131111 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:57.131085 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:57.213228 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:57.213204 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:58.187858 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:58.187827 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:58.289514 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:58.289484 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:58.528096 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:58.528024 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:58.746504 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:58.746470 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:58.930648 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:58.930622 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:59.008695 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:59.008661 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:59.240452 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:59.240377 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:59.344728 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:59.344701 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:59.423589 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:59.423546 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:06:59.928622 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:06:59.928596 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjvhr" Sep 10 12:07:00.136777 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:00.136744 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:00.330202 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:00.330144 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:00.728658 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:00.728626 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:00.866532 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:00.866503 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:00.947653 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:00.947628 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:01.044120 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:01.044059 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:01.332684 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:01.332623 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:07:01.334911 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:01.334887 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cfb6379-1e32-4997-b643-6ac043560089-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k428\" (UID: \"2cfb6379-1e32-4997-b643-6ac043560089\") " pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:07:01.412628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:01.412598 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bp4gw\"" Sep 10 12:07:01.420118 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:01.420101 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8k428" Sep 10 12:07:01.527537 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:01.527505 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:01.724479 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:01.724452 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8k428"] Sep 10 12:07:01.726792 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:01.726763 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfb6379_1e32_4997_b643_6ac043560089.slice/crio-7dd1794c84e87e2bde3759550bc08c4c92ec846b656b70f5cf1391b4008fa13b WatchSource:0}: Error finding container 7dd1794c84e87e2bde3759550bc08c4c92ec846b656b70f5cf1391b4008fa13b: Status 404 returned error can't find the container with id 7dd1794c84e87e2bde3759550bc08c4c92ec846b656b70f5cf1391b4008fa13b Sep 10 12:07:01.970124 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:01.970090 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:02.074640 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:02.074581 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k428" event={"ID":"2cfb6379-1e32-4997-b643-6ac043560089","Type":"ContainerStarted","Data":"df439823a7994d1964ef8d00c209fc3f01cafc90576ea223118946efdb7e317c"} Sep 10 12:07:02.074640 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:02.074631 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k428" event={"ID":"2cfb6379-1e32-4997-b643-6ac043560089","Type":"ContainerStarted","Data":"7dd1794c84e87e2bde3759550bc08c4c92ec846b656b70f5cf1391b4008fa13b"} Sep 10 12:07:02.358779 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:02.358746 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:02.528060 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:02.528023 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:03.079136 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:03.079056 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k428" event={"ID":"2cfb6379-1e32-4997-b643-6ac043560089","Type":"ContainerStarted","Data":"7ee56ed2f184699a515d2c980c047b1c0337c9789b7eecab9d8572574a9c53ec"} Sep 10 12:07:03.150859 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:03.150829 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:04.199473 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:04.199412 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:04.304049 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:04.303999 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:04.412555 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:04.412519 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:04.870018 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:04.869991 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:07:04.870169 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:04.870051 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:07:04.870422 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:04.870404 2555 scope.go:117] "RemoveContainer" containerID="3f2943fbb48f495d5dc27776488e4886788a9ad38d8d3288124b6e170bab690c" Sep 10 12:07:04.870605 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:07:04.870583 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-gqr7z_openshift-console-operator(4ca0350c-c2c0-4510-a165-4924c1b0e626)\"" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" podUID="4ca0350c-c2c0-4510-a165-4924c1b0e626" Sep 10 12:07:05.087267 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:05.087237 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k428" event={"ID":"2cfb6379-1e32-4997-b643-6ac043560089","Type":"ContainerStarted","Data":"765491662f970d6d5eded1f54e7945bf833023781ed362b02f5ffd4817899419"} Sep 10 12:07:05.114987 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:05.114943 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8k428" podStartSLOduration=17.828782077 podStartE2EDuration="20.114928706s" totalImagesPullingTime="2.286146629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:05.114129685 +0000 UTC m=+64.950112268" watchObservedRunningTime="2026-09-10 12:07:05.114928706 +0000 UTC m=+64.950911292" Sep 10 12:07:05.390083 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:05.390046 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:05.466537 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:05.466484 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:06.374945 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.374905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:07:06.377306 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.377284 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") pod \"image-registry-5544b76fcb-gcvqq\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:07:06.475748 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.475721 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:07:06.476141 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.475756 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:07:06.476141 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.475775 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:07:06.476141 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.475816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:07:06.476141 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.475852 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:07:06.476141 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.475879 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w47\" (UniqueName: \"kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47\") pod \"network-check-target-dznv6\" (UID: \"2155a7db-7555-4c34-9898-82c3de1c8ad7\") " pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:07:06.476141 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.475931 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:07:06.476726 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.476703 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac90c9b6-ead8-494f-95b6-8afc5abb5239-service-ca-bundle\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:07:06.478187 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.478164 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac90c9b6-ead8-494f-95b6-8afc5abb5239-metrics-certs\") pod \"router-default-5c76cccf54-qpjb6\" (UID: \"ac90c9b6-ead8-494f-95b6-8afc5abb5239\") " pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:07:06.478387 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.478369 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4w47\" (UniqueName: \"kubernetes.io/projected/2155a7db-7555-4c34-9898-82c3de1c8ad7-kube-api-access-b4w47\") pod \"network-check-target-dznv6\" (UID: \"2155a7db-7555-4c34-9898-82c3de1c8ad7\") " pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:07:06.478545 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.478528 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0fe6b0-6ac8-467d-a817-a664c7f1a266-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-jqrd7\" (UID: \"2e0fe6b0-6ac8-467d-a817-a664c7f1a266\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:07:06.478622 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.478551 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7efda6d-7e77-4bfe-845b-6e766a94b3ba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-c59nn\" (UID: \"b7efda6d-7e77-4bfe-845b-6e766a94b3ba\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:07:06.479312 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.479293 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:07:06.480371 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.480353 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:07:06.488588 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.488551 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c538f6f-2768-4746-877a-8c7e2cb2ecc2-metrics-certs\") pod \"network-metrics-daemon-mnkdw\" (UID: \"7c538f6f-2768-4746-877a-8c7e2cb2ecc2\") " pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:07:06.488694 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.488636 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/677825a5-038d-449f-9240-d5c10e329ae8-original-pull-secret\") pod \"global-pull-secret-syncer-bj8j2\" (UID: \"677825a5-038d-449f-9240-d5c10e329ae8\") " pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:07:06.572965 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.572945 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bj8j2" Sep 10 12:07:06.576160 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.576142 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:07:06.578100 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.578080 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06882160-6a41-4d36-af22-75132d2644c1-metrics-tls\") pod \"dns-default-f2r2p\" (UID: \"06882160-6a41-4d36-af22-75132d2644c1\") " pod="openshift-dns/dns-default-f2r2p" Sep 10 12:07:06.599650 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.599631 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c52mp\"" Sep 10 12:07:06.607234 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.607217 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:07:06.645007 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.644975 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4xb9h\"" Sep 10 12:07:06.653164 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.652727 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" Sep 10 12:07:06.675171 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.675148 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llnv7\"" Sep 10 12:07:06.680587 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.680412 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vr5lb\"" Sep 10 12:07:06.682993 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.682668 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnkdw" Sep 10 12:07:06.688365 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.688140 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:07:06.707930 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.707880 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cl4wl\"" Sep 10 12:07:06.714875 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.714796 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:07:06.716815 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.716715 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z242c\"" Sep 10 12:07:06.724355 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.724213 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" Sep 10 12:07:06.747237 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.745311 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4wjzz\"" Sep 10 12:07:06.751841 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.751613 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f2r2p" Sep 10 12:07:06.861638 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.861617 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bj8j2"] Sep 10 12:07:06.863865 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:06.863841 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod677825a5_038d_449f_9240_d5c10e329ae8.slice/crio-bd1703482309293962f5b994173234b4077f74226585ee9d5428f7b3d516b6ac WatchSource:0}: Error finding container bd1703482309293962f5b994173234b4077f74226585ee9d5428f7b3d516b6ac: Status 404 returned error can't find the container with id bd1703482309293962f5b994173234b4077f74226585ee9d5428f7b3d516b6ac Sep 10 12:07:06.907775 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.907751 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5544b76fcb-gcvqq"] Sep 10 12:07:06.909714 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:06.909692 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4978d5d8_c8cb_473a_92f1_1fff4f2d3ab9.slice/crio-b445ce54370609e1a42a0df78603ecec436faf7a813c5297ae9f0cbefb4c6fd5 WatchSource:0}: Error finding container b445ce54370609e1a42a0df78603ecec436faf7a813c5297ae9f0cbefb4c6fd5: Status 404 returned error can't find the container with id b445ce54370609e1a42a0df78603ecec436faf7a813c5297ae9f0cbefb4c6fd5 Sep 10 12:07:06.933731 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.933669 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn"] Sep 10 12:07:06.941392 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:06.941370 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7efda6d_7e77_4bfe_845b_6e766a94b3ba.slice/crio-ca1cfd73b9ea4653a6faca404082b71a7fec919930045fd11d38b66207a8799f WatchSource:0}: Error finding container ca1cfd73b9ea4653a6faca404082b71a7fec919930045fd11d38b66207a8799f: Status 404 returned error can't find the container with id ca1cfd73b9ea4653a6faca404082b71a7fec919930045fd11d38b66207a8799f Sep 10 12:07:06.969489 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.969459 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mnkdw"] Sep 10 12:07:06.970766 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:06.970743 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c538f6f_2768_4746_877a_8c7e2cb2ecc2.slice/crio-38d17904068155e932d8a0626e04aeb89115b880a0e80fe740e9f55e3791cee2 WatchSource:0}: Error finding container 38d17904068155e932d8a0626e04aeb89115b880a0e80fe740e9f55e3791cee2: Status 404 returned error can't find the container with id 38d17904068155e932d8a0626e04aeb89115b880a0e80fe740e9f55e3791cee2 Sep 10 12:07:06.987887 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:06.987864 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dznv6"] Sep 10 12:07:06.991556 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:06.991529 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2155a7db_7555_4c34_9898_82c3de1c8ad7.slice/crio-bd02306878d1b7108667bcc2e602d32926935a76de6162089868a1ddf9b8becd WatchSource:0}: Error finding container bd02306878d1b7108667bcc2e602d32926935a76de6162089868a1ddf9b8becd: Status 404 returned error can't find the container with id bd02306878d1b7108667bcc2e602d32926935a76de6162089868a1ddf9b8becd Sep 10 12:07:07.023380 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.023354 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c76cccf54-qpjb6"] Sep 10 12:07:07.026388 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.026343 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7"] Sep 10 12:07:07.033529 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:07.033504 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac90c9b6_ead8_494f_95b6_8afc5abb5239.slice/crio-77f4fe85e8f79519ce1e1383763afb75e51d1023714871c8a6278a38d8d29b1d WatchSource:0}: Error finding container 77f4fe85e8f79519ce1e1383763afb75e51d1023714871c8a6278a38d8d29b1d: Status 404 returned error can't find the container with id 77f4fe85e8f79519ce1e1383763afb75e51d1023714871c8a6278a38d8d29b1d Sep 10 12:07:07.058967 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.058943 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f2r2p"] Sep 10 12:07:07.062619 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:07.062592 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06882160_6a41_4d36_af22_75132d2644c1.slice/crio-e44ce34f822e4b9378e8bec482f72c0777118e317320c4f634a9ba3c74d3bd6b WatchSource:0}: Error finding container e44ce34f822e4b9378e8bec482f72c0777118e317320c4f634a9ba3c74d3bd6b: Status 404 returned error can't find the container with id e44ce34f822e4b9378e8bec482f72c0777118e317320c4f634a9ba3c74d3bd6b Sep 10 12:07:07.096046 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.096014 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bj8j2" event={"ID":"677825a5-038d-449f-9240-d5c10e329ae8","Type":"ContainerStarted","Data":"bd1703482309293962f5b994173234b4077f74226585ee9d5428f7b3d516b6ac"} Sep 10 12:07:07.097211 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.097188 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2r2p" event={"ID":"06882160-6a41-4d36-af22-75132d2644c1","Type":"ContainerStarted","Data":"e44ce34f822e4b9378e8bec482f72c0777118e317320c4f634a9ba3c74d3bd6b"} Sep 10 12:07:07.099467 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.098861 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c76cccf54-qpjb6" event={"ID":"ac90c9b6-ead8-494f-95b6-8afc5abb5239","Type":"ContainerStarted","Data":"b495e6e0b00c4c91a6d4372659d3fe411a523e64a31936d22d03154f47e93f9d"} Sep 10 12:07:07.099467 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.098905 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c76cccf54-qpjb6" event={"ID":"ac90c9b6-ead8-494f-95b6-8afc5abb5239","Type":"ContainerStarted","Data":"77f4fe85e8f79519ce1e1383763afb75e51d1023714871c8a6278a38d8d29b1d"} Sep 10 12:07:07.101007 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.100986 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dznv6" event={"ID":"2155a7db-7555-4c34-9898-82c3de1c8ad7","Type":"ContainerStarted","Data":"a304c8812c0e3a729b435634401a6facd890ca252f14ed5419d2807242a8af85"} Sep 10 12:07:07.101098 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.101021 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dznv6" event={"ID":"2155a7db-7555-4c34-9898-82c3de1c8ad7","Type":"ContainerStarted","Data":"bd02306878d1b7108667bcc2e602d32926935a76de6162089868a1ddf9b8becd"} Sep 10 12:07:07.101098 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.101041 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:07:07.102611 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.102587 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" event={"ID":"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9","Type":"ContainerStarted","Data":"9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246"} Sep 10 12:07:07.102720 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.102630 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" event={"ID":"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9","Type":"ContainerStarted","Data":"b445ce54370609e1a42a0df78603ecec436faf7a813c5297ae9f0cbefb4c6fd5"} Sep 10 12:07:07.102720 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.102675 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:07:07.104045 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.104014 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" event={"ID":"2e0fe6b0-6ac8-467d-a817-a664c7f1a266","Type":"ContainerStarted","Data":"ae811034166c264b9bff14cc59a71ed7912217dc9d5e36a3ae3d2352d9b3f2c7"} Sep 10 12:07:07.105261 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.105238 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mnkdw" event={"ID":"7c538f6f-2768-4746-877a-8c7e2cb2ecc2","Type":"ContainerStarted","Data":"38d17904068155e932d8a0626e04aeb89115b880a0e80fe740e9f55e3791cee2"} Sep 10 12:07:07.106451 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.106430 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" event={"ID":"b7efda6d-7e77-4bfe-845b-6e766a94b3ba","Type":"ContainerStarted","Data":"ca1cfd73b9ea4653a6faca404082b71a7fec919930045fd11d38b66207a8799f"} Sep 10 12:07:07.124938 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.124886 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c76cccf54-qpjb6" podStartSLOduration=46.124867716 podStartE2EDuration="46.124867716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:07.122879425 +0000 UTC m=+66.958862010" watchObservedRunningTime="2026-09-10 12:07:07.124867716 +0000 UTC m=+66.960850303" Sep 10 12:07:07.154320 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.154272 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" podStartSLOduration=65.154258506 podStartE2EDuration="1m5.154258506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:07.153781065 +0000 UTC m=+66.989763651" watchObservedRunningTime="2026-09-10 12:07:07.154258506 +0000 UTC m=+66.990241085" Sep 10 12:07:07.172829 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.172758 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dznv6" podStartSLOduration=66.172745892 podStartE2EDuration="1m6.172745892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:07.171417821 +0000 UTC m=+67.007400407" watchObservedRunningTime="2026-09-10 12:07:07.172745892 +0000 UTC m=+67.008728490" Sep 10 12:07:07.715011 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.714973 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:07:07.717727 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:07.717693 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:07:08.111122 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:08.111070 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:07:08.112254 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:08.112230 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c76cccf54-qpjb6" Sep 10 12:07:09.874074 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:09.874030 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:10.006127 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.005798 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5"] Sep 10 12:07:10.010756 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.010726 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:10.015016 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.014997 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" Sep 10 12:07:10.018102 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.018085 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 10 12:07:10.019576 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.019491 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 12:07:10.019786 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.019763 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 12:07:10.019786 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.019775 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 12:07:10.019954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.019816 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vv9xp\"" Sep 10 12:07:10.028536 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.028485 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5"] Sep 10 12:07:10.106711 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.106682 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b90c935e-3dd0-40e2-96be-ff0085214a77-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5\" (UID: \"b90c935e-3dd0-40e2-96be-ff0085214a77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" Sep 10 12:07:10.106863 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.106757 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn9k5\" (UniqueName: \"kubernetes.io/projected/b90c935e-3dd0-40e2-96be-ff0085214a77-kube-api-access-nn9k5\") pod \"managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5\" (UID: \"b90c935e-3dd0-40e2-96be-ff0085214a77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" Sep 10 12:07:10.121206 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.121179 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2r2p" event={"ID":"06882160-6a41-4d36-af22-75132d2644c1","Type":"ContainerStarted","Data":"59aeee11102fe601d6c192c236ad264d8872c88e040f9594eaf7c4271b5ee82d"} Sep 10 12:07:10.121340 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.121228 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2r2p" event={"ID":"06882160-6a41-4d36-af22-75132d2644c1","Type":"ContainerStarted","Data":"3e9108f9b9ffcd8dd0bcf3793a2974980527631a8b1f3be5921b80210060fe84"} Sep 10 12:07:10.121340 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.121304 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f2r2p" Sep 10 12:07:10.123524 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.123492 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mnkdw" event={"ID":"7c538f6f-2768-4746-877a-8c7e2cb2ecc2","Type":"ContainerStarted","Data":"d0a23529d2e7db8419b2d89dee126293d0de76f04b63313fdd600c6d9fddfc43"} Sep 10 12:07:10.123632 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.123544 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mnkdw" event={"ID":"7c538f6f-2768-4746-877a-8c7e2cb2ecc2","Type":"ContainerStarted","Data":"a4905601d187a477658272b32a57b9b685ac27419603653ca377b461aed8ebd2"} Sep 10 12:07:10.125025 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.124969 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" event={"ID":"b7efda6d-7e77-4bfe-845b-6e766a94b3ba","Type":"ContainerStarted","Data":"95a92b9dcf27c891011a46a75890acdf199ce56dfdb6256b64c16d7a4b2ba978"} Sep 10 12:07:10.164313 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.164282 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc"] Sep 10 12:07:10.167310 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.167289 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc" Sep 10 12:07:10.169517 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.169483 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f2r2p" podStartSLOduration=33.846190863 podStartE2EDuration="36.169471859s" totalImagesPullingTime="2.323280996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:10.167169939 +0000 UTC m=+70.003152524" watchObservedRunningTime="2026-09-10 12:07:10.169471859 +0000 UTC m=+70.005454445" Sep 10 12:07:10.171700 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.171682 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-khr28\"" Sep 10 12:07:10.174749 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.174732 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 12:07:10.204159 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.204131 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc"] Sep 10 12:07:10.208142 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.208107 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b90c935e-3dd0-40e2-96be-ff0085214a77-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5\" (UID: \"b90c935e-3dd0-40e2-96be-ff0085214a77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" Sep 10 12:07:10.208304 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.208280 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn9k5\" (UniqueName: \"kubernetes.io/projected/b90c935e-3dd0-40e2-96be-ff0085214a77-kube-api-access-nn9k5\") pod \"managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5\" (UID: \"b90c935e-3dd0-40e2-96be-ff0085214a77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" Sep 10 12:07:10.212232 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.212192 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b90c935e-3dd0-40e2-96be-ff0085214a77-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5\" (UID: \"b90c935e-3dd0-40e2-96be-ff0085214a77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" Sep 10 12:07:10.259162 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.259125 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn9k5\" (UniqueName: \"kubernetes.io/projected/b90c935e-3dd0-40e2-96be-ff0085214a77-kube-api-access-nn9k5\") pod \"managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5\" (UID: \"b90c935e-3dd0-40e2-96be-ff0085214a77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" Sep 10 12:07:10.309225 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.309185 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/beba4cf0-3ca7-476d-b6fc-301c0b5d3071-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-g4nxc\" (UID: \"beba4cf0-3ca7-476d-b6fc-301c0b5d3071\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc" Sep 10 12:07:10.319845 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.319798 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mnkdw" podStartSLOduration=66.861464377 podStartE2EDuration="1m9.319783031s" totalImagesPullingTime="2.458318654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:10.25651906 +0000 UTC m=+70.092501660" watchObservedRunningTime="2026-09-10 12:07:10.319783031 +0000 UTC m=+70.155765617" Sep 10 12:07:10.320042 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.320018 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-c59nn" podStartSLOduration=46.880644339 podStartE2EDuration="49.320010012s" totalImagesPullingTime="2.439365673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:10.31808143 +0000 UTC m=+70.154064017" watchObservedRunningTime="2026-09-10 12:07:10.320010012 +0000 UTC m=+70.155992597" Sep 10 12:07:10.338263 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.338238 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" Sep 10 12:07:10.410875 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.410842 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/beba4cf0-3ca7-476d-b6fc-301c0b5d3071-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-g4nxc\" (UID: \"beba4cf0-3ca7-476d-b6fc-301c0b5d3071\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc" Sep 10 12:07:10.414400 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.414323 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/beba4cf0-3ca7-476d-b6fc-301c0b5d3071-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-g4nxc\" (UID: \"beba4cf0-3ca7-476d-b6fc-301c0b5d3071\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc" Sep 10 12:07:10.475947 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.475918 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc" Sep 10 12:07:10.549856 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.549709 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:10.635035 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.635008 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5"] Sep 10 12:07:10.637205 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:10.637176 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb90c935e_3dd0_40e2_96be_ff0085214a77.slice/crio-ac9202f34ebd49f53baabfbd5bcfcfeaf99fa2e358cd903419f936a38540de24 WatchSource:0}: Error finding container ac9202f34ebd49f53baabfbd5bcfcfeaf99fa2e358cd903419f936a38540de24: Status 404 returned error can't find the container with id ac9202f34ebd49f53baabfbd5bcfcfeaf99fa2e358cd903419f936a38540de24 Sep 10 12:07:10.709846 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.709791 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:10.777299 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:10.777277 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc"] Sep 10 12:07:10.779854 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:10.779827 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeba4cf0_3ca7_476d_b6fc_301c0b5d3071.slice/crio-cc66b4d14b39b132d508e8ba40cbb28fde807343173f2a9bc1d466933e554522 WatchSource:0}: Error finding container cc66b4d14b39b132d508e8ba40cbb28fde807343173f2a9bc1d466933e554522: Status 404 returned error can't find the container with id cc66b4d14b39b132d508e8ba40cbb28fde807343173f2a9bc1d466933e554522 Sep 10 12:07:11.129249 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:11.129215 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" event={"ID":"b90c935e-3dd0-40e2-96be-ff0085214a77","Type":"ContainerStarted","Data":"ac9202f34ebd49f53baabfbd5bcfcfeaf99fa2e358cd903419f936a38540de24"} Sep 10 12:07:11.130391 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:11.130358 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc" event={"ID":"beba4cf0-3ca7-476d-b6fc-301c0b5d3071","Type":"ContainerStarted","Data":"cc66b4d14b39b132d508e8ba40cbb28fde807343173f2a9bc1d466933e554522"} Sep 10 12:07:11.146951 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:11.146920 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:11.240052 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:11.240014 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:11.553162 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:11.553078 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:11.638604 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:11.638536 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:12.538936 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:12.538877 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:12.680532 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:12.680489 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:12.939934 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:12.939899 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:16.148789 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:16.148749 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bj8j2" event={"ID":"677825a5-038d-449f-9240-d5c10e329ae8","Type":"ContainerStarted","Data":"d2dd5fbd9c83d2f56c05f17d8c5694eb2c682bdb712dd45e36b8441ee96c24eb"} Sep 10 12:07:16.150707 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:16.150682 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" event={"ID":"2e0fe6b0-6ac8-467d-a817-a664c7f1a266","Type":"ContainerStarted","Data":"2bedcb6080eb8b78f06e74f45888c71b0364991dc5a78082380fddbd7ed4781e"} Sep 10 12:07:16.150857 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:16.150724 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" event={"ID":"2e0fe6b0-6ac8-467d-a817-a664c7f1a266","Type":"ContainerStarted","Data":"7822df36cf884aa29443e730e43ea080313730ca55c123e328bbf4d0dc1007f9"} Sep 10 12:07:16.152350 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:16.152328 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" event={"ID":"b90c935e-3dd0-40e2-96be-ff0085214a77","Type":"ContainerStarted","Data":"4c7e3f131c5a2b45cbe5eb0245b3962c2958bdcda2d7183f9b4cc1db9807c3e5"} Sep 10 12:07:16.168601 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:16.168547 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bj8j2" podStartSLOduration=65.25557475 podStartE2EDuration="1m14.168534477s" totalImagesPullingTime="8.912959727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:16.168467941 +0000 UTC m=+76.004450526" watchObservedRunningTime="2026-09-10 12:07:16.168534477 +0000 UTC m=+76.004517062" Sep 10 12:07:16.189789 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:16.189750 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-jqrd7" podStartSLOduration=36.501941829 podStartE2EDuration="45.189734871s" totalImagesPullingTime="8.687793042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:16.189443438 +0000 UTC m=+76.025426025" watchObservedRunningTime="2026-09-10 12:07:16.189734871 +0000 UTC m=+76.025717474" Sep 10 12:07:16.206825 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:16.206786 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f78cd85c4-r5nw5" podStartSLOduration=2.061136162 podStartE2EDuration="7.206773373s" totalImagesPullingTime="5.145637211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:16.205428068 +0000 UTC m=+76.041410655" watchObservedRunningTime="2026-09-10 12:07:16.206773373 +0000 UTC m=+76.042755958" Sep 10 12:07:16.761988 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:16.761961 2555 scope.go:117] "RemoveContainer" containerID="3f2943fbb48f495d5dc27776488e4886788a9ad38d8d3288124b6e170bab690c" Sep 10 12:07:17.157986 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:17.157947 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc" event={"ID":"beba4cf0-3ca7-476d-b6fc-301c0b5d3071","Type":"ContainerStarted","Data":"6245814c0eecad4a4cb75e3fa91f775a7d13061d0399de956baab248750a4f03"} Sep 10 12:07:17.158481 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:17.158171 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc" Sep 10 12:07:17.160190 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:17.160167 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/2.log" Sep 10 12:07:17.160337 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:17.160310 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" event={"ID":"4ca0350c-c2c0-4510-a165-4924c1b0e626","Type":"ContainerStarted","Data":"52e1eebc2940f642adba512e01eb283bffd363c1fbbd6d08fece2e98c0f89126"} Sep 10 12:07:17.163677 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:17.163657 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc" Sep 10 12:07:17.182982 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:17.182937 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-g4nxc" podStartSLOduration=1.806824471 podStartE2EDuration="7.182924581s" totalImagesPullingTime="5.37610011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:17.181844079 +0000 UTC m=+77.017826665" watchObservedRunningTime="2026-09-10 12:07:17.182924581 +0000 UTC m=+77.018907167" Sep 10 12:07:17.212844 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:17.212785 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" podStartSLOduration=38.087681864 podStartE2EDuration="46.212764119s" totalImagesPullingTime="8.125082255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:17.211357821 +0000 UTC m=+77.047340406" watchObservedRunningTime="2026-09-10 12:07:17.212764119 +0000 UTC m=+77.048746706" Sep 10 12:07:17.648616 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:17.648554 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:17.743943 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:17.743912 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:17.939625 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:17.939535 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:18.109013 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:18.108968 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:18.200864 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:18.200785 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:18.487830 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:18.487751 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:18.590682 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:18.590653 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:18.745032 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:18.744955 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:18.829184 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:18.829152 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:19.182220 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:19.182183 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:19.315640 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:19.315611 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:19.416386 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:19.416360 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:19.651948 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:19.651910 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:19.788431 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:19.788401 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:20.132829 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:20.132804 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f2r2p" Sep 10 12:07:20.224492 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:20.224447 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:20.326627 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:20.326591 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:20.406294 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:20.406197 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:21.269966 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:21.269929 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:23.328861 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.328718 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:23.568044 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.568009 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:23.699684 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.699652 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5xprx"] Sep 10 12:07:23.702067 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.702047 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.705472 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.705448 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 12:07:23.705718 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.705702 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 12:07:23.706724 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.706705 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 12:07:23.706790 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.706759 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 12:07:23.706838 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.706791 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qv5br\"" Sep 10 12:07:23.717707 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.717688 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:23.808851 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.808821 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-tls\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.808966 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.808861 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.808966 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.808892 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-wtmp\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.808966 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.808953 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-textfile\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.809071 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.809001 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-metrics-client-ca\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.809071 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.809022 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mskz\" (UniqueName: \"kubernetes.io/projected/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-kube-api-access-9mskz\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.809071 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.809059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-root\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.809172 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.809090 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-sys\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.809172 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.809120 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.829888 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.829858 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:23.909989 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.909964 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-tls\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910109 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910000 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910109 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910025 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-wtmp\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910109 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910042 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-textfile\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910109 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910070 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-metrics-client-ca\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910109 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910092 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mskz\" (UniqueName: \"kubernetes.io/projected/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-kube-api-access-9mskz\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910357 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910110 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-root\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910357 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910149 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-sys\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910357 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910155 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-wtmp\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910357 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910185 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910357 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910216 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-sys\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910357 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910328 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-root\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910676 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910444 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-textfile\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910730 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910693 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-metrics-client-ca\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.910730 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.910696 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.912343 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.912324 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.912425 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.912407 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-node-exporter-tls\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:23.931388 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:23.931369 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mskz\" (UniqueName: \"kubernetes.io/projected/6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08-kube-api-access-9mskz\") pod \"node-exporter-5xprx\" (UID: \"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08\") " pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:24.011760 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:24.011709 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5xprx" Sep 10 12:07:24.021852 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:24.021832 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd8fca1_c0f1_4fff_84ab_71e7abc0bf08.slice/crio-411079aade8e1568e9c74a98f1bcdbe00e042c97d95b7ba49a892acbef4c89db WatchSource:0}: Error finding container 411079aade8e1568e9c74a98f1bcdbe00e042c97d95b7ba49a892acbef4c89db: Status 404 returned error can't find the container with id 411079aade8e1568e9c74a98f1bcdbe00e042c97d95b7ba49a892acbef4c89db Sep 10 12:07:24.132985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:24.132953 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:24.187304 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:24.187269 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xprx" event={"ID":"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08","Type":"ContainerStarted","Data":"411079aade8e1568e9c74a98f1bcdbe00e042c97d95b7ba49a892acbef4c89db"} Sep 10 12:07:24.425643 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:24.425607 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:24.558697 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:24.558661 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:24.729515 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:24.729444 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:24.837230 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:24.837201 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:25.082370 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:25.082286 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:25.298978 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:25.298948 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:25.808599 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:25.808511 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:25.909957 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:25.909923 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:26.196765 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:26.196734 2555 generic.go:356] "Generic (PLEG): container finished" podID="6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08" containerID="a678cf27cc892a057797ec8b2e64fd78d7aa6ad665dc1c8eff7e1b6b6ca4407e" exitCode=0 Sep 10 12:07:26.196765 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:26.196768 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xprx" event={"ID":"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08","Type":"ContainerDied","Data":"a678cf27cc892a057797ec8b2e64fd78d7aa6ad665dc1c8eff7e1b6b6ca4407e"} Sep 10 12:07:26.696976 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:26.696945 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:27.161145 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:27.161115 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:07:27.164629 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:27.164612 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-gqr7z" Sep 10 12:07:27.202670 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:27.202634 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xprx" event={"ID":"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08","Type":"ContainerStarted","Data":"4e7d0c082e0015401e03b107637dc40b54afddbf2641b6ffaf8437edb01a78b9"} Sep 10 12:07:27.202821 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:27.202718 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xprx" event={"ID":"6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08","Type":"ContainerStarted","Data":"c3928bb1f57f9516605cf9041ba4e3c7fe22463989ffd5a3e9f926e5b8255170"} Sep 10 12:07:27.234489 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:27.234439 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5xprx" podStartSLOduration=2.767243736 podStartE2EDuration="4.234424829s" totalImagesPullingTime="1.404757363s" totalInitContainerRuntime="62.42373ms" isStatefulPod=true podCreationTimestamp="2026-09-10 12:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:27.232449618 +0000 UTC m=+87.068432204" watchObservedRunningTime="2026-09-10 12:07:27.234424829 +0000 UTC m=+87.070407415" Sep 10 12:07:27.394529 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:27.394493 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:27.503957 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:27.503877 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:28.115065 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:28.115038 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:07:28.322821 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:28.322787 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:28.429368 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:28.429261 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:28.527156 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:28.527121 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:28.759615 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:28.759489 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:29.455833 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:29.455797 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:29.577516 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:29.577477 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:30.053266 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:30.053230 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:32.530471 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:32.530431 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5544b76fcb-gcvqq"] Sep 10 12:07:32.538294 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:32.538259 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:32.634083 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:32.634038 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:32.751251 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:32.751215 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:32.850443 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:32.850406 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:32.994442 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:32.994406 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:33.343844 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:33.343806 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:33.438797 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:33.438764 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:33.641982 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:33.641903 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:33.722133 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:33.722097 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:35.921198 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.921165 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69fddc955-2qf58"] Sep 10 12:07:35.923943 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.923922 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:35.931767 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.931746 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 12:07:35.932626 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.932608 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 12:07:35.932918 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.932900 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 12:07:35.933004 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.932908 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-h7hf8\"" Sep 10 12:07:35.933398 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.933379 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 12:07:35.934986 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.934962 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 12:07:35.935104 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.935087 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 12:07:35.936079 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.936063 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 12:07:35.936783 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.936761 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69fddc955-2qf58"] Sep 10 12:07:35.939133 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:35.939116 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 12:07:36.008468 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.008445 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-oauth-config\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.008554 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.008471 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-oauth-serving-cert\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.008554 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.008491 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-service-ca\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.008662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.008595 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfscr\" (UniqueName: \"kubernetes.io/projected/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-kube-api-access-cfscr\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.008662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.008620 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-serving-cert\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.008662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.008638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-config\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.008764 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.008683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-trusted-ca-bundle\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.109024 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.108999 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-trusted-ca-bundle\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.109115 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.109028 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-oauth-config\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.109115 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.109044 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-oauth-serving-cert\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.109115 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.109061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-service-ca\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.109115 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.109100 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfscr\" (UniqueName: \"kubernetes.io/projected/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-kube-api-access-cfscr\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.109261 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.109123 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-serving-cert\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.109261 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.109144 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-config\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.109913 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.109888 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-config\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.110003 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.109949 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-service-ca\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.110072 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.110041 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-oauth-serving-cert\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.110072 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.110049 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-trusted-ca-bundle\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.111653 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.111618 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-oauth-config\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.111748 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.111732 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-serving-cert\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.119453 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.119434 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfscr\" (UniqueName: \"kubernetes.io/projected/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-kube-api-access-cfscr\") pod \"console-69fddc955-2qf58\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.232470 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.232404 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:36.506974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.506951 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69fddc955-2qf58"] Sep 10 12:07:36.508747 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:07:36.508725 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2fd4d4f_1ab0_4da3_8098_2bb3da6083fa.slice/crio-deb26ebb9a9561e2d015fadffa112f9187e9f13b808536cfebb409f11445f779 WatchSource:0}: Error finding container deb26ebb9a9561e2d015fadffa112f9187e9f13b808536cfebb409f11445f779: Status 404 returned error can't find the container with id deb26ebb9a9561e2d015fadffa112f9187e9f13b808536cfebb409f11445f779 Sep 10 12:07:36.525004 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.524962 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:36.624162 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:36.624137 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:37.240523 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:37.240490 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fddc955-2qf58" event={"ID":"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa","Type":"ContainerStarted","Data":"deb26ebb9a9561e2d015fadffa112f9187e9f13b808536cfebb409f11445f779"} Sep 10 12:07:38.113681 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:38.113632 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dznv6" Sep 10 12:07:38.173098 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:38.173064 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:38.286523 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:38.286488 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:40.254237 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:40.254198 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fddc955-2qf58" event={"ID":"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa","Type":"ContainerStarted","Data":"d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489"} Sep 10 12:07:40.285504 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:40.285453 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69fddc955-2qf58" podStartSLOduration=2.469716655 podStartE2EDuration="5.285438626s" totalImagesPullingTime="2.815721971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:07:40.282677389 +0000 UTC m=+100.118659988" watchObservedRunningTime="2026-09-10 12:07:40.285438626 +0000 UTC m=+100.121421211" Sep 10 12:07:40.767326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:40.767286 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:40.845738 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:40.845706 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:42.714074 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:42.714014 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:42.813806 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:42.813767 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:46.233228 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:46.233196 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:46.233623 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:46.233281 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:46.238796 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:46.238767 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:46.280030 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:46.280008 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:07:47.139301 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:47.139265 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:47.239795 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:47.239758 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:47.855943 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:47.855902 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:47.983708 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:47.983675 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:49.288684 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:49.288657 2555 generic.go:356] "Generic (PLEG): container finished" podID="425cdd5b-5159-418c-953b-24784915bafc" containerID="d8a160bd14d9709a9aff9be7e1e7db1944590dfdf0c6393cb9bd1e1819502458" exitCode=0 Sep 10 12:07:49.288960 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:49.288727 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" event={"ID":"425cdd5b-5159-418c-953b-24784915bafc","Type":"ContainerDied","Data":"d8a160bd14d9709a9aff9be7e1e7db1944590dfdf0c6393cb9bd1e1819502458"} Sep 10 12:07:49.289055 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:49.289037 2555 scope.go:117] "RemoveContainer" containerID="d8a160bd14d9709a9aff9be7e1e7db1944590dfdf0c6393cb9bd1e1819502458" Sep 10 12:07:50.294067 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:50.294030 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pszqg" event={"ID":"425cdd5b-5159-418c-953b-24784915bafc","Type":"ContainerStarted","Data":"fa4f4398b94b42b87a454832ce439ef51e999edeed16a078f7fadd68e6485660"} Sep 10 12:07:55.826413 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:55.826367 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:56.137330 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:56.137291 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:07:57.550194 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.550152 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" podUID="4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" containerName="registry" containerID="cri-o://9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246" gracePeriod=30 Sep 10 12:07:57.787171 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.787149 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:07:57.861680 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.861646 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-installation-pull-secrets\") pod \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " Sep 10 12:07:57.861680 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.861685 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-trusted-ca\") pod \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " Sep 10 12:07:57.861901 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.861700 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-certificates\") pod \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " Sep 10 12:07:57.861901 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.861741 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-ca-trust-extracted\") pod \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " Sep 10 12:07:57.861901 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.861757 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxd7q\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-kube-api-access-kxd7q\") pod \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " Sep 10 12:07:57.861901 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.861801 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-image-registry-private-configuration\") pod \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " Sep 10 12:07:57.861901 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.861841 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") pod \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " Sep 10 12:07:57.861901 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.861879 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-bound-sa-token\") pod \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\" (UID: \"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9\") " Sep 10 12:07:57.862237 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.862210 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:07:57.862297 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.862257 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:07:57.864651 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.864624 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-kube-api-access-kxd7q" (OuterVolumeSpecName: "kube-api-access-kxd7q") pod "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9"). InnerVolumeSpecName "kube-api-access-kxd7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:07:57.864830 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.864807 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:07:57.864913 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.864819 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:07:57.864913 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.864884 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:07:57.864913 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.864901 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:07:57.872404 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.872380 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" (UID: "4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:07:57.963320 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.963293 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-image-registry-private-configuration\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:07:57.963320 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.963319 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-tls\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:07:57.963480 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.963331 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-bound-sa-token\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:07:57.963480 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.963339 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-installation-pull-secrets\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:07:57.963480 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.963353 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-trusted-ca\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:07:57.963480 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.963365 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-registry-certificates\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:07:57.963480 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.963373 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-ca-trust-extracted\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:07:57.963480 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:57.963381 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxd7q\" (UniqueName: \"kubernetes.io/projected/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9-kube-api-access-kxd7q\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:07:58.323426 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:58.323338 2555 generic.go:356] "Generic (PLEG): container finished" podID="4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" containerID="9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246" exitCode=0 Sep 10 12:07:58.323426 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:58.323387 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" Sep 10 12:07:58.323648 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:58.323426 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" event={"ID":"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9","Type":"ContainerDied","Data":"9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246"} Sep 10 12:07:58.323648 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:58.323477 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5544b76fcb-gcvqq" event={"ID":"4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9","Type":"ContainerDied","Data":"b445ce54370609e1a42a0df78603ecec436faf7a813c5297ae9f0cbefb4c6fd5"} Sep 10 12:07:58.323648 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:58.323499 2555 scope.go:117] "RemoveContainer" containerID="9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246" Sep 10 12:07:58.332019 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:58.331999 2555 scope.go:117] "RemoveContainer" containerID="9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246" Sep 10 12:07:58.332262 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:07:58.332242 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246\": container with ID starting with 9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246 not found: ID does not exist" containerID="9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246" Sep 10 12:07:58.332310 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:58.332268 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246"} err="failed to get container status \"9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246\": rpc error: code = NotFound desc = could not find container \"9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246\": container with ID starting with 9bdc349e96946da7d0da5de6ee75f812244a7eefb80ba016eb26c13724a77246 not found: ID does not exist" Sep 10 12:07:58.345503 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:58.345480 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5544b76fcb-gcvqq"] Sep 10 12:07:58.348052 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:58.348034 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5544b76fcb-gcvqq"] Sep 10 12:07:58.766758 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:07:58.766728 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" path="/var/lib/kubelet/pods/4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9/volumes" Sep 10 12:08:00.334365 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:00.334334 2555 generic.go:356] "Generic (PLEG): container finished" podID="82e21dee-d039-4ad6-8bee-56da40618432" containerID="acf8034c24a43f09ad78511f54da21553b6538e525cb9a0e2632f5fcb5c728d3" exitCode=0 Sep 10 12:08:00.334781 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:00.334396 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" event={"ID":"82e21dee-d039-4ad6-8bee-56da40618432","Type":"ContainerDied","Data":"acf8034c24a43f09ad78511f54da21553b6538e525cb9a0e2632f5fcb5c728d3"} Sep 10 12:08:00.334781 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:00.334694 2555 scope.go:117] "RemoveContainer" containerID="acf8034c24a43f09ad78511f54da21553b6538e525cb9a0e2632f5fcb5c728d3" Sep 10 12:08:01.341012 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:01.340981 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-j4xzv" event={"ID":"82e21dee-d039-4ad6-8bee-56da40618432","Type":"ContainerStarted","Data":"8cfd520f2a9d1e979c2f6d5d2f6ed1eb981c03d352df4329305843e31257bf5e"} Sep 10 12:08:09.371401 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:09.371368 2555 generic.go:356] "Generic (PLEG): container finished" podID="d4608600-2ca0-4cb8-a59a-19db4433938e" containerID="25ef8c626ae2ba39ecf3714cdb0c230f452acbed4e437105205b364fb6c624ba" exitCode=0 Sep 10 12:08:09.371819 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:09.371441 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" event={"ID":"d4608600-2ca0-4cb8-a59a-19db4433938e","Type":"ContainerDied","Data":"25ef8c626ae2ba39ecf3714cdb0c230f452acbed4e437105205b364fb6c624ba"} Sep 10 12:08:09.371819 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:09.371778 2555 scope.go:117] "RemoveContainer" containerID="25ef8c626ae2ba39ecf3714cdb0c230f452acbed4e437105205b364fb6c624ba" Sep 10 12:08:10.377239 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:10.377206 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-w2tt2" event={"ID":"d4608600-2ca0-4cb8-a59a-19db4433938e","Type":"ContainerStarted","Data":"a41d87ca421c642d6e8ff10d26ddad4dca26eb7d76164d97119bfc27811c18c9"} Sep 10 12:08:10.764310 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:10.764225 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:10.830993 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:10.830965 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:22.024338 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:22.024296 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:22.086904 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:22.086873 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:42.949887 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:42.949843 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:43.146924 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:43.146892 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:45.441334 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:45.441302 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:51.040295 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.040259 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:51.119862 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.119817 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:51.839862 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.839826 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-697cc9f954-gt7ph"] Sep 10 12:08:51.840180 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.840165 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" containerName="registry" Sep 10 12:08:51.840233 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.840183 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" containerName="registry" Sep 10 12:08:51.840267 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.840243 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4978d5d8-c8cb-473a-92f1-1fff4f2d3ab9" containerName="registry" Sep 10 12:08:51.842867 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.842847 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:51.857272 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.857250 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697cc9f954-gt7ph"] Sep 10 12:08:51.900967 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.900936 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:51.954927 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.954899 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-oauth-config\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:51.955034 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.954935 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-service-ca\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:51.955034 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.954955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-oauth-serving-cert\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:51.955102 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.955031 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phn82\" (UniqueName: \"kubernetes.io/projected/d3553351-07cc-4e25-8ee8-03dc097d68c9-kube-api-access-phn82\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:51.955102 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.955075 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-config\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:51.955168 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.955102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-trusted-ca-bundle\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:51.955168 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.955130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-serving-cert\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:51.983947 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:51.983913 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:08:52.055978 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.055954 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phn82\" (UniqueName: \"kubernetes.io/projected/d3553351-07cc-4e25-8ee8-03dc097d68c9-kube-api-access-phn82\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.056345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.055983 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-config\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.056345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.056002 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-trusted-ca-bundle\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.056345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.056022 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-serving-cert\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.056345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.056063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-oauth-config\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.056345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.056098 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-service-ca\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.056345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.056186 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-oauth-serving-cert\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.056808 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.056783 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-config\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.056961 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.056881 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-service-ca\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.057077 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.056990 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-oauth-serving-cert\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.057077 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.057065 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-trusted-ca-bundle\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.058812 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.058783 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-oauth-config\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.058887 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.058869 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-serving-cert\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.067915 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.067894 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phn82\" (UniqueName: \"kubernetes.io/projected/d3553351-07cc-4e25-8ee8-03dc097d68c9-kube-api-access-phn82\") pod \"console-697cc9f954-gt7ph\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.153463 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.153374 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:08:52.425947 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.425922 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697cc9f954-gt7ph"] Sep 10 12:08:52.428047 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:08:52.428019 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3553351_07cc_4e25_8ee8_03dc097d68c9.slice/crio-bb64fb019670dc615dc336fd27bef754d954acce1dff5824a3e22421828a2518 WatchSource:0}: Error finding container bb64fb019670dc615dc336fd27bef754d954acce1dff5824a3e22421828a2518: Status 404 returned error can't find the container with id bb64fb019670dc615dc336fd27bef754d954acce1dff5824a3e22421828a2518 Sep 10 12:08:52.531028 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.530989 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697cc9f954-gt7ph" event={"ID":"d3553351-07cc-4e25-8ee8-03dc097d68c9","Type":"ContainerStarted","Data":"b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9"} Sep 10 12:08:52.531166 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.531048 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697cc9f954-gt7ph" event={"ID":"d3553351-07cc-4e25-8ee8-03dc097d68c9","Type":"ContainerStarted","Data":"bb64fb019670dc615dc336fd27bef754d954acce1dff5824a3e22421828a2518"} Sep 10 12:08:52.555139 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:08:52.555094 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-697cc9f954-gt7ph" podStartSLOduration=1.555079052 podStartE2EDuration="1.555079052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:08:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:08:52.554321822 +0000 UTC m=+172.390304408" watchObservedRunningTime="2026-09-10 12:08:52.555079052 +0000 UTC m=+172.391061638" Sep 10 12:09:02.154234 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:02.154142 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:09:02.154234 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:02.154196 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:09:02.158794 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:02.158771 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:09:02.570737 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:02.570661 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:09:02.633138 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:02.633107 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69fddc955-2qf58"] Sep 10 12:09:02.837031 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:02.837006 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:02.946253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:02.946224 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:27.657785 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.657739 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69fddc955-2qf58" podUID="a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" containerName="console" containerID="cri-o://d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489" gracePeriod=15 Sep 10 12:09:27.893983 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.893958 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:09:27.915597 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.915525 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-trusted-ca-bundle\") pod \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " Sep 10 12:09:27.915597 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.915589 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-oauth-config\") pod \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " Sep 10 12:09:27.915741 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.915622 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-oauth-serving-cert\") pod \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " Sep 10 12:09:27.915741 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.915682 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-config\") pod \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " Sep 10 12:09:27.915741 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.915708 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-service-ca\") pod \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " Sep 10 12:09:27.915741 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.915733 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfscr\" (UniqueName: \"kubernetes.io/projected/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-kube-api-access-cfscr\") pod \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " Sep 10 12:09:27.915936 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.915757 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-serving-cert\") pod \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\" (UID: \"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa\") " Sep 10 12:09:27.915936 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.915866 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" (UID: "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:09:27.916065 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.916041 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-trusted-ca-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:09:27.916218 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.916191 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-config" (OuterVolumeSpecName: "console-config") pod "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" (UID: "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:09:27.916218 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.916200 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" (UID: "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:09:27.916344 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.916260 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" (UID: "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:09:27.918942 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.918914 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" (UID: "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:09:27.919414 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.919379 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" (UID: "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:09:27.919511 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:27.919473 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-kube-api-access-cfscr" (OuterVolumeSpecName: "kube-api-access-cfscr") pod "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" (UID: "a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa"). InnerVolumeSpecName "kube-api-access-cfscr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:09:28.016573 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.016539 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-config\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:09:28.016662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.016580 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-service-ca\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:09:28.016662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.016589 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfscr\" (UniqueName: \"kubernetes.io/projected/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-kube-api-access-cfscr\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:09:28.016662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.016599 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-serving-cert\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:09:28.016662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.016608 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-console-oauth-config\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:09:28.016662 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.016616 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa-oauth-serving-cert\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:09:28.662251 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.662210 2555 generic.go:356] "Generic (PLEG): container finished" podID="a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" containerID="d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489" exitCode=0 Sep 10 12:09:28.662689 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.662262 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fddc955-2qf58" Sep 10 12:09:28.662689 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.662296 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fddc955-2qf58" event={"ID":"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa","Type":"ContainerDied","Data":"d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489"} Sep 10 12:09:28.662689 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.662353 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fddc955-2qf58" event={"ID":"a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa","Type":"ContainerDied","Data":"deb26ebb9a9561e2d015fadffa112f9187e9f13b808536cfebb409f11445f779"} Sep 10 12:09:28.662689 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.662374 2555 scope.go:117] "RemoveContainer" containerID="d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489" Sep 10 12:09:28.671181 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.671166 2555 scope.go:117] "RemoveContainer" containerID="d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489" Sep 10 12:09:28.671448 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:09:28.671432 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489\": container with ID starting with d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489 not found: ID does not exist" containerID="d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489" Sep 10 12:09:28.671517 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.671457 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489"} err="failed to get container status \"d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489\": rpc error: code = NotFound desc = could not find container \"d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489\": container with ID starting with d9a611029358187e3cd20b2c77ed7521de06eb65014e8a9beee3647767e2b489 not found: ID does not exist" Sep 10 12:09:28.690046 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.690024 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69fddc955-2qf58"] Sep 10 12:09:28.696474 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.696453 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69fddc955-2qf58"] Sep 10 12:09:28.766994 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:28.766968 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" path="/var/lib/kubelet/pods/a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa/volumes" Sep 10 12:09:29.748066 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:29.748026 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:31.209501 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:31.209466 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:31.272994 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:31.272960 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:58.255614 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:58.255556 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:58.355699 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:09:58.355668 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:04.686824 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.686790 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-774b7d858c-ch69q"] Sep 10 12:10:04.687200 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.687041 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" containerName="console" Sep 10 12:10:04.687200 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.687051 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" containerName="console" Sep 10 12:10:04.687200 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.687107 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2fd4d4f-1ab0-4da3-8098-2bb3da6083fa" containerName="console" Sep 10 12:10:04.691682 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.691658 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.703441 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.703418 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-774b7d858c-ch69q"] Sep 10 12:10:04.750892 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.750853 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:04.761785 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.761763 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-trusted-ca-bundle\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.761859 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.761800 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-serving-cert\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.761859 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.761822 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-config\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.761968 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.761928 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-oauth-serving-cert\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.762015 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.761968 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5jch\" (UniqueName: \"kubernetes.io/projected/c8061d0c-fca6-49f9-8a51-9f838fd1af25-kube-api-access-h5jch\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.762015 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.762001 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-service-ca\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.762077 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.762033 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-oauth-config\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.812157 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.812129 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:04.863158 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.863139 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-trusted-ca-bundle\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.863250 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.863175 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-serving-cert\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.863250 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.863196 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-config\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.863250 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.863222 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-oauth-serving-cert\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.863401 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.863337 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5jch\" (UniqueName: \"kubernetes.io/projected/c8061d0c-fca6-49f9-8a51-9f838fd1af25-kube-api-access-h5jch\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.863401 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.863372 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-service-ca\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.863498 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.863423 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-oauth-config\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.863924 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.863895 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-oauth-serving-cert\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.864020 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.863934 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-config\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.864084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.864038 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-trusted-ca-bundle\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.864084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.864057 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-service-ca\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.865700 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.865671 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-serving-cert\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.865779 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.865714 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-oauth-config\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:04.878852 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:04.878829 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5jch\" (UniqueName: \"kubernetes.io/projected/c8061d0c-fca6-49f9-8a51-9f838fd1af25-kube-api-access-h5jch\") pod \"console-774b7d858c-ch69q\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:05.004288 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:05.004224 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:05.277404 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:05.277270 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-774b7d858c-ch69q"] Sep 10 12:10:05.279984 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:10:05.279956 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8061d0c_fca6_49f9_8a51_9f838fd1af25.slice/crio-c18d588a9595c8eff8c5960d4608ca64458047b02eeffd0372c6e99e8a5a8b8d WatchSource:0}: Error finding container c18d588a9595c8eff8c5960d4608ca64458047b02eeffd0372c6e99e8a5a8b8d: Status 404 returned error can't find the container with id c18d588a9595c8eff8c5960d4608ca64458047b02eeffd0372c6e99e8a5a8b8d Sep 10 12:10:05.798451 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:05.798412 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-774b7d858c-ch69q" event={"ID":"c8061d0c-fca6-49f9-8a51-9f838fd1af25","Type":"ContainerStarted","Data":"e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5"} Sep 10 12:10:05.798959 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:05.798495 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-774b7d858c-ch69q" event={"ID":"c8061d0c-fca6-49f9-8a51-9f838fd1af25","Type":"ContainerStarted","Data":"c18d588a9595c8eff8c5960d4608ca64458047b02eeffd0372c6e99e8a5a8b8d"} Sep 10 12:10:05.825442 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:05.825393 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-774b7d858c-ch69q" podStartSLOduration=1.825378323 podStartE2EDuration="1.825378323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:05.824920336 +0000 UTC m=+245.660902947" watchObservedRunningTime="2026-09-10 12:10:05.825378323 +0000 UTC m=+245.661360908" Sep 10 12:10:10.270437 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:10.270404 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:10.371022 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:10.370990 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:11.153808 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:11.153771 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:15.004951 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:15.004918 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:15.005381 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:15.005061 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:15.010092 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:15.010074 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:15.838961 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:15.838934 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:10:15.914195 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:15.914165 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-697cc9f954-gt7ph"] Sep 10 12:10:16.117579 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:16.117485 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:16.215104 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:16.215070 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:26.067154 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:26.067044 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:26.169394 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:26.169360 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:40.932645 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:40.932587 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-697cc9f954-gt7ph" podUID="d3553351-07cc-4e25-8ee8-03dc097d68c9" containerName="console" containerID="cri-o://b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9" gracePeriod=15 Sep 10 12:10:41.164755 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.164731 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:10:41.322657 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.322586 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-service-ca\") pod \"d3553351-07cc-4e25-8ee8-03dc097d68c9\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " Sep 10 12:10:41.322657 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.322638 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-trusted-ca-bundle\") pod \"d3553351-07cc-4e25-8ee8-03dc097d68c9\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " Sep 10 12:10:41.322860 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.322663 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-oauth-serving-cert\") pod \"d3553351-07cc-4e25-8ee8-03dc097d68c9\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " Sep 10 12:10:41.322860 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.322688 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-serving-cert\") pod \"d3553351-07cc-4e25-8ee8-03dc097d68c9\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " Sep 10 12:10:41.322860 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.322713 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phn82\" (UniqueName: \"kubernetes.io/projected/d3553351-07cc-4e25-8ee8-03dc097d68c9-kube-api-access-phn82\") pod \"d3553351-07cc-4e25-8ee8-03dc097d68c9\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " Sep 10 12:10:41.322860 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.322790 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-config\") pod \"d3553351-07cc-4e25-8ee8-03dc097d68c9\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " Sep 10 12:10:41.323064 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.322851 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3553351-07cc-4e25-8ee8-03dc097d68c9" (UID: "d3553351-07cc-4e25-8ee8-03dc097d68c9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:10:41.323064 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.322869 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-oauth-config\") pod \"d3553351-07cc-4e25-8ee8-03dc097d68c9\" (UID: \"d3553351-07cc-4e25-8ee8-03dc097d68c9\") " Sep 10 12:10:41.323157 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.323067 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-service-ca\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:10:41.323157 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.323120 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d3553351-07cc-4e25-8ee8-03dc097d68c9" (UID: "d3553351-07cc-4e25-8ee8-03dc097d68c9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:10:41.323225 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.323159 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3553351-07cc-4e25-8ee8-03dc097d68c9" (UID: "d3553351-07cc-4e25-8ee8-03dc097d68c9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:10:41.323265 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.323221 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-config" (OuterVolumeSpecName: "console-config") pod "d3553351-07cc-4e25-8ee8-03dc097d68c9" (UID: "d3553351-07cc-4e25-8ee8-03dc097d68c9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:10:41.324902 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.324877 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3553351-07cc-4e25-8ee8-03dc097d68c9" (UID: "d3553351-07cc-4e25-8ee8-03dc097d68c9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:10:41.325152 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.325129 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3553351-07cc-4e25-8ee8-03dc097d68c9" (UID: "d3553351-07cc-4e25-8ee8-03dc097d68c9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:10:41.325198 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.325180 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3553351-07cc-4e25-8ee8-03dc097d68c9-kube-api-access-phn82" (OuterVolumeSpecName: "kube-api-access-phn82") pod "d3553351-07cc-4e25-8ee8-03dc097d68c9" (UID: "d3553351-07cc-4e25-8ee8-03dc097d68c9"). InnerVolumeSpecName "kube-api-access-phn82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:10:41.423552 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.423530 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-serving-cert\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:10:41.423552 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.423553 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phn82\" (UniqueName: \"kubernetes.io/projected/d3553351-07cc-4e25-8ee8-03dc097d68c9-kube-api-access-phn82\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:10:41.423727 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.423596 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-config\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:10:41.423727 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.423609 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3553351-07cc-4e25-8ee8-03dc097d68c9-console-oauth-config\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:10:41.423727 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.423621 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-trusted-ca-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:10:41.423727 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.423633 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3553351-07cc-4e25-8ee8-03dc097d68c9-oauth-serving-cert\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:10:41.928623 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.928591 2555 generic.go:356] "Generic (PLEG): container finished" podID="d3553351-07cc-4e25-8ee8-03dc097d68c9" containerID="b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9" exitCode=0 Sep 10 12:10:41.928777 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.928696 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697cc9f954-gt7ph" Sep 10 12:10:41.928777 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.928700 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697cc9f954-gt7ph" event={"ID":"d3553351-07cc-4e25-8ee8-03dc097d68c9","Type":"ContainerDied","Data":"b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9"} Sep 10 12:10:41.928777 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.928748 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697cc9f954-gt7ph" event={"ID":"d3553351-07cc-4e25-8ee8-03dc097d68c9","Type":"ContainerDied","Data":"bb64fb019670dc615dc336fd27bef754d954acce1dff5824a3e22421828a2518"} Sep 10 12:10:41.928777 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.928775 2555 scope.go:117] "RemoveContainer" containerID="b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9" Sep 10 12:10:41.937468 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.937283 2555 scope.go:117] "RemoveContainer" containerID="b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9" Sep 10 12:10:41.937720 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:10:41.937596 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9\": container with ID starting with b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9 not found: ID does not exist" containerID="b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9" Sep 10 12:10:41.937720 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.937628 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9"} err="failed to get container status \"b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9\": rpc error: code = NotFound desc = could not find container \"b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9\": container with ID starting with b1f6bc18db225a43add8ebb675dd875d4613921a0dc6b13e62f868ddc2b342b9 not found: ID does not exist" Sep 10 12:10:41.959734 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.959711 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-697cc9f954-gt7ph"] Sep 10 12:10:41.966058 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:41.966039 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-697cc9f954-gt7ph"] Sep 10 12:10:42.766390 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:42.766357 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3553351-07cc-4e25-8ee8-03dc097d68c9" path="/var/lib/kubelet/pods/d3553351-07cc-4e25-8ee8-03dc097d68c9/volumes" Sep 10 12:10:42.863748 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:42.863716 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:54.192005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:54.191968 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:54.336691 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:54.336659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:55.546262 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.546230 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g"] Sep 10 12:10:55.546673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.546480 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3553351-07cc-4e25-8ee8-03dc097d68c9" containerName="console" Sep 10 12:10:55.546673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.546490 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3553351-07cc-4e25-8ee8-03dc097d68c9" containerName="console" Sep 10 12:10:55.546673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.546546 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3553351-07cc-4e25-8ee8-03dc097d68c9" containerName="console" Sep 10 12:10:55.549464 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.549445 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:55.552683 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.552663 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:10:55.552872 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.552858 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:10:55.553999 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.553982 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9h588\"" Sep 10 12:10:55.564373 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.564337 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g"] Sep 10 12:10:55.723871 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.723846 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:55.723979 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.723876 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:55.723979 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.723900 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2s6f\" (UniqueName: \"kubernetes.io/projected/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-kube-api-access-w2s6f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:55.824426 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.824368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:55.824426 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.824396 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:55.824426 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.824415 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2s6f\" (UniqueName: \"kubernetes.io/projected/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-kube-api-access-w2s6f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:55.824802 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.824786 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:55.824842 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.824818 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:55.835064 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.835033 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2s6f\" (UniqueName: \"kubernetes.io/projected/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-kube-api-access-w2s6f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:55.858620 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:55.858600 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:10:56.134411 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:56.134389 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g"] Sep 10 12:10:56.136703 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:10:56.136676 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503c699b_ecc0_4b45_8ed2_3c45ab49c2d7.slice/crio-43c30d0c6892a24703a5835e43e572e5980fe8cca33f1a6da2c37ef10692850b WatchSource:0}: Error finding container 43c30d0c6892a24703a5835e43e572e5980fe8cca33f1a6da2c37ef10692850b: Status 404 returned error can't find the container with id 43c30d0c6892a24703a5835e43e572e5980fe8cca33f1a6da2c37ef10692850b Sep 10 12:10:56.983845 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:10:56.983813 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" event={"ID":"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7","Type":"ContainerStarted","Data":"43c30d0c6892a24703a5835e43e572e5980fe8cca33f1a6da2c37ef10692850b"} Sep 10 12:11:00.531896 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:00.531866 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/2.log" Sep 10 12:11:00.533347 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:00.533325 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/2.log" Sep 10 12:11:00.542887 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:00.542866 2555 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 12:11:04.013786 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:04.013751 2555 generic.go:356] "Generic (PLEG): container finished" podID="503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" containerID="4910507fe3844f20947ccadbe6f005d044f3809f71054ae862709a94ffd4e02e" exitCode=0 Sep 10 12:11:04.014180 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:04.013803 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" event={"ID":"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7","Type":"ContainerDied","Data":"4910507fe3844f20947ccadbe6f005d044f3809f71054ae862709a94ffd4e02e"} Sep 10 12:11:04.014797 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:04.014777 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:11:10.039176 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:10.039143 2555 generic.go:356] "Generic (PLEG): container finished" podID="503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" containerID="33446da3ae1d3234de9f31cbd6cf3a85f93e6651a448da2b0b0f60daa288effc" exitCode=0 Sep 10 12:11:10.039673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:10.039231 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" event={"ID":"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7","Type":"ContainerDied","Data":"33446da3ae1d3234de9f31cbd6cf3a85f93e6651a448da2b0b0f60daa288effc"} Sep 10 12:11:18.071381 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:18.071347 2555 generic.go:356] "Generic (PLEG): container finished" podID="503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" containerID="c75d5a3c0c6c9c8120c800072fe0184da7caf4cdeb2695c6a28323fca8217683" exitCode=0 Sep 10 12:11:18.071381 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:18.071384 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" event={"ID":"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7","Type":"ContainerDied","Data":"c75d5a3c0c6c9c8120c800072fe0184da7caf4cdeb2695c6a28323fca8217683"} Sep 10 12:11:19.240319 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:19.240289 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:11:19.301825 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:19.301793 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2s6f\" (UniqueName: \"kubernetes.io/projected/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-kube-api-access-w2s6f\") pod \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " Sep 10 12:11:19.301974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:19.301833 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-bundle\") pod \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " Sep 10 12:11:19.301974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:19.301938 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-util\") pod \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\" (UID: \"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7\") " Sep 10 12:11:19.302479 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:19.302455 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-bundle" (OuterVolumeSpecName: "bundle") pod "503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" (UID: "503c699b-ecc0-4b45-8ed2-3c45ab49c2d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:11:19.304036 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:19.304008 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-kube-api-access-w2s6f" (OuterVolumeSpecName: "kube-api-access-w2s6f") pod "503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" (UID: "503c699b-ecc0-4b45-8ed2-3c45ab49c2d7"). InnerVolumeSpecName "kube-api-access-w2s6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:11:19.306027 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:19.306007 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-util" (OuterVolumeSpecName: "util") pod "503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" (UID: "503c699b-ecc0-4b45-8ed2-3c45ab49c2d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:11:19.402429 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:19.402407 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-util\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:11:19.402429 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:19.402428 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2s6f\" (UniqueName: \"kubernetes.io/projected/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-kube-api-access-w2s6f\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:11:19.402543 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:19.402438 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/503c699b-ecc0-4b45-8ed2-3c45ab49c2d7-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:11:20.080425 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:20.080393 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" event={"ID":"503c699b-ecc0-4b45-8ed2-3c45ab49c2d7","Type":"ContainerDied","Data":"43c30d0c6892a24703a5835e43e572e5980fe8cca33f1a6da2c37ef10692850b"} Sep 10 12:11:20.080582 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:20.080438 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43c30d0c6892a24703a5835e43e572e5980fe8cca33f1a6da2c37ef10692850b" Sep 10 12:11:20.080582 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:20.080490 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drw2g" Sep 10 12:11:21.809930 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:21.809894 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:23.248123 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:23.248080 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:24.152815 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.152784 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f"] Sep 10 12:11:24.153048 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.153035 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" containerName="extract" Sep 10 12:11:24.153096 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.153048 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" containerName="extract" Sep 10 12:11:24.153096 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.153061 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" containerName="util" Sep 10 12:11:24.153096 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.153066 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" containerName="util" Sep 10 12:11:24.153096 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.153080 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" containerName="pull" Sep 10 12:11:24.153096 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.153085 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" containerName="pull" Sep 10 12:11:24.153270 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.153134 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="503c699b-ecc0-4b45-8ed2-3c45ab49c2d7" containerName="extract" Sep 10 12:11:24.154822 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.154805 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" Sep 10 12:11:24.161138 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.161113 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:11:24.161254 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.161178 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fx9s7\"" Sep 10 12:11:24.161254 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.161114 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 12:11:24.174661 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.174637 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f"] Sep 10 12:11:24.237517 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.237496 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/347131eb-fe47-4ce8-b211-c3038d6bf965-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jvq2f\" (UID: \"347131eb-fe47-4ce8-b211-c3038d6bf965\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" Sep 10 12:11:24.237644 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.237529 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57qqp\" (UniqueName: \"kubernetes.io/projected/347131eb-fe47-4ce8-b211-c3038d6bf965-kube-api-access-57qqp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jvq2f\" (UID: \"347131eb-fe47-4ce8-b211-c3038d6bf965\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" Sep 10 12:11:24.338190 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.338156 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/347131eb-fe47-4ce8-b211-c3038d6bf965-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jvq2f\" (UID: \"347131eb-fe47-4ce8-b211-c3038d6bf965\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" Sep 10 12:11:24.338487 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.338199 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57qqp\" (UniqueName: \"kubernetes.io/projected/347131eb-fe47-4ce8-b211-c3038d6bf965-kube-api-access-57qqp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jvq2f\" (UID: \"347131eb-fe47-4ce8-b211-c3038d6bf965\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" Sep 10 12:11:24.338527 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.338501 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/347131eb-fe47-4ce8-b211-c3038d6bf965-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jvq2f\" (UID: \"347131eb-fe47-4ce8-b211-c3038d6bf965\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" Sep 10 12:11:24.349840 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.349818 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57qqp\" (UniqueName: \"kubernetes.io/projected/347131eb-fe47-4ce8-b211-c3038d6bf965-kube-api-access-57qqp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jvq2f\" (UID: \"347131eb-fe47-4ce8-b211-c3038d6bf965\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" Sep 10 12:11:24.463380 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.463332 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" Sep 10 12:11:24.755956 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:24.755925 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f"] Sep 10 12:11:24.757935 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:11:24.757902 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347131eb_fe47_4ce8_b211_c3038d6bf965.slice/crio-ff9dcfd970f11455f304851b80fc4ecb190ed618f05de40dd462ac8a2230f64d WatchSource:0}: Error finding container ff9dcfd970f11455f304851b80fc4ecb190ed618f05de40dd462ac8a2230f64d: Status 404 returned error can't find the container with id ff9dcfd970f11455f304851b80fc4ecb190ed618f05de40dd462ac8a2230f64d Sep 10 12:11:25.101106 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:25.101067 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" event={"ID":"347131eb-fe47-4ce8-b211-c3038d6bf965","Type":"ContainerStarted","Data":"ff9dcfd970f11455f304851b80fc4ecb190ed618f05de40dd462ac8a2230f64d"} Sep 10 12:11:26.030312 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:26.030277 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:26.135217 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:26.135185 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:27.884814 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:27.884773 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:28.114082 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.114053 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" event={"ID":"347131eb-fe47-4ce8-b211-c3038d6bf965","Type":"ContainerStarted","Data":"fc9e139fa75dd01ef6e332b2162f508a8f26be435ce12eb210554579bdd6f7e6"} Sep 10 12:11:28.140442 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.140363 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:28.189546 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.189504 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jvq2f" podStartSLOduration=1.8875781360000001 podStartE2EDuration="4.189492941s" totalImagesPullingTime="2.301914805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:28.185831065 +0000 UTC m=+328.021813650" watchObservedRunningTime="2026-09-10 12:11:28.189492941 +0000 UTC m=+328.025475527" Sep 10 12:11:28.223351 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.223321 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-22gbt"] Sep 10 12:11:28.225369 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.225352 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" Sep 10 12:11:28.229063 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.229042 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 12:11:28.229169 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.229078 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 12:11:28.229552 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.229535 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bgnzq\"" Sep 10 12:11:28.261135 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.261105 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-22gbt"] Sep 10 12:11:28.264131 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.264107 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/074379e5-6275-4c59-bb50-e49ca9a4e96b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-22gbt\" (UID: \"074379e5-6275-4c59-bb50-e49ca9a4e96b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" Sep 10 12:11:28.264223 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.264175 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rghd\" (UniqueName: \"kubernetes.io/projected/074379e5-6275-4c59-bb50-e49ca9a4e96b-kube-api-access-9rghd\") pod \"cert-manager-webhook-6486ffd997-22gbt\" (UID: \"074379e5-6275-4c59-bb50-e49ca9a4e96b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" Sep 10 12:11:28.364943 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.364914 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rghd\" (UniqueName: \"kubernetes.io/projected/074379e5-6275-4c59-bb50-e49ca9a4e96b-kube-api-access-9rghd\") pod \"cert-manager-webhook-6486ffd997-22gbt\" (UID: \"074379e5-6275-4c59-bb50-e49ca9a4e96b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" Sep 10 12:11:28.365052 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.364949 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/074379e5-6275-4c59-bb50-e49ca9a4e96b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-22gbt\" (UID: \"074379e5-6275-4c59-bb50-e49ca9a4e96b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" Sep 10 12:11:28.407827 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.407771 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/074379e5-6275-4c59-bb50-e49ca9a4e96b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-22gbt\" (UID: \"074379e5-6275-4c59-bb50-e49ca9a4e96b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" Sep 10 12:11:28.416215 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.416188 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rghd\" (UniqueName: \"kubernetes.io/projected/074379e5-6275-4c59-bb50-e49ca9a4e96b-kube-api-access-9rghd\") pod \"cert-manager-webhook-6486ffd997-22gbt\" (UID: \"074379e5-6275-4c59-bb50-e49ca9a4e96b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" Sep 10 12:11:28.534974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.534950 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" Sep 10 12:11:28.833063 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.832990 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:28.837958 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:28.837937 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-22gbt"] Sep 10 12:11:28.839721 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:11:28.839691 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod074379e5_6275_4c59_bb50_e49ca9a4e96b.slice/crio-aca70bb8fbdc6509320029d5c3a4c82638c011e30167a6923ab888d382e93ff2 WatchSource:0}: Error finding container aca70bb8fbdc6509320029d5c3a4c82638c011e30167a6923ab888d382e93ff2: Status 404 returned error can't find the container with id aca70bb8fbdc6509320029d5c3a4c82638c011e30167a6923ab888d382e93ff2 Sep 10 12:11:29.119076 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.119048 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" event={"ID":"074379e5-6275-4c59-bb50-e49ca9a4e96b","Type":"ContainerStarted","Data":"aca70bb8fbdc6509320029d5c3a4c82638c011e30167a6923ab888d382e93ff2"} Sep 10 12:11:29.232269 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.232239 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt"] Sep 10 12:11:29.235086 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.235067 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.238372 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.238354 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9h588\"" Sep 10 12:11:29.238780 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.238764 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:11:29.239612 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.239553 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:11:29.239762 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.239736 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:29.272915 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.272892 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.273003 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.272920 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkdd6\" (UniqueName: \"kubernetes.io/projected/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-kube-api-access-fkdd6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.273003 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.272949 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.281389 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.281370 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt"] Sep 10 12:11:29.373892 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.373836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkdd6\" (UniqueName: \"kubernetes.io/projected/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-kube-api-access-fkdd6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.373892 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.373880 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.374032 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.373948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.374280 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.374264 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.374323 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.374296 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.391321 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.391298 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkdd6\" (UniqueName: \"kubernetes.io/projected/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-kube-api-access-fkdd6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.545180 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.545156 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:29.855347 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:29.852446 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt"] Sep 10 12:11:30.125762 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:30.125684 2555 generic.go:356] "Generic (PLEG): container finished" podID="a93c6fd9-6d98-490f-810a-e0efb6b74ce0" containerID="ce52c87463b9c9fa2ec678c15f2c2f50dd591c2e9fce390cbbde27ef55f308ae" exitCode=0 Sep 10 12:11:30.126177 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:30.125763 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" event={"ID":"a93c6fd9-6d98-490f-810a-e0efb6b74ce0","Type":"ContainerDied","Data":"ce52c87463b9c9fa2ec678c15f2c2f50dd591c2e9fce390cbbde27ef55f308ae"} Sep 10 12:11:30.126177 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:30.125809 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" event={"ID":"a93c6fd9-6d98-490f-810a-e0efb6b74ce0","Type":"ContainerStarted","Data":"8dc6e7c3bd73c4f501b3e79984f764415f9801aaad6a0b11047781242e207c6c"} Sep 10 12:11:30.500214 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:30.500175 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:30.755122 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:30.755028 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:32.138449 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:32.138351 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" event={"ID":"074379e5-6275-4c59-bb50-e49ca9a4e96b","Type":"ContainerStarted","Data":"e71c1bb04a6d9c4e24625a037a59feafb3251aa379fd99e898cb5b6d193c504d"} Sep 10 12:11:32.138449 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:32.138438 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" Sep 10 12:11:32.214442 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:32.214356 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" podStartSLOduration=1.168894391 podStartE2EDuration="4.214335985s" totalImagesPullingTime="3.045441594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:32.212991532 +0000 UTC m=+332.048974118" watchObservedRunningTime="2026-09-10 12:11:32.214335985 +0000 UTC m=+332.050318571" Sep 10 12:11:33.755791 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:33.755752 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:33.944679 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:33.944640 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:34.150272 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:34.150241 2555 generic.go:356] "Generic (PLEG): container finished" podID="a93c6fd9-6d98-490f-810a-e0efb6b74ce0" containerID="4d01ac3e21e6432cbeb151accfc4a43c3497f32f884bfd3a7e2567c2e48d39fa" exitCode=0 Sep 10 12:11:34.150426 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:34.150297 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" event={"ID":"a93c6fd9-6d98-490f-810a-e0efb6b74ce0","Type":"ContainerDied","Data":"4d01ac3e21e6432cbeb151accfc4a43c3497f32f884bfd3a7e2567c2e48d39fa"} Sep 10 12:11:35.156356 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:35.156319 2555 generic.go:356] "Generic (PLEG): container finished" podID="a93c6fd9-6d98-490f-810a-e0efb6b74ce0" containerID="d06cc29f47d1647c700c1b4fe155229cf380e48be23613b3ce646459e8b4c6fb" exitCode=0 Sep 10 12:11:35.156728 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:35.156398 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" event={"ID":"a93c6fd9-6d98-490f-810a-e0efb6b74ce0","Type":"ContainerDied","Data":"d06cc29f47d1647c700c1b4fe155229cf380e48be23613b3ce646459e8b4c6fb"} Sep 10 12:11:36.280843 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.280818 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:36.332524 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.332502 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-bundle\") pod \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " Sep 10 12:11:36.332681 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.332531 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-util\") pod \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " Sep 10 12:11:36.332681 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.332588 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkdd6\" (UniqueName: \"kubernetes.io/projected/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-kube-api-access-fkdd6\") pod \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\" (UID: \"a93c6fd9-6d98-490f-810a-e0efb6b74ce0\") " Sep 10 12:11:36.332875 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.332852 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-bundle" (OuterVolumeSpecName: "bundle") pod "a93c6fd9-6d98-490f-810a-e0efb6b74ce0" (UID: "a93c6fd9-6d98-490f-810a-e0efb6b74ce0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:11:36.334490 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.334463 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-kube-api-access-fkdd6" (OuterVolumeSpecName: "kube-api-access-fkdd6") pod "a93c6fd9-6d98-490f-810a-e0efb6b74ce0" (UID: "a93c6fd9-6d98-490f-810a-e0efb6b74ce0"). InnerVolumeSpecName "kube-api-access-fkdd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:11:36.338726 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.338682 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-util" (OuterVolumeSpecName: "util") pod "a93c6fd9-6d98-490f-810a-e0efb6b74ce0" (UID: "a93c6fd9-6d98-490f-810a-e0efb6b74ce0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:11:36.433831 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.433781 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:11:36.433831 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.433800 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-util\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:11:36.433831 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.433809 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkdd6\" (UniqueName: \"kubernetes.io/projected/a93c6fd9-6d98-490f-810a-e0efb6b74ce0-kube-api-access-fkdd6\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:11:36.723583 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.723506 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:36.920302 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:36.920274 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:37.167606 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:37.167578 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" Sep 10 12:11:37.167764 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:37.167548 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mggt" event={"ID":"a93c6fd9-6d98-490f-810a-e0efb6b74ce0","Type":"ContainerDied","Data":"8dc6e7c3bd73c4f501b3e79984f764415f9801aaad6a0b11047781242e207c6c"} Sep 10 12:11:37.167764 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:37.167710 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8dc6e7c3bd73c4f501b3e79984f764415f9801aaad6a0b11047781242e207c6c" Sep 10 12:11:38.146464 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:38.146431 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-22gbt" Sep 10 12:11:38.493434 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:38.493347 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:40.020403 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:40.020363 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:40.129683 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:40.129646 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:41.401598 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.401551 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm"] Sep 10 12:11:41.401954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.401828 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a93c6fd9-6d98-490f-810a-e0efb6b74ce0" containerName="extract" Sep 10 12:11:41.401954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.401840 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a93c6fd9-6d98-490f-810a-e0efb6b74ce0" containerName="extract" Sep 10 12:11:41.401954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.401861 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a93c6fd9-6d98-490f-810a-e0efb6b74ce0" containerName="util" Sep 10 12:11:41.401954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.401868 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a93c6fd9-6d98-490f-810a-e0efb6b74ce0" containerName="util" Sep 10 12:11:41.401954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.401878 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a93c6fd9-6d98-490f-810a-e0efb6b74ce0" containerName="pull" Sep 10 12:11:41.401954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.401884 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a93c6fd9-6d98-490f-810a-e0efb6b74ce0" containerName="pull" Sep 10 12:11:41.401954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.401929 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a93c6fd9-6d98-490f-810a-e0efb6b74ce0" containerName="extract" Sep 10 12:11:41.404785 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.404768 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" Sep 10 12:11:41.408392 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.408369 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 12:11:41.409373 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.409357 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pbqhl\"" Sep 10 12:11:41.409451 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.409374 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:11:41.418730 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.418709 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm"] Sep 10 12:11:41.479480 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.479446 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3930088e-03c4-427f-87d1-93ec0b84c4c8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-84jjm\" (UID: \"3930088e-03c4-427f-87d1-93ec0b84c4c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" Sep 10 12:11:41.479621 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.479494 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpmvz\" (UniqueName: \"kubernetes.io/projected/3930088e-03c4-427f-87d1-93ec0b84c4c8-kube-api-access-hpmvz\") pod \"openshift-lws-operator-fd8ccff4c-84jjm\" (UID: \"3930088e-03c4-427f-87d1-93ec0b84c4c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" Sep 10 12:11:41.579831 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.579794 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3930088e-03c4-427f-87d1-93ec0b84c4c8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-84jjm\" (UID: \"3930088e-03c4-427f-87d1-93ec0b84c4c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" Sep 10 12:11:41.579983 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.579838 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpmvz\" (UniqueName: \"kubernetes.io/projected/3930088e-03c4-427f-87d1-93ec0b84c4c8-kube-api-access-hpmvz\") pod \"openshift-lws-operator-fd8ccff4c-84jjm\" (UID: \"3930088e-03c4-427f-87d1-93ec0b84c4c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" Sep 10 12:11:41.580150 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.580132 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3930088e-03c4-427f-87d1-93ec0b84c4c8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-84jjm\" (UID: \"3930088e-03c4-427f-87d1-93ec0b84c4c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" Sep 10 12:11:41.593634 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.593612 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpmvz\" (UniqueName: \"kubernetes.io/projected/3930088e-03c4-427f-87d1-93ec0b84c4c8-kube-api-access-hpmvz\") pod \"openshift-lws-operator-fd8ccff4c-84jjm\" (UID: \"3930088e-03c4-427f-87d1-93ec0b84c4c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" Sep 10 12:11:41.713179 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.713115 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" Sep 10 12:11:41.996439 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:41.996394 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm"] Sep 10 12:11:41.999205 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:11:41.999178 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3930088e_03c4_427f_87d1_93ec0b84c4c8.slice/crio-4b84938c8f3422d813e71464ee4dc5b3e94bda064019c8310d19b1d93a69ca40 WatchSource:0}: Error finding container 4b84938c8f3422d813e71464ee4dc5b3e94bda064019c8310d19b1d93a69ca40: Status 404 returned error can't find the container with id 4b84938c8f3422d813e71464ee4dc5b3e94bda064019c8310d19b1d93a69ca40 Sep 10 12:11:42.190144 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:42.190110 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" event={"ID":"3930088e-03c4-427f-87d1-93ec0b84c4c8","Type":"ContainerStarted","Data":"4b84938c8f3422d813e71464ee4dc5b3e94bda064019c8310d19b1d93a69ca40"} Sep 10 12:11:44.201779 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:44.201749 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" event={"ID":"3930088e-03c4-427f-87d1-93ec0b84c4c8","Type":"ContainerStarted","Data":"a78560e54cc1340b875cd8dff641c76b8f195b1685699cd107678c1758948870"} Sep 10 12:11:44.220392 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:44.220342 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-84jjm" podStartSLOduration=1.141092715 podStartE2EDuration="3.220327258s" totalImagesPullingTime="2.079234543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:44.220104122 +0000 UTC m=+344.056086711" watchObservedRunningTime="2026-09-10 12:11:44.220327258 +0000 UTC m=+344.056309843" Sep 10 12:11:45.391978 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:45.391930 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:45.491115 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:45.491078 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:47.186978 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.186943 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:47.719982 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.719948 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v"] Sep 10 12:11:47.742260 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.742234 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v"] Sep 10 12:11:47.742436 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.742341 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:47.745460 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.745439 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:11:47.745644 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.745623 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:11:47.745723 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.745628 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9h588\"" Sep 10 12:11:47.829590 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.829545 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:47.829705 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.829609 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:47.829705 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.829664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpdk5\" (UniqueName: \"kubernetes.io/projected/ba9afb43-203b-447f-948f-65c88f298031-kube-api-access-mpdk5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:47.931041 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.931015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:47.931188 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.931071 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:47.931188 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.931102 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpdk5\" (UniqueName: \"kubernetes.io/projected/ba9afb43-203b-447f-948f-65c88f298031-kube-api-access-mpdk5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:47.931386 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.931367 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:47.931456 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.931386 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:47.940194 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:47.940174 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpdk5\" (UniqueName: \"kubernetes.io/projected/ba9afb43-203b-447f-948f-65c88f298031-kube-api-access-mpdk5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:48.051923 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:48.051865 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:48.343369 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:48.343334 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v"] Sep 10 12:11:48.346227 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:11:48.346197 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9afb43_203b_447f_948f_65c88f298031.slice/crio-f4e0fc9a022b061296ab2c4c7584f776bf944f194545b0be2516c76002f63b4f WatchSource:0}: Error finding container f4e0fc9a022b061296ab2c4c7584f776bf944f194545b0be2516c76002f63b4f: Status 404 returned error can't find the container with id f4e0fc9a022b061296ab2c4c7584f776bf944f194545b0be2516c76002f63b4f Sep 10 12:11:49.225803 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:49.225719 2555 generic.go:356] "Generic (PLEG): container finished" podID="ba9afb43-203b-447f-948f-65c88f298031" containerID="8a3d9e57b509148add2ec351db7fe8e2863c25b63bf451e566530e4f65504720" exitCode=0 Sep 10 12:11:49.225952 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:49.225853 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" event={"ID":"ba9afb43-203b-447f-948f-65c88f298031","Type":"ContainerDied","Data":"8a3d9e57b509148add2ec351db7fe8e2863c25b63bf451e566530e4f65504720"} Sep 10 12:11:49.225952 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:49.225910 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" event={"ID":"ba9afb43-203b-447f-948f-65c88f298031","Type":"ContainerStarted","Data":"f4e0fc9a022b061296ab2c4c7584f776bf944f194545b0be2516c76002f63b4f"} Sep 10 12:11:50.231948 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:50.231917 2555 generic.go:356] "Generic (PLEG): container finished" podID="ba9afb43-203b-447f-948f-65c88f298031" containerID="3e2845abbd411323969d37b6f216e43327af055e434ac528d0afc4bbc5d0539b" exitCode=0 Sep 10 12:11:50.232302 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:50.231972 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" event={"ID":"ba9afb43-203b-447f-948f-65c88f298031","Type":"ContainerDied","Data":"3e2845abbd411323969d37b6f216e43327af055e434ac528d0afc4bbc5d0539b"} Sep 10 12:11:51.238479 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:51.238441 2555 generic.go:356] "Generic (PLEG): container finished" podID="ba9afb43-203b-447f-948f-65c88f298031" containerID="c99a0dfd002dc5dc1b2402db0682bfe057dd92e4a287f1391387cfd3222516c2" exitCode=0 Sep 10 12:11:51.238863 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:51.238500 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" event={"ID":"ba9afb43-203b-447f-948f-65c88f298031","Type":"ContainerDied","Data":"c99a0dfd002dc5dc1b2402db0682bfe057dd92e4a287f1391387cfd3222516c2"} Sep 10 12:11:52.360453 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:52.360431 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:52.464789 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:52.464761 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-bundle\") pod \"ba9afb43-203b-447f-948f-65c88f298031\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " Sep 10 12:11:52.464935 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:52.464819 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-util\") pod \"ba9afb43-203b-447f-948f-65c88f298031\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " Sep 10 12:11:52.464935 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:52.464839 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpdk5\" (UniqueName: \"kubernetes.io/projected/ba9afb43-203b-447f-948f-65c88f298031-kube-api-access-mpdk5\") pod \"ba9afb43-203b-447f-948f-65c88f298031\" (UID: \"ba9afb43-203b-447f-948f-65c88f298031\") " Sep 10 12:11:52.465409 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:52.465370 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-bundle" (OuterVolumeSpecName: "bundle") pod "ba9afb43-203b-447f-948f-65c88f298031" (UID: "ba9afb43-203b-447f-948f-65c88f298031"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:11:52.466868 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:52.466847 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9afb43-203b-447f-948f-65c88f298031-kube-api-access-mpdk5" (OuterVolumeSpecName: "kube-api-access-mpdk5") pod "ba9afb43-203b-447f-948f-65c88f298031" (UID: "ba9afb43-203b-447f-948f-65c88f298031"). InnerVolumeSpecName "kube-api-access-mpdk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:11:52.470160 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:52.470127 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-util" (OuterVolumeSpecName: "util") pod "ba9afb43-203b-447f-948f-65c88f298031" (UID: "ba9afb43-203b-447f-948f-65c88f298031"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:11:52.565820 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:52.565766 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.565820 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:52.565787 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba9afb43-203b-447f-948f-65c88f298031-util\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.565820 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:52.565797 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpdk5\" (UniqueName: \"kubernetes.io/projected/ba9afb43-203b-447f-948f-65c88f298031-kube-api-access-mpdk5\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:11:53.248438 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:53.248362 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" event={"ID":"ba9afb43-203b-447f-948f-65c88f298031","Type":"ContainerDied","Data":"f4e0fc9a022b061296ab2c4c7584f776bf944f194545b0be2516c76002f63b4f"} Sep 10 12:11:53.248438 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:53.248405 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6842v" Sep 10 12:11:53.248636 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:11:53.248409 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4e0fc9a022b061296ab2c4c7584f776bf944f194545b0be2516c76002f63b4f" Sep 10 12:12:04.116917 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.116869 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:04.217178 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.217131 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:04.581580 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.581486 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm"] Sep 10 12:12:04.581815 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.581801 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9afb43-203b-447f-948f-65c88f298031" containerName="extract" Sep 10 12:12:04.581858 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.581817 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9afb43-203b-447f-948f-65c88f298031" containerName="extract" Sep 10 12:12:04.581858 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.581841 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9afb43-203b-447f-948f-65c88f298031" containerName="util" Sep 10 12:12:04.581858 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.581847 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9afb43-203b-447f-948f-65c88f298031" containerName="util" Sep 10 12:12:04.581950 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.581859 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9afb43-203b-447f-948f-65c88f298031" containerName="pull" Sep 10 12:12:04.581950 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.581865 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9afb43-203b-447f-948f-65c88f298031" containerName="pull" Sep 10 12:12:04.581950 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.581915 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9afb43-203b-447f-948f-65c88f298031" containerName="extract" Sep 10 12:12:04.584603 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.584580 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:04.587714 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.587697 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:12:04.588869 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.588855 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9h588\"" Sep 10 12:12:04.588951 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.588893 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:12:04.599512 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.599489 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm"] Sep 10 12:12:04.749669 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.749643 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:04.752609 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.752586 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:04.752722 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.752620 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:04.752722 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.752647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8zrp\" (UniqueName: \"kubernetes.io/projected/7e3f25f4-6538-4d29-94a1-8259eb9512fd-kube-api-access-r8zrp\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:04.853606 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.853583 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:04.853748 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.853622 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:04.853851 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.853828 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8zrp\" (UniqueName: \"kubernetes.io/projected/7e3f25f4-6538-4d29-94a1-8259eb9512fd-kube-api-access-r8zrp\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:04.853974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.853959 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:04.854054 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.853993 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:04.872549 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.872520 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8zrp\" (UniqueName: \"kubernetes.io/projected/7e3f25f4-6538-4d29-94a1-8259eb9512fd-kube-api-access-r8zrp\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:04.893152 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:04.893128 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:05.107880 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.107797 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:05.200235 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.200210 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm"] Sep 10 12:12:05.202700 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:12:05.202671 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3f25f4_6538_4d29_94a1_8259eb9512fd.slice/crio-fa35203391b76b8c22b8921bac9c2b56ce621aa1b7b2b3b710c9c407627d2ed4 WatchSource:0}: Error finding container fa35203391b76b8c22b8921bac9c2b56ce621aa1b7b2b3b710c9c407627d2ed4: Status 404 returned error can't find the container with id fa35203391b76b8c22b8921bac9c2b56ce621aa1b7b2b3b710c9c407627d2ed4 Sep 10 12:12:05.264842 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.264817 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n"] Sep 10 12:12:05.267386 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.267366 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.270458 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.270434 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 12:12:05.270711 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.270694 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 12:12:05.271526 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.271475 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 12:12:05.271806 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.271785 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rzdvf\"" Sep 10 12:12:05.271898 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.271868 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 12:12:05.291035 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.291012 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n"] Sep 10 12:12:05.303255 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.303219 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" event={"ID":"7e3f25f4-6538-4d29-94a1-8259eb9512fd","Type":"ContainerStarted","Data":"aa85595c561d33be2a188311edb6ae876895624bbf7ac822ca945b7bf7344c07"} Sep 10 12:12:05.303366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.303289 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" event={"ID":"7e3f25f4-6538-4d29-94a1-8259eb9512fd","Type":"ContainerStarted","Data":"fa35203391b76b8c22b8921bac9c2b56ce621aa1b7b2b3b710c9c407627d2ed4"} Sep 10 12:12:05.357791 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.357761 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/21175ba6-0cf8-48a7-aa77-9db86931a433-manifests\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.357791 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.357794 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21175ba6-0cf8-48a7-aa77-9db86931a433-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.358020 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.357818 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21175ba6-0cf8-48a7-aa77-9db86931a433-tmp\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.358020 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.357884 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21175ba6-0cf8-48a7-aa77-9db86931a433-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.358020 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.357930 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnr26\" (UniqueName: \"kubernetes.io/projected/21175ba6-0cf8-48a7-aa77-9db86931a433-kube-api-access-vnr26\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.458327 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.458292 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/21175ba6-0cf8-48a7-aa77-9db86931a433-manifests\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.458327 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.458328 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21175ba6-0cf8-48a7-aa77-9db86931a433-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.458547 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.458364 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21175ba6-0cf8-48a7-aa77-9db86931a433-tmp\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.458547 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.458447 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21175ba6-0cf8-48a7-aa77-9db86931a433-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.458547 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.458494 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnr26\" (UniqueName: \"kubernetes.io/projected/21175ba6-0cf8-48a7-aa77-9db86931a433-kube-api-access-vnr26\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.458813 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.458787 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/21175ba6-0cf8-48a7-aa77-9db86931a433-manifests\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.460835 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.460802 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21175ba6-0cf8-48a7-aa77-9db86931a433-tmp\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.460948 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.460895 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21175ba6-0cf8-48a7-aa77-9db86931a433-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.461039 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.461021 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21175ba6-0cf8-48a7-aa77-9db86931a433-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.469060 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.469037 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnr26\" (UniqueName: \"kubernetes.io/projected/21175ba6-0cf8-48a7-aa77-9db86931a433-kube-api-access-vnr26\") pod \"opendatahub-operator-controller-manager-7d9854688c-m7p7n\" (UID: \"21175ba6-0cf8-48a7-aa77-9db86931a433\") " pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.477812 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.477787 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:05.574693 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.574662 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:05.577954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.577936 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:05.726786 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.726758 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:05.833253 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.833219 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:05.871037 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:05.871001 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n"] Sep 10 12:12:05.874009 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:12:05.873984 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21175ba6_0cf8_48a7_aa77_9db86931a433.slice/crio-bb63dacf76ac9c5f8018225fc809d996bd0cd69fcc242a516d523ccaffcdcffd WatchSource:0}: Error finding container bb63dacf76ac9c5f8018225fc809d996bd0cd69fcc242a516d523ccaffcdcffd: Status 404 returned error can't find the container with id bb63dacf76ac9c5f8018225fc809d996bd0cd69fcc242a516d523ccaffcdcffd Sep 10 12:12:06.310044 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:06.310017 2555 generic.go:356] "Generic (PLEG): container finished" podID="7e3f25f4-6538-4d29-94a1-8259eb9512fd" containerID="aa85595c561d33be2a188311edb6ae876895624bbf7ac822ca945b7bf7344c07" exitCode=0 Sep 10 12:12:06.310044 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:06.310038 2555 generic.go:356] "Generic (PLEG): container finished" podID="7e3f25f4-6538-4d29-94a1-8259eb9512fd" containerID="ebd2cb293dc70207ff54db4c83fc34915843b0ce03dd5bc5bebfedf4edbf6de1" exitCode=0 Sep 10 12:12:06.310440 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:06.310091 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" event={"ID":"7e3f25f4-6538-4d29-94a1-8259eb9512fd","Type":"ContainerDied","Data":"aa85595c561d33be2a188311edb6ae876895624bbf7ac822ca945b7bf7344c07"} Sep 10 12:12:06.310440 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:06.310141 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" event={"ID":"7e3f25f4-6538-4d29-94a1-8259eb9512fd","Type":"ContainerDied","Data":"ebd2cb293dc70207ff54db4c83fc34915843b0ce03dd5bc5bebfedf4edbf6de1"} Sep 10 12:12:06.311427 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:06.311404 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" event={"ID":"21175ba6-0cf8-48a7-aa77-9db86931a433","Type":"ContainerStarted","Data":"bb63dacf76ac9c5f8018225fc809d996bd0cd69fcc242a516d523ccaffcdcffd"} Sep 10 12:12:07.320316 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:07.320229 2555 generic.go:356] "Generic (PLEG): container finished" podID="7e3f25f4-6538-4d29-94a1-8259eb9512fd" containerID="f8490e9697825917af11c3461eda81a83f24c91f4ac3686069f889dd583ad35c" exitCode=0 Sep 10 12:12:07.320723 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:07.320358 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" event={"ID":"7e3f25f4-6538-4d29-94a1-8259eb9512fd","Type":"ContainerDied","Data":"f8490e9697825917af11c3461eda81a83f24c91f4ac3686069f889dd583ad35c"} Sep 10 12:12:09.246916 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.246895 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:09.331314 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.331295 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" Sep 10 12:12:09.331314 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.331303 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0s4gvm" event={"ID":"7e3f25f4-6538-4d29-94a1-8259eb9512fd","Type":"ContainerDied","Data":"fa35203391b76b8c22b8921bac9c2b56ce621aa1b7b2b3b710c9c407627d2ed4"} Sep 10 12:12:09.331464 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.331351 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa35203391b76b8c22b8921bac9c2b56ce621aa1b7b2b3b710c9c407627d2ed4" Sep 10 12:12:09.393846 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.393816 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8zrp\" (UniqueName: \"kubernetes.io/projected/7e3f25f4-6538-4d29-94a1-8259eb9512fd-kube-api-access-r8zrp\") pod \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " Sep 10 12:12:09.393959 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.393882 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-bundle\") pod \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " Sep 10 12:12:09.393959 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.393919 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-util\") pod \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\" (UID: \"7e3f25f4-6538-4d29-94a1-8259eb9512fd\") " Sep 10 12:12:09.394628 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.394600 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-bundle" (OuterVolumeSpecName: "bundle") pod "7e3f25f4-6538-4d29-94a1-8259eb9512fd" (UID: "7e3f25f4-6538-4d29-94a1-8259eb9512fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:12:09.395806 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.395784 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e3f25f4-6538-4d29-94a1-8259eb9512fd-kube-api-access-r8zrp" (OuterVolumeSpecName: "kube-api-access-r8zrp") pod "7e3f25f4-6538-4d29-94a1-8259eb9512fd" (UID: "7e3f25f4-6538-4d29-94a1-8259eb9512fd"). InnerVolumeSpecName "kube-api-access-r8zrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:12:09.398700 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.398675 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-util" (OuterVolumeSpecName: "util") pod "7e3f25f4-6538-4d29-94a1-8259eb9512fd" (UID: "7e3f25f4-6538-4d29-94a1-8259eb9512fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:12:09.494711 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.494660 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8zrp\" (UniqueName: \"kubernetes.io/projected/7e3f25f4-6538-4d29-94a1-8259eb9512fd-kube-api-access-r8zrp\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:12:09.494711 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.494681 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:12:09.494711 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:09.494692 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e3f25f4-6538-4d29-94a1-8259eb9512fd-util\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:12:10.339145 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:10.339107 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" event={"ID":"21175ba6-0cf8-48a7-aa77-9db86931a433","Type":"ContainerStarted","Data":"72aa8502dd166b3912583e65db5ab09c4cde56e916a2f544b863c1d13cb68a5e"} Sep 10 12:12:11.344399 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:11.344357 2555 generic.go:356] "Generic (PLEG): container finished" podID="21175ba6-0cf8-48a7-aa77-9db86931a433" containerID="72aa8502dd166b3912583e65db5ab09c4cde56e916a2f544b863c1d13cb68a5e" exitCode=0 Sep 10 12:12:11.344854 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:11.344437 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" event={"ID":"21175ba6-0cf8-48a7-aa77-9db86931a433","Type":"ContainerDied","Data":"72aa8502dd166b3912583e65db5ab09c4cde56e916a2f544b863c1d13cb68a5e"} Sep 10 12:12:12.352627 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:12.352595 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" event={"ID":"21175ba6-0cf8-48a7-aa77-9db86931a433","Type":"ContainerStarted","Data":"c66aff0b9f9eb84449d95e893c0e0b07233d030360f7ffc77ed42654630e54cc"} Sep 10 12:12:12.353088 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:12.352739 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:12.385326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:12.385262 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" podStartSLOduration=2.394082276 podStartE2EDuration="7.385240975s" totalImagesPullingTime="3.97754895s" totalInitContainerRuntime="1.013609749s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:12:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:12:12.381645891 +0000 UTC m=+372.217628478" watchObservedRunningTime="2026-09-10 12:12:12.385240975 +0000 UTC m=+372.221223562" Sep 10 12:12:16.959402 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:16.959367 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:18.042537 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:18.042503 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:22.588787 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:22.588753 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:22.649837 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:22.649795 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:23.016045 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:23.015969 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:23.358986 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:23.358952 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d9854688c-m7p7n" Sep 10 12:12:26.672813 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.672778 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv"] Sep 10 12:12:26.673255 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.673192 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3f25f4-6538-4d29-94a1-8259eb9512fd" containerName="extract" Sep 10 12:12:26.673255 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.673211 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3f25f4-6538-4d29-94a1-8259eb9512fd" containerName="extract" Sep 10 12:12:26.673255 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.673236 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3f25f4-6538-4d29-94a1-8259eb9512fd" containerName="util" Sep 10 12:12:26.673255 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.673244 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3f25f4-6538-4d29-94a1-8259eb9512fd" containerName="util" Sep 10 12:12:26.673472 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.673268 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3f25f4-6538-4d29-94a1-8259eb9512fd" containerName="pull" Sep 10 12:12:26.673472 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.673276 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3f25f4-6538-4d29-94a1-8259eb9512fd" containerName="pull" Sep 10 12:12:26.673472 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.673374 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e3f25f4-6538-4d29-94a1-8259eb9512fd" containerName="extract" Sep 10 12:12:26.676418 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.676396 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:26.679909 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.679889 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 12:12:26.680043 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.680003 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 12:12:26.689046 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.689023 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv"] Sep 10 12:12:26.726610 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.726583 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt264\" (UniqueName: \"kubernetes.io/projected/efdba391-c0ba-48a8-96a7-b6fcab1a358c-kube-api-access-dt264\") pod \"kube-auth-proxy-64d8784dff-j4dzv\" (UID: \"efdba391-c0ba-48a8-96a7-b6fcab1a358c\") " pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:26.726720 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.726627 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efdba391-c0ba-48a8-96a7-b6fcab1a358c-tmp\") pod \"kube-auth-proxy-64d8784dff-j4dzv\" (UID: \"efdba391-c0ba-48a8-96a7-b6fcab1a358c\") " pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:26.726720 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.726645 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efdba391-c0ba-48a8-96a7-b6fcab1a358c-tls-certs\") pod \"kube-auth-proxy-64d8784dff-j4dzv\" (UID: \"efdba391-c0ba-48a8-96a7-b6fcab1a358c\") " pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:26.813843 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.813812 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:26.827050 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.827023 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt264\" (UniqueName: \"kubernetes.io/projected/efdba391-c0ba-48a8-96a7-b6fcab1a358c-kube-api-access-dt264\") pod \"kube-auth-proxy-64d8784dff-j4dzv\" (UID: \"efdba391-c0ba-48a8-96a7-b6fcab1a358c\") " pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:26.827170 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.827087 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efdba391-c0ba-48a8-96a7-b6fcab1a358c-tmp\") pod \"kube-auth-proxy-64d8784dff-j4dzv\" (UID: \"efdba391-c0ba-48a8-96a7-b6fcab1a358c\") " pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:26.827170 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.827117 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efdba391-c0ba-48a8-96a7-b6fcab1a358c-tls-certs\") pod \"kube-auth-proxy-64d8784dff-j4dzv\" (UID: \"efdba391-c0ba-48a8-96a7-b6fcab1a358c\") " pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:26.827290 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:12:26.827277 2555 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 10 12:12:26.827374 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:12:26.827358 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efdba391-c0ba-48a8-96a7-b6fcab1a358c-tls-certs podName:efdba391-c0ba-48a8-96a7-b6fcab1a358c nodeName:}" failed. No retries permitted until 2026-09-10 12:12:27.327337443 +0000 UTC m=+387.163320011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/efdba391-c0ba-48a8-96a7-b6fcab1a358c-tls-certs") pod "kube-auth-proxy-64d8784dff-j4dzv" (UID: "efdba391-c0ba-48a8-96a7-b6fcab1a358c") : secret "kube-auth-proxy-tls" not found Sep 10 12:12:26.829331 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.829304 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efdba391-c0ba-48a8-96a7-b6fcab1a358c-tmp\") pod \"kube-auth-proxy-64d8784dff-j4dzv\" (UID: \"efdba391-c0ba-48a8-96a7-b6fcab1a358c\") " pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:26.840190 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.840167 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt264\" (UniqueName: \"kubernetes.io/projected/efdba391-c0ba-48a8-96a7-b6fcab1a358c-kube-api-access-dt264\") pod \"kube-auth-proxy-64d8784dff-j4dzv\" (UID: \"efdba391-c0ba-48a8-96a7-b6fcab1a358c\") " pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:26.925832 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:26.925768 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:27.104351 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:27.104313 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:27.330571 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:27.330474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efdba391-c0ba-48a8-96a7-b6fcab1a358c-tls-certs\") pod \"kube-auth-proxy-64d8784dff-j4dzv\" (UID: \"efdba391-c0ba-48a8-96a7-b6fcab1a358c\") " pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:27.333163 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:27.333136 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efdba391-c0ba-48a8-96a7-b6fcab1a358c-tls-certs\") pod \"kube-auth-proxy-64d8784dff-j4dzv\" (UID: \"efdba391-c0ba-48a8-96a7-b6fcab1a358c\") " pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:27.585548 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:27.585466 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" Sep 10 12:12:27.860350 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:27.860327 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv"] Sep 10 12:12:27.862408 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:12:27.862386 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefdba391_c0ba_48a8_96a7_b6fcab1a358c.slice/crio-c3833d65ec0025594f9d807e0720e0ecf94bd47980c495c3dd76f5d888937e1f WatchSource:0}: Error finding container c3833d65ec0025594f9d807e0720e0ecf94bd47980c495c3dd76f5d888937e1f: Status 404 returned error can't find the container with id c3833d65ec0025594f9d807e0720e0ecf94bd47980c495c3dd76f5d888937e1f Sep 10 12:12:28.274855 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.274758 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:28.280443 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.280418 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9"] Sep 10 12:12:28.284398 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.284382 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.287376 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.287356 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 12:12:28.287611 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.287595 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bzl8k\"" Sep 10 12:12:28.287713 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.287632 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 12:12:28.287713 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.287652 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 12:12:28.287833 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.287710 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 12:12:28.309142 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.309118 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9"] Sep 10 12:12:28.338070 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.338048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.338204 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.338080 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.338204 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.338106 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.338204 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.338135 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp9bl\" (UniqueName: \"kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-kube-api-access-bp9bl\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.338381 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.338259 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d529ec4-3f07-4351-a76e-d5977f56a493-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.338381 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.338302 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.338381 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.338332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.374972 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.374931 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:28.426173 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.426149 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" event={"ID":"efdba391-c0ba-48a8-96a7-b6fcab1a358c","Type":"ContainerStarted","Data":"c3833d65ec0025594f9d807e0720e0ecf94bd47980c495c3dd76f5d888937e1f"} Sep 10 12:12:28.439528 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.439504 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d529ec4-3f07-4351-a76e-d5977f56a493-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.439649 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.439538 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.439649 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.439555 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.439649 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.439600 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.439649 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.439620 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.439859 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.439656 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.439859 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.439721 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp9bl\" (UniqueName: \"kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-kube-api-access-bp9bl\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.440329 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.440310 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.442265 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.442236 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d529ec4-3f07-4351-a76e-d5977f56a493-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.442361 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.442300 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.442476 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.442455 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.442519 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.442469 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.454782 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.454763 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.456295 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.456270 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp9bl\" (UniqueName: \"kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-kube-api-access-bp9bl\") pod \"istiod-openshift-gateway-7b7995d5cd-qnlq9\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.593809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.593776 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:28.894127 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.894086 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9"] Sep 10 12:12:28.897290 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:12:28.897261 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d529ec4_3f07_4351_a76e_d5977f56a493.slice/crio-cd828d74f60203df4251fcde96671bb01756880f6d3af9a1ab27b49d160759cd WatchSource:0}: Error finding container cd828d74f60203df4251fcde96671bb01756880f6d3af9a1ab27b49d160759cd: Status 404 returned error can't find the container with id cd828d74f60203df4251fcde96671bb01756880f6d3af9a1ab27b49d160759cd Sep 10 12:12:28.931018 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.930845 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-779965cdd5-z4bdz"] Sep 10 12:12:28.938119 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.937861 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:28.952549 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.952490 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-779965cdd5-z4bdz"] Sep 10 12:12:28.999145 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:28.999041 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:29.045096 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.045067 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82q2z\" (UniqueName: \"kubernetes.io/projected/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-kube-api-access-82q2z\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.045242 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.045123 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-trusted-ca-bundle\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.045242 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.045162 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-console-serving-cert\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.045242 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.045217 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-oauth-serving-cert\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.045417 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.045282 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-console-oauth-config\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.045417 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.045319 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-console-config\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.045417 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.045347 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-service-ca\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.083552 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.083521 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:29.146326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.146255 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-oauth-serving-cert\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.146326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.146289 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-console-oauth-config\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.146326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.146310 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-console-config\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.146551 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.146333 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-service-ca\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.146551 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.146383 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82q2z\" (UniqueName: \"kubernetes.io/projected/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-kube-api-access-82q2z\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.146551 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.146422 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-trusted-ca-bundle\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.146551 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.146454 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-console-serving-cert\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.147148 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.147112 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-oauth-serving-cert\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.147244 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.147141 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-service-ca\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.147320 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.147292 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-trusted-ca-bundle\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.147526 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.147506 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-console-config\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.149038 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.149014 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-console-oauth-config\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.149264 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.149237 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-console-serving-cert\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.157394 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.157372 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82q2z\" (UniqueName: \"kubernetes.io/projected/aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378-kube-api-access-82q2z\") pod \"console-779965cdd5-z4bdz\" (UID: \"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378\") " pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.251304 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.251270 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:29.434598 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.434488 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" event={"ID":"5d529ec4-3f07-4351-a76e-d5977f56a493","Type":"ContainerStarted","Data":"cd828d74f60203df4251fcde96671bb01756880f6d3af9a1ab27b49d160759cd"} Sep 10 12:12:29.531135 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:29.531087 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:30.252934 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:30.252903 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-779965cdd5-z4bdz"] Sep 10 12:12:30.801353 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:12:30.801258 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6657d0_2ed5_4ab5_a7bd_9f2e72de7378.slice/crio-783999df6be65ba1bf3e87f82af098505a1a641e4c216e34fb7d3700fa8e0baa WatchSource:0}: Error finding container 783999df6be65ba1bf3e87f82af098505a1a641e4c216e34fb7d3700fa8e0baa: Status 404 returned error can't find the container with id 783999df6be65ba1bf3e87f82af098505a1a641e4c216e34fb7d3700fa8e0baa Sep 10 12:12:31.447390 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:31.447359 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779965cdd5-z4bdz" event={"ID":"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378","Type":"ContainerStarted","Data":"783999df6be65ba1bf3e87f82af098505a1a641e4c216e34fb7d3700fa8e0baa"} Sep 10 12:12:31.952727 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:31.952682 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 12:12:31.952820 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:31.952775 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 12:12:32.453787 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:32.453752 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" event={"ID":"efdba391-c0ba-48a8-96a7-b6fcab1a358c","Type":"ContainerStarted","Data":"40b6de916345f6b08ccf9950a401a56eb2c6d70815db3113cee84018df0ebbf7"} Sep 10 12:12:32.455458 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:32.455432 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" event={"ID":"5d529ec4-3f07-4351-a76e-d5977f56a493","Type":"ContainerStarted","Data":"e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c"} Sep 10 12:12:32.455615 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:32.455480 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:32.457109 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:32.457081 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-779965cdd5-z4bdz" event={"ID":"aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378","Type":"ContainerStarted","Data":"87d3b83d6aca13250adbee831872049a9a0f3321f66cd59bd678dea7c39f6845"} Sep 10 12:12:32.474346 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:32.474303 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64d8784dff-j4dzv" podStartSLOduration=2.392093569 podStartE2EDuration="6.474290757s" totalImagesPullingTime="4.082197188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:12:32.47320613 +0000 UTC m=+392.309188715" watchObservedRunningTime="2026-09-10 12:12:32.474290757 +0000 UTC m=+392.310273342" Sep 10 12:12:32.500540 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:32.500491 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" podStartSLOduration=1.448595109 podStartE2EDuration="4.500478715s" totalImagesPullingTime="3.051883606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:12:32.49782452 +0000 UTC m=+392.333807118" watchObservedRunningTime="2026-09-10 12:12:32.500478715 +0000 UTC m=+392.336461301" Sep 10 12:12:32.526012 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:32.520396 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-779965cdd5-z4bdz" podStartSLOduration=4.520380141 podStartE2EDuration="4.520380141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:12:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:12:32.518170388 +0000 UTC m=+392.354152971" watchObservedRunningTime="2026-09-10 12:12:32.520380141 +0000 UTC m=+392.356362732" Sep 10 12:12:32.926289 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:32.926241 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:33.025407 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:33.025364 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:33.463555 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:33.463523 2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-qnlq9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 12:12:33.463900 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:33.463603 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" podUID="5d529ec4-3f07-4351-a76e-d5977f56a493" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 12:12:33.583553 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:33.583520 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:33.790524 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:33.790416 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:33.922620 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:33.922586 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:36.462668 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:36.462638 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:37.339755 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.339723 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wwn2v"] Sep 10 12:12:37.344241 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.344217 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:12:37.347095 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.347074 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hh5f8\"" Sep 10 12:12:37.347383 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.347366 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 10 12:12:37.359154 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.359125 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wwn2v"] Sep 10 12:12:37.415292 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.415255 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73c771a1-369c-4909-8cec-4d0fb1c48479-cert\") pod \"odh-model-controller-7998c67dc4-wwn2v\" (UID: \"73c771a1-369c-4909-8cec-4d0fb1c48479\") " pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:12:37.415449 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.415345 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncp5p\" (UniqueName: \"kubernetes.io/projected/73c771a1-369c-4909-8cec-4d0fb1c48479-kube-api-access-ncp5p\") pod \"odh-model-controller-7998c67dc4-wwn2v\" (UID: \"73c771a1-369c-4909-8cec-4d0fb1c48479\") " pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:12:37.430419 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.430385 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:37.516578 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.516532 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73c771a1-369c-4909-8cec-4d0fb1c48479-cert\") pod \"odh-model-controller-7998c67dc4-wwn2v\" (UID: \"73c771a1-369c-4909-8cec-4d0fb1c48479\") " pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:12:37.516923 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.516627 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncp5p\" (UniqueName: \"kubernetes.io/projected/73c771a1-369c-4909-8cec-4d0fb1c48479-kube-api-access-ncp5p\") pod \"odh-model-controller-7998c67dc4-wwn2v\" (UID: \"73c771a1-369c-4909-8cec-4d0fb1c48479\") " pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:12:37.516923 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:12:37.516686 2555 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 10 12:12:37.516923 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:12:37.516763 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c771a1-369c-4909-8cec-4d0fb1c48479-cert podName:73c771a1-369c-4909-8cec-4d0fb1c48479 nodeName:}" failed. No retries permitted until 2026-09-10 12:12:38.016744696 +0000 UTC m=+397.852727261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73c771a1-369c-4909-8cec-4d0fb1c48479-cert") pod "odh-model-controller-7998c67dc4-wwn2v" (UID: "73c771a1-369c-4909-8cec-4d0fb1c48479") : secret "odh-model-controller-webhook-cert" not found Sep 10 12:12:37.526941 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.526918 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncp5p\" (UniqueName: \"kubernetes.io/projected/73c771a1-369c-4909-8cec-4d0fb1c48479-kube-api-access-ncp5p\") pod \"odh-model-controller-7998c67dc4-wwn2v\" (UID: \"73c771a1-369c-4909-8cec-4d0fb1c48479\") " pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:12:37.531178 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.531149 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:37.622892 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.622820 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:37.704144 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:37.704109 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:38.022451 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:38.022374 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73c771a1-369c-4909-8cec-4d0fb1c48479-cert\") pod \"odh-model-controller-7998c67dc4-wwn2v\" (UID: \"73c771a1-369c-4909-8cec-4d0fb1c48479\") " pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:12:38.024829 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:38.024806 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73c771a1-369c-4909-8cec-4d0fb1c48479-cert\") pod \"odh-model-controller-7998c67dc4-wwn2v\" (UID: \"73c771a1-369c-4909-8cec-4d0fb1c48479\") " pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:12:38.035933 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:38.035907 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:38.184528 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:38.184494 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:38.254341 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:38.254306 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:12:38.534653 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:38.533867 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wwn2v"] Sep 10 12:12:38.538064 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:12:38.538039 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c771a1_369c_4909_8cec_4d0fb1c48479.slice/crio-8960cd7c5100d90d01ff63c4e6a98372497c8e948a2c0366940093a34f75e867 WatchSource:0}: Error finding container 8960cd7c5100d90d01ff63c4e6a98372497c8e948a2c0366940093a34f75e867: Status 404 returned error can't find the container with id 8960cd7c5100d90d01ff63c4e6a98372497c8e948a2c0366940093a34f75e867 Sep 10 12:12:39.252247 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:39.252213 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:39.252416 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:39.252284 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:39.257245 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:39.257219 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:39.494317 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:39.494275 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" event={"ID":"73c771a1-369c-4909-8cec-4d0fb1c48479","Type":"ContainerStarted","Data":"8960cd7c5100d90d01ff63c4e6a98372497c8e948a2c0366940093a34f75e867"} Sep 10 12:12:39.499331 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:39.499292 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-779965cdd5-z4bdz" Sep 10 12:12:39.547502 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:39.547424 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-774b7d858c-ch69q"] Sep 10 12:12:39.668937 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:39.668864 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:39.769944 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:39.769854 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:39.827121 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:39.827042 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:41.683117 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:41.683032 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:41.755162 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:41.755129 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:42.512157 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:42.512118 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" event={"ID":"73c771a1-369c-4909-8cec-4d0fb1c48479","Type":"ContainerStarted","Data":"22297a286ba2dd7f6709994fce07b73e56386e2332afabf39817be7d8eaccc2f"} Sep 10 12:12:42.512396 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:42.512271 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:12:42.530001 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:42.529957 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" podStartSLOduration=2.267797942 podStartE2EDuration="5.529944419s" totalImagesPullingTime="3.262146477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:12:42.529300877 +0000 UTC m=+402.365283465" watchObservedRunningTime="2026-09-10 12:12:42.529944419 +0000 UTC m=+402.365927005" Sep 10 12:12:47.951959 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:47.951919 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:48.023419 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.023389 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8"] Sep 10 12:12:48.027131 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.027107 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" Sep 10 12:12:48.030747 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.030722 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rg89l\"" Sep 10 12:12:48.031063 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.031041 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 10 12:12:48.052594 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.052493 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8"] Sep 10 12:12:48.055235 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.055196 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx"] Sep 10 12:12:48.059087 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.059065 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" Sep 10 12:12:48.062145 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.062127 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 10 12:12:48.062768 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.062746 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nvm9k\"" Sep 10 12:12:48.074737 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.074713 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx"] Sep 10 12:12:48.078961 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.078915 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:48.116227 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.116202 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghfbb\" (UniqueName: \"kubernetes.io/projected/d6745cec-de2e-4f98-88ce-e6976a286a39-kube-api-access-ghfbb\") pod \"kserve-controller-manager-d6f4b65b8-7vkl8\" (UID: \"d6745cec-de2e-4f98-88ce-e6976a286a39\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" Sep 10 12:12:48.116346 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.116270 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6745cec-de2e-4f98-88ce-e6976a286a39-cert\") pod \"kserve-controller-manager-d6f4b65b8-7vkl8\" (UID: \"d6745cec-de2e-4f98-88ce-e6976a286a39\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" Sep 10 12:12:48.217201 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.217122 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/841029a3-8110-4102-9310-55c7ab8bc762-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vpqfx\" (UID: \"841029a3-8110-4102-9310-55c7ab8bc762\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" Sep 10 12:12:48.217201 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.217171 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghfbb\" (UniqueName: \"kubernetes.io/projected/d6745cec-de2e-4f98-88ce-e6976a286a39-kube-api-access-ghfbb\") pod \"kserve-controller-manager-d6f4b65b8-7vkl8\" (UID: \"d6745cec-de2e-4f98-88ce-e6976a286a39\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" Sep 10 12:12:48.217391 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.217242 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6745cec-de2e-4f98-88ce-e6976a286a39-cert\") pod \"kserve-controller-manager-d6f4b65b8-7vkl8\" (UID: \"d6745cec-de2e-4f98-88ce-e6976a286a39\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" Sep 10 12:12:48.217391 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.217273 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z49kc\" (UniqueName: \"kubernetes.io/projected/841029a3-8110-4102-9310-55c7ab8bc762-kube-api-access-z49kc\") pod \"llmisvc-controller-manager-777c6bd7d5-vpqfx\" (UID: \"841029a3-8110-4102-9310-55c7ab8bc762\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" Sep 10 12:12:48.219738 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.219710 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6745cec-de2e-4f98-88ce-e6976a286a39-cert\") pod \"kserve-controller-manager-d6f4b65b8-7vkl8\" (UID: \"d6745cec-de2e-4f98-88ce-e6976a286a39\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" Sep 10 12:12:48.229869 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.229845 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghfbb\" (UniqueName: \"kubernetes.io/projected/d6745cec-de2e-4f98-88ce-e6976a286a39-kube-api-access-ghfbb\") pod \"kserve-controller-manager-d6f4b65b8-7vkl8\" (UID: \"d6745cec-de2e-4f98-88ce-e6976a286a39\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" Sep 10 12:12:48.242539 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.242509 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:48.318001 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.317974 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/841029a3-8110-4102-9310-55c7ab8bc762-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vpqfx\" (UID: \"841029a3-8110-4102-9310-55c7ab8bc762\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" Sep 10 12:12:48.318105 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.318037 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z49kc\" (UniqueName: \"kubernetes.io/projected/841029a3-8110-4102-9310-55c7ab8bc762-kube-api-access-z49kc\") pod \"llmisvc-controller-manager-777c6bd7d5-vpqfx\" (UID: \"841029a3-8110-4102-9310-55c7ab8bc762\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" Sep 10 12:12:48.320082 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.320063 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/841029a3-8110-4102-9310-55c7ab8bc762-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vpqfx\" (UID: \"841029a3-8110-4102-9310-55c7ab8bc762\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" Sep 10 12:12:48.337452 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.337426 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z49kc\" (UniqueName: \"kubernetes.io/projected/841029a3-8110-4102-9310-55c7ab8bc762-kube-api-access-z49kc\") pod \"llmisvc-controller-manager-777c6bd7d5-vpqfx\" (UID: \"841029a3-8110-4102-9310-55c7ab8bc762\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" Sep 10 12:12:48.338255 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.338237 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" Sep 10 12:12:48.369577 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.369532 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" Sep 10 12:12:48.642939 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.642920 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8"] Sep 10 12:12:48.645410 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:12:48.645385 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6745cec_de2e_4f98_88ce_e6976a286a39.slice/crio-a9dbdfec0217d8beb9d2c979ed968759bbb5df9f8288a3cbde5e0f022bfa8987 WatchSource:0}: Error finding container a9dbdfec0217d8beb9d2c979ed968759bbb5df9f8288a3cbde5e0f022bfa8987: Status 404 returned error can't find the container with id a9dbdfec0217d8beb9d2c979ed968759bbb5df9f8288a3cbde5e0f022bfa8987 Sep 10 12:12:48.672291 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:48.672271 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx"] Sep 10 12:12:48.674130 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:12:48.674107 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod841029a3_8110_4102_9310_55c7ab8bc762.slice/crio-58986068c7bdfceecbeee83d7cbf686d2de4081be7c6a74c5f15263b78223275 WatchSource:0}: Error finding container 58986068c7bdfceecbeee83d7cbf686d2de4081be7c6a74c5f15263b78223275: Status 404 returned error can't find the container with id 58986068c7bdfceecbeee83d7cbf686d2de4081be7c6a74c5f15263b78223275 Sep 10 12:12:49.284325 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:49.284284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:49.381147 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:49.381111 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:49.517637 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:49.517579 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:49.551155 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:49.551062 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" event={"ID":"d6745cec-de2e-4f98-88ce-e6976a286a39","Type":"ContainerStarted","Data":"a9dbdfec0217d8beb9d2c979ed968759bbb5df9f8288a3cbde5e0f022bfa8987"} Sep 10 12:12:49.552591 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:49.552546 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" event={"ID":"841029a3-8110-4102-9310-55c7ab8bc762","Type":"ContainerStarted","Data":"58986068c7bdfceecbeee83d7cbf686d2de4081be7c6a74c5f15263b78223275"} Sep 10 12:12:49.775729 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:49.775693 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9"] Sep 10 12:12:49.775923 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:49.775881 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" podUID="5d529ec4-3f07-4351-a76e-d5977f56a493" containerName="discovery" containerID="cri-o://e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c" gracePeriod=30 Sep 10 12:12:50.157884 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.157853 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:50.234456 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.234426 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-dns-cert\") pod \"5d529ec4-3f07-4351-a76e-d5977f56a493\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " Sep 10 12:12:50.234636 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.234476 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-ca-configmap\") pod \"5d529ec4-3f07-4351-a76e-d5977f56a493\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " Sep 10 12:12:50.234636 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.234503 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-cacerts\") pod \"5d529ec4-3f07-4351-a76e-d5977f56a493\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " Sep 10 12:12:50.234894 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.234855 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp9bl\" (UniqueName: \"kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-kube-api-access-bp9bl\") pod \"5d529ec4-3f07-4351-a76e-d5977f56a493\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " Sep 10 12:12:50.235003 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.234978 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d529ec4-3f07-4351-a76e-d5977f56a493-local-certs\") pod \"5d529ec4-3f07-4351-a76e-d5977f56a493\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " Sep 10 12:12:50.235072 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.235019 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-kubeconfig\") pod \"5d529ec4-3f07-4351-a76e-d5977f56a493\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " Sep 10 12:12:50.235072 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.235051 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-token\") pod \"5d529ec4-3f07-4351-a76e-d5977f56a493\" (UID: \"5d529ec4-3f07-4351-a76e-d5977f56a493\") " Sep 10 12:12:50.235249 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.235206 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5d529ec4-3f07-4351-a76e-d5977f56a493" (UID: "5d529ec4-3f07-4351-a76e-d5977f56a493"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:12:50.237006 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.236212 2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-ca-configmap\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:12:50.237944 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.237492 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-cacerts" (OuterVolumeSpecName: "cacerts") pod "5d529ec4-3f07-4351-a76e-d5977f56a493" (UID: "5d529ec4-3f07-4351-a76e-d5977f56a493"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:12:50.243383 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.238458 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d529ec4-3f07-4351-a76e-d5977f56a493" (UID: "5d529ec4-3f07-4351-a76e-d5977f56a493"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:12:50.243383 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.239709 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5d529ec4-3f07-4351-a76e-d5977f56a493" (UID: "5d529ec4-3f07-4351-a76e-d5977f56a493"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:12:50.243383 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.239749 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5d529ec4-3f07-4351-a76e-d5977f56a493" (UID: "5d529ec4-3f07-4351-a76e-d5977f56a493"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:12:50.243383 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.240042 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d529ec4-3f07-4351-a76e-d5977f56a493-local-certs" (OuterVolumeSpecName: "local-certs") pod "5d529ec4-3f07-4351-a76e-d5977f56a493" (UID: "5d529ec4-3f07-4351-a76e-d5977f56a493"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:12:50.243383 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.241314 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-kube-api-access-bp9bl" (OuterVolumeSpecName: "kube-api-access-bp9bl") pod "5d529ec4-3f07-4351-a76e-d5977f56a493" (UID: "5d529ec4-3f07-4351-a76e-d5977f56a493"). InnerVolumeSpecName "kube-api-access-bp9bl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:12:50.336997 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.336964 2555 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d529ec4-3f07-4351-a76e-d5977f56a493-local-certs\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:12:50.336997 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.336996 2555 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-kubeconfig\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:12:50.336997 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.337007 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-token\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:12:50.337487 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.337019 2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-istio-csr-dns-cert\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:12:50.337487 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.337031 2555 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d529ec4-3f07-4351-a76e-d5977f56a493-cacerts\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:12:50.337487 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.337045 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp9bl\" (UniqueName: \"kubernetes.io/projected/5d529ec4-3f07-4351-a76e-d5977f56a493-kube-api-access-bp9bl\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:12:50.560507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.560426 2555 generic.go:356] "Generic (PLEG): container finished" podID="5d529ec4-3f07-4351-a76e-d5977f56a493" containerID="e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c" exitCode=0 Sep 10 12:12:50.560507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.560499 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" Sep 10 12:12:50.560759 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.560505 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" event={"ID":"5d529ec4-3f07-4351-a76e-d5977f56a493","Type":"ContainerDied","Data":"e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c"} Sep 10 12:12:50.560759 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.560611 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9" event={"ID":"5d529ec4-3f07-4351-a76e-d5977f56a493","Type":"ContainerDied","Data":"cd828d74f60203df4251fcde96671bb01756880f6d3af9a1ab27b49d160759cd"} Sep 10 12:12:50.560759 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.560642 2555 scope.go:117] "RemoveContainer" containerID="e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c" Sep 10 12:12:50.570681 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.570602 2555 scope.go:117] "RemoveContainer" containerID="e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c" Sep 10 12:12:50.570902 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:12:50.570881 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c\": container with ID starting with e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c not found: ID does not exist" containerID="e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c" Sep 10 12:12:50.570986 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.570909 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c"} err="failed to get container status \"e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c\": rpc error: code = NotFound desc = could not find container \"e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c\": container with ID starting with e382ebf76cfbbea95c7b5c0b9555d6adf8ea74c65142cd6f43b39ad82bd7c31c not found: ID does not exist" Sep 10 12:12:50.603436 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.603413 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9"] Sep 10 12:12:50.617798 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.617762 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qnlq9"] Sep 10 12:12:50.769507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:50.769410 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d529ec4-3f07-4351-a76e-d5977f56a493" path="/var/lib/kubelet/pods/5d529ec4-3f07-4351-a76e-d5977f56a493/volumes" Sep 10 12:12:52.574376 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:52.574342 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" event={"ID":"d6745cec-de2e-4f98-88ce-e6976a286a39","Type":"ContainerStarted","Data":"8fa40d05e20bcc04b58353271b6530caeff2a6e30328569597b822e305ebaa48"} Sep 10 12:12:52.574862 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:52.574451 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" Sep 10 12:12:52.576234 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:52.576206 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" event={"ID":"841029a3-8110-4102-9310-55c7ab8bc762","Type":"ContainerStarted","Data":"b429c2aa690f84036efb0ca84031c425b79f25293d5ae46c5b3e02ff690dfd5f"} Sep 10 12:12:52.576347 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:52.576257 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" Sep 10 12:12:52.592086 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:52.592047 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" podStartSLOduration=1.492482814 podStartE2EDuration="4.592033456s" totalImagesPullingTime="3.099550642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:12:52.591142171 +0000 UTC m=+412.427124758" watchObservedRunningTime="2026-09-10 12:12:52.592033456 +0000 UTC m=+412.428016042" Sep 10 12:12:52.608359 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:52.608316 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" podStartSLOduration=1.533462102 podStartE2EDuration="4.608305593s" totalImagesPullingTime="3.074843491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:12:52.607608238 +0000 UTC m=+412.443590826" watchObservedRunningTime="2026-09-10 12:12:52.608305593 +0000 UTC m=+412.444288180" Sep 10 12:12:53.519969 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:12:53.519936 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wwn2v" Sep 10 12:13:04.575576 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.575497 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-774b7d858c-ch69q" podUID="c8061d0c-fca6-49f9-8a51-9f838fd1af25" containerName="console" containerID="cri-o://e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5" gracePeriod=15 Sep 10 12:13:04.810113 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.810089 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:13:04.954692 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.954657 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-trusted-ca-bundle\") pod \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " Sep 10 12:13:04.954864 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.954706 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-oauth-config\") pod \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " Sep 10 12:13:04.954864 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.954748 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-config\") pod \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " Sep 10 12:13:04.954864 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.954789 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-serving-cert\") pod \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " Sep 10 12:13:04.954864 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.954818 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-oauth-serving-cert\") pod \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " Sep 10 12:13:04.954864 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.954842 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-service-ca\") pod \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " Sep 10 12:13:04.955122 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.954931 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5jch\" (UniqueName: \"kubernetes.io/projected/c8061d0c-fca6-49f9-8a51-9f838fd1af25-kube-api-access-h5jch\") pod \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\" (UID: \"c8061d0c-fca6-49f9-8a51-9f838fd1af25\") " Sep 10 12:13:04.955183 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.955127 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c8061d0c-fca6-49f9-8a51-9f838fd1af25" (UID: "c8061d0c-fca6-49f9-8a51-9f838fd1af25"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:13:04.955249 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.955218 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-config" (OuterVolumeSpecName: "console-config") pod "c8061d0c-fca6-49f9-8a51-9f838fd1af25" (UID: "c8061d0c-fca6-49f9-8a51-9f838fd1af25"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:13:04.955427 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.955402 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-service-ca" (OuterVolumeSpecName: "service-ca") pod "c8061d0c-fca6-49f9-8a51-9f838fd1af25" (UID: "c8061d0c-fca6-49f9-8a51-9f838fd1af25"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:13:04.955493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.955477 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c8061d0c-fca6-49f9-8a51-9f838fd1af25" (UID: "c8061d0c-fca6-49f9-8a51-9f838fd1af25"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:13:04.957237 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.957208 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c8061d0c-fca6-49f9-8a51-9f838fd1af25" (UID: "c8061d0c-fca6-49f9-8a51-9f838fd1af25"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:13:04.957342 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.957233 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8061d0c-fca6-49f9-8a51-9f838fd1af25-kube-api-access-h5jch" (OuterVolumeSpecName: "kube-api-access-h5jch") pod "c8061d0c-fca6-49f9-8a51-9f838fd1af25" (UID: "c8061d0c-fca6-49f9-8a51-9f838fd1af25"). InnerVolumeSpecName "kube-api-access-h5jch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:13:04.957450 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:04.957427 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c8061d0c-fca6-49f9-8a51-9f838fd1af25" (UID: "c8061d0c-fca6-49f9-8a51-9f838fd1af25"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:13:05.056455 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.056420 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-service-ca\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:05.056455 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.056449 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5jch\" (UniqueName: \"kubernetes.io/projected/c8061d0c-fca6-49f9-8a51-9f838fd1af25-kube-api-access-h5jch\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:05.056455 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.056459 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-trusted-ca-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:05.056719 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.056468 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-oauth-config\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:05.056719 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.056477 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-config\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:05.056719 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.056487 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8061d0c-fca6-49f9-8a51-9f838fd1af25-console-serving-cert\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:05.056719 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.056495 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8061d0c-fca6-49f9-8a51-9f838fd1af25-oauth-serving-cert\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:05.643471 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.643431 2555 generic.go:356] "Generic (PLEG): container finished" podID="c8061d0c-fca6-49f9-8a51-9f838fd1af25" containerID="e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5" exitCode=0 Sep 10 12:13:05.643938 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.643480 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-774b7d858c-ch69q" event={"ID":"c8061d0c-fca6-49f9-8a51-9f838fd1af25","Type":"ContainerDied","Data":"e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5"} Sep 10 12:13:05.643938 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.643487 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-774b7d858c-ch69q" Sep 10 12:13:05.643938 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.643582 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-774b7d858c-ch69q" event={"ID":"c8061d0c-fca6-49f9-8a51-9f838fd1af25","Type":"ContainerDied","Data":"c18d588a9595c8eff8c5960d4608ca64458047b02eeffd0372c6e99e8a5a8b8d"} Sep 10 12:13:05.644426 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.643631 2555 scope.go:117] "RemoveContainer" containerID="e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5" Sep 10 12:13:05.653402 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.653387 2555 scope.go:117] "RemoveContainer" containerID="e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5" Sep 10 12:13:05.653718 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:13:05.653697 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5\": container with ID starting with e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5 not found: ID does not exist" containerID="e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5" Sep 10 12:13:05.653766 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.653725 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5"} err="failed to get container status \"e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5\": rpc error: code = NotFound desc = could not find container \"e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5\": container with ID starting with e0a61a5183c5659221ebefd5726754031843c091a8daee8e63b0e63cac6495a5 not found: ID does not exist" Sep 10 12:13:05.667053 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.667027 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-774b7d858c-ch69q"] Sep 10 12:13:05.668874 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:05.668854 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-774b7d858c-ch69q"] Sep 10 12:13:06.767445 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:06.767412 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8061d0c-fca6-49f9-8a51-9f838fd1af25" path="/var/lib/kubelet/pods/c8061d0c-fca6-49f9-8a51-9f838fd1af25/volumes" Sep 10 12:13:23.583490 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:23.583405 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vpqfx" Sep 10 12:13:23.586533 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:23.586514 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7vkl8" Sep 10 12:13:25.536146 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:25.536110 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:33.505076 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:33.505035 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:33.604789 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:33.604756 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:38.574843 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:38.574756 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:38.670353 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:38.670322 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:43.006792 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.006761 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4"] Sep 10 12:13:43.007165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.007055 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8061d0c-fca6-49f9-8a51-9f838fd1af25" containerName="console" Sep 10 12:13:43.007165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.007066 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8061d0c-fca6-49f9-8a51-9f838fd1af25" containerName="console" Sep 10 12:13:43.007165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.007082 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d529ec4-3f07-4351-a76e-d5977f56a493" containerName="discovery" Sep 10 12:13:43.007165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.007087 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d529ec4-3f07-4351-a76e-d5977f56a493" containerName="discovery" Sep 10 12:13:43.007165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.007143 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d529ec4-3f07-4351-a76e-d5977f56a493" containerName="discovery" Sep 10 12:13:43.007165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.007153 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8061d0c-fca6-49f9-8a51-9f838fd1af25" containerName="console" Sep 10 12:13:43.010342 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.010318 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.013313 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.013293 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9h588\"" Sep 10 12:13:43.013907 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.013886 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:13:43.014483 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.014466 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:13:43.021433 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.021413 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4"] Sep 10 12:13:43.102721 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.102693 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76"] Sep 10 12:13:43.106027 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.106011 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.119178 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.119158 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76"] Sep 10 12:13:43.140896 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.140870 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.140988 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.140913 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.140988 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.140942 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwv6d\" (UniqueName: \"kubernetes.io/projected/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-kube-api-access-kwv6d\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.205770 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.205743 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m"] Sep 10 12:13:43.209147 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.209133 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.219768 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.219746 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m"] Sep 10 12:13:43.241736 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.241713 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.241819 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.241751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwv6d\" (UniqueName: \"kubernetes.io/projected/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-kube-api-access-kwv6d\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.241819 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.241776 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.241890 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.241827 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.241890 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.241848 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.241890 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.241876 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcmdv\" (UniqueName: \"kubernetes.io/projected/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-kube-api-access-pcmdv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.242072 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.242054 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.242137 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.242121 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.251466 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.251442 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwv6d\" (UniqueName: \"kubernetes.io/projected/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-kube-api-access-kwv6d\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.307127 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.307071 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4"] Sep 10 12:13:43.310505 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.310490 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.319181 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.319166 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:43.324384 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.324363 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4"] Sep 10 12:13:43.342269 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.342226 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.342269 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.342268 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.342467 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.342291 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.342467 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.342333 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcmdv\" (UniqueName: \"kubernetes.io/projected/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-kube-api-access-pcmdv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.342467 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.342355 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.342467 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.342380 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kgxc\" (UniqueName: \"kubernetes.io/projected/943e312e-d7f8-457e-9157-7ddf92ab4600-kube-api-access-7kgxc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.342992 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.342629 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.342992 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.342674 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.351916 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.351892 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcmdv\" (UniqueName: \"kubernetes.io/projected/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-kube-api-access-pcmdv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.414650 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.414622 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:43.442758 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.442732 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.442872 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.442800 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndk9j\" (UniqueName: \"kubernetes.io/projected/e20ae3a2-361f-4111-a533-884c097032eb-kube-api-access-ndk9j\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.442872 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.442841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.442991 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.442881 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.442991 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.442928 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.443095 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.443067 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kgxc\" (UniqueName: \"kubernetes.io/projected/943e312e-d7f8-457e-9157-7ddf92ab4600-kube-api-access-7kgxc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.443142 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.443125 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.443252 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.443231 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.454058 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.454009 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kgxc\" (UniqueName: \"kubernetes.io/projected/943e312e-d7f8-457e-9157-7ddf92ab4600-kube-api-access-7kgxc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.517362 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.517332 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:43.543796 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.543768 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndk9j\" (UniqueName: \"kubernetes.io/projected/e20ae3a2-361f-4111-a533-884c097032eb-kube-api-access-ndk9j\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.543917 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.543805 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.543917 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.543832 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.544188 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.544169 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.544250 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.544173 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.552821 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.552796 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndk9j\" (UniqueName: \"kubernetes.io/projected/e20ae3a2-361f-4111-a533-884c097032eb-kube-api-access-ndk9j\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.597213 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.597180 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4"] Sep 10 12:13:43.600442 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:13:43.600414 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a79b70_8c6d_473f_8bbc_bc2e8b44e027.slice/crio-213075f2af5608657a0a64eb86ef1710f0baad11462631d74fa4e91e7ae8a98a WatchSource:0}: Error finding container 213075f2af5608657a0a64eb86ef1710f0baad11462631d74fa4e91e7ae8a98a: Status 404 returned error can't find the container with id 213075f2af5608657a0a64eb86ef1710f0baad11462631d74fa4e91e7ae8a98a Sep 10 12:13:43.619180 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.619161 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:43.689547 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.689523 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76"] Sep 10 12:13:43.692180 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:13:43.692149 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2c43cb_c4f2_4a78_9bf1_797ee5faf11b.slice/crio-8971ef2a6cc12245dc49dc5854d4241d3e3beb92474f82b5be1443727433b639 WatchSource:0}: Error finding container 8971ef2a6cc12245dc49dc5854d4241d3e3beb92474f82b5be1443727433b639: Status 404 returned error can't find the container with id 8971ef2a6cc12245dc49dc5854d4241d3e3beb92474f82b5be1443727433b639 Sep 10 12:13:43.790239 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.790216 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m"] Sep 10 12:13:43.793627 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:13:43.793599 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943e312e_d7f8_457e_9157_7ddf92ab4600.slice/crio-a9cea4229e3b77ba76c58f41dbec32698cfa3aefe076100bc3ad88f75600b217 WatchSource:0}: Error finding container a9cea4229e3b77ba76c58f41dbec32698cfa3aefe076100bc3ad88f75600b217: Status 404 returned error can't find the container with id a9cea4229e3b77ba76c58f41dbec32698cfa3aefe076100bc3ad88f75600b217 Sep 10 12:13:43.840790 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.840757 2555 generic.go:356] "Generic (PLEG): container finished" podID="41a79b70-8c6d-473f-8bbc-bc2e8b44e027" containerID="d8112b1f36dea21c94b4c299a89ff7ec8a2aabb1dfc3ac38e06078c4b3d7bf91" exitCode=0 Sep 10 12:13:43.840905 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.840887 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" event={"ID":"41a79b70-8c6d-473f-8bbc-bc2e8b44e027","Type":"ContainerDied","Data":"d8112b1f36dea21c94b4c299a89ff7ec8a2aabb1dfc3ac38e06078c4b3d7bf91"} Sep 10 12:13:43.840975 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.840943 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" event={"ID":"41a79b70-8c6d-473f-8bbc-bc2e8b44e027","Type":"ContainerStarted","Data":"213075f2af5608657a0a64eb86ef1710f0baad11462631d74fa4e91e7ae8a98a"} Sep 10 12:13:43.842898 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.842869 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" event={"ID":"943e312e-d7f8-457e-9157-7ddf92ab4600","Type":"ContainerStarted","Data":"a9cea4229e3b77ba76c58f41dbec32698cfa3aefe076100bc3ad88f75600b217"} Sep 10 12:13:43.844934 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.844819 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" event={"ID":"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b","Type":"ContainerStarted","Data":"b60798ff3130cdbb5f7aaede4038b43cd6cd6acdfebe4137f717fb395f49d347"} Sep 10 12:13:43.844934 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.844862 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" event={"ID":"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b","Type":"ContainerStarted","Data":"8971ef2a6cc12245dc49dc5854d4241d3e3beb92474f82b5be1443727433b639"} Sep 10 12:13:43.898141 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:43.898115 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4"] Sep 10 12:13:43.968285 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:13:43.968252 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20ae3a2_361f_4111_a533_884c097032eb.slice/crio-cb18baaf72a9eeadc4db2460660dfeba3fa020c6858e027dc1a1f1f5d832fe8e WatchSource:0}: Error finding container cb18baaf72a9eeadc4db2460660dfeba3fa020c6858e027dc1a1f1f5d832fe8e: Status 404 returned error can't find the container with id cb18baaf72a9eeadc4db2460660dfeba3fa020c6858e027dc1a1f1f5d832fe8e Sep 10 12:13:44.854164 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:44.854124 2555 generic.go:356] "Generic (PLEG): container finished" podID="943e312e-d7f8-457e-9157-7ddf92ab4600" containerID="8b18b240c0d3d13e6608732df089eb412451b44db3d9e9732c74a1580fc19049" exitCode=0 Sep 10 12:13:44.854595 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:44.854210 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" event={"ID":"943e312e-d7f8-457e-9157-7ddf92ab4600","Type":"ContainerDied","Data":"8b18b240c0d3d13e6608732df089eb412451b44db3d9e9732c74a1580fc19049"} Sep 10 12:13:44.855874 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:44.855851 2555 generic.go:356] "Generic (PLEG): container finished" podID="dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" containerID="b60798ff3130cdbb5f7aaede4038b43cd6cd6acdfebe4137f717fb395f49d347" exitCode=0 Sep 10 12:13:44.855960 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:44.855894 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" event={"ID":"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b","Type":"ContainerDied","Data":"b60798ff3130cdbb5f7aaede4038b43cd6cd6acdfebe4137f717fb395f49d347"} Sep 10 12:13:44.857796 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:44.857775 2555 generic.go:356] "Generic (PLEG): container finished" podID="e20ae3a2-361f-4111-a533-884c097032eb" containerID="e177087c8f8693e2b303a1d4285859cf8853879fbb3ca2afe701be26f7355a9c" exitCode=0 Sep 10 12:13:44.857870 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:44.857835 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" event={"ID":"e20ae3a2-361f-4111-a533-884c097032eb","Type":"ContainerDied","Data":"e177087c8f8693e2b303a1d4285859cf8853879fbb3ca2afe701be26f7355a9c"} Sep 10 12:13:44.857870 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:44.857863 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" event={"ID":"e20ae3a2-361f-4111-a533-884c097032eb","Type":"ContainerStarted","Data":"cb18baaf72a9eeadc4db2460660dfeba3fa020c6858e027dc1a1f1f5d832fe8e"} Sep 10 12:13:45.864542 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:45.864507 2555 generic.go:356] "Generic (PLEG): container finished" podID="41a79b70-8c6d-473f-8bbc-bc2e8b44e027" containerID="562c0748f87307ead74ca022e9b6739ff67aec7c0387b8684674c78de4a19147" exitCode=0 Sep 10 12:13:45.864901 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:45.864600 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" event={"ID":"41a79b70-8c6d-473f-8bbc-bc2e8b44e027","Type":"ContainerDied","Data":"562c0748f87307ead74ca022e9b6739ff67aec7c0387b8684674c78de4a19147"} Sep 10 12:13:46.873040 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:46.873012 2555 generic.go:356] "Generic (PLEG): container finished" podID="dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" containerID="0827e42987802dde43de3b73ac1168247d7eb29c1687815df202b52c006bc8b4" exitCode=0 Sep 10 12:13:46.873361 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:46.873071 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" event={"ID":"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b","Type":"ContainerDied","Data":"0827e42987802dde43de3b73ac1168247d7eb29c1687815df202b52c006bc8b4"} Sep 10 12:13:46.875202 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:46.875183 2555 generic.go:356] "Generic (PLEG): container finished" podID="e20ae3a2-361f-4111-a533-884c097032eb" containerID="6f2e00cf866096d5a0aed8ed63681d8f0bdd46c3892bdf2472df9a46d1840501" exitCode=0 Sep 10 12:13:46.875307 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:46.875254 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" event={"ID":"e20ae3a2-361f-4111-a533-884c097032eb","Type":"ContainerDied","Data":"6f2e00cf866096d5a0aed8ed63681d8f0bdd46c3892bdf2472df9a46d1840501"} Sep 10 12:13:46.877647 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:46.877627 2555 generic.go:356] "Generic (PLEG): container finished" podID="41a79b70-8c6d-473f-8bbc-bc2e8b44e027" containerID="652353905a7f3502dea632186a4fb64bc2da3f861bca4c3bf9c5a86a6dcea6b4" exitCode=0 Sep 10 12:13:46.877740 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:46.877671 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" event={"ID":"41a79b70-8c6d-473f-8bbc-bc2e8b44e027","Type":"ContainerDied","Data":"652353905a7f3502dea632186a4fb64bc2da3f861bca4c3bf9c5a86a6dcea6b4"} Sep 10 12:13:47.887831 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:47.887798 2555 generic.go:356] "Generic (PLEG): container finished" podID="e20ae3a2-361f-4111-a533-884c097032eb" containerID="7769abd7b316bb149abbab25ea9f7fdc49db3ff7c525bd73dd0cb34ad62ed8bb" exitCode=0 Sep 10 12:13:47.888262 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:47.887884 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" event={"ID":"e20ae3a2-361f-4111-a533-884c097032eb","Type":"ContainerDied","Data":"7769abd7b316bb149abbab25ea9f7fdc49db3ff7c525bd73dd0cb34ad62ed8bb"} Sep 10 12:13:47.889809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:47.889786 2555 generic.go:356] "Generic (PLEG): container finished" podID="943e312e-d7f8-457e-9157-7ddf92ab4600" containerID="99543d922c520e89f297d5c568be78031ab1a1f27d543fcfc9e3595c9a7ae2a2" exitCode=0 Sep 10 12:13:47.889910 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:47.889860 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" event={"ID":"943e312e-d7f8-457e-9157-7ddf92ab4600","Type":"ContainerDied","Data":"99543d922c520e89f297d5c568be78031ab1a1f27d543fcfc9e3595c9a7ae2a2"} Sep 10 12:13:47.892285 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:47.892259 2555 generic.go:356] "Generic (PLEG): container finished" podID="dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" containerID="9ac3d45f8caa0e13da553c0f64975874f44191a101584221ecf32472e4f4735e" exitCode=0 Sep 10 12:13:47.892378 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:47.892311 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" event={"ID":"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b","Type":"ContainerDied","Data":"9ac3d45f8caa0e13da553c0f64975874f44191a101584221ecf32472e4f4735e"} Sep 10 12:13:48.092470 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.092444 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:48.185390 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.185329 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-bundle\") pod \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " Sep 10 12:13:48.185390 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.185389 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-util\") pod \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " Sep 10 12:13:48.185616 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.185414 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwv6d\" (UniqueName: \"kubernetes.io/projected/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-kube-api-access-kwv6d\") pod \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\" (UID: \"41a79b70-8c6d-473f-8bbc-bc2e8b44e027\") " Sep 10 12:13:48.185915 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.185890 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-bundle" (OuterVolumeSpecName: "bundle") pod "41a79b70-8c6d-473f-8bbc-bc2e8b44e027" (UID: "41a79b70-8c6d-473f-8bbc-bc2e8b44e027"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:13:48.187474 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.187452 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-kube-api-access-kwv6d" (OuterVolumeSpecName: "kube-api-access-kwv6d") pod "41a79b70-8c6d-473f-8bbc-bc2e8b44e027" (UID: "41a79b70-8c6d-473f-8bbc-bc2e8b44e027"). InnerVolumeSpecName "kube-api-access-kwv6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:13:48.191009 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.190977 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-util" (OuterVolumeSpecName: "util") pod "41a79b70-8c6d-473f-8bbc-bc2e8b44e027" (UID: "41a79b70-8c6d-473f-8bbc-bc2e8b44e027"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:13:48.286208 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.286184 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:48.286208 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.286205 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-util\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:48.286333 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.286214 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwv6d\" (UniqueName: \"kubernetes.io/projected/41a79b70-8c6d-473f-8bbc-bc2e8b44e027-kube-api-access-kwv6d\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:48.899283 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.899255 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" Sep 10 12:13:48.899283 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.899275 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ch7js4" event={"ID":"41a79b70-8c6d-473f-8bbc-bc2e8b44e027","Type":"ContainerDied","Data":"213075f2af5608657a0a64eb86ef1710f0baad11462631d74fa4e91e7ae8a98a"} Sep 10 12:13:48.899692 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.899312 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="213075f2af5608657a0a64eb86ef1710f0baad11462631d74fa4e91e7ae8a98a" Sep 10 12:13:48.901623 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.901601 2555 generic.go:356] "Generic (PLEG): container finished" podID="943e312e-d7f8-457e-9157-7ddf92ab4600" containerID="ecd38df643404d82a746d478585954757ca17f646f32333cef442eb8a4016cd1" exitCode=0 Sep 10 12:13:48.901733 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:48.901672 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" event={"ID":"943e312e-d7f8-457e-9157-7ddf92ab4600","Type":"ContainerDied","Data":"ecd38df643404d82a746d478585954757ca17f646f32333cef442eb8a4016cd1"} Sep 10 12:13:49.049846 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.049823 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:49.051938 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.051922 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:49.193787 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.193760 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndk9j\" (UniqueName: \"kubernetes.io/projected/e20ae3a2-361f-4111-a533-884c097032eb-kube-api-access-ndk9j\") pod \"e20ae3a2-361f-4111-a533-884c097032eb\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " Sep 10 12:13:49.193958 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.193812 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-util\") pod \"e20ae3a2-361f-4111-a533-884c097032eb\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " Sep 10 12:13:49.193958 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.193832 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-util\") pod \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " Sep 10 12:13:49.193958 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.193894 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-bundle\") pod \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " Sep 10 12:13:49.193958 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.193927 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-bundle\") pod \"e20ae3a2-361f-4111-a533-884c097032eb\" (UID: \"e20ae3a2-361f-4111-a533-884c097032eb\") " Sep 10 12:13:49.193958 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.193961 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcmdv\" (UniqueName: \"kubernetes.io/projected/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-kube-api-access-pcmdv\") pod \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\" (UID: \"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b\") " Sep 10 12:13:49.194420 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.194393 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-bundle" (OuterVolumeSpecName: "bundle") pod "dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" (UID: "dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:13:49.194759 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.194730 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-bundle" (OuterVolumeSpecName: "bundle") pod "e20ae3a2-361f-4111-a533-884c097032eb" (UID: "e20ae3a2-361f-4111-a533-884c097032eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:13:49.196599 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.196575 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e20ae3a2-361f-4111-a533-884c097032eb-kube-api-access-ndk9j" (OuterVolumeSpecName: "kube-api-access-ndk9j") pod "e20ae3a2-361f-4111-a533-884c097032eb" (UID: "e20ae3a2-361f-4111-a533-884c097032eb"). InnerVolumeSpecName "kube-api-access-ndk9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:13:49.196688 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.196607 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-kube-api-access-pcmdv" (OuterVolumeSpecName: "kube-api-access-pcmdv") pod "dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" (UID: "dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b"). InnerVolumeSpecName "kube-api-access-pcmdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:13:49.199264 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.199243 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-util" (OuterVolumeSpecName: "util") pod "e20ae3a2-361f-4111-a533-884c097032eb" (UID: "e20ae3a2-361f-4111-a533-884c097032eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:13:49.199771 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.199749 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-util" (OuterVolumeSpecName: "util") pod "dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" (UID: "dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:13:49.294974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.294912 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcmdv\" (UniqueName: \"kubernetes.io/projected/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-kube-api-access-pcmdv\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:49.294974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.294938 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndk9j\" (UniqueName: \"kubernetes.io/projected/e20ae3a2-361f-4111-a533-884c097032eb-kube-api-access-ndk9j\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:49.294974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.294951 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-util\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:49.294974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.294963 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-util\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:49.294974 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.294975 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:49.295183 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.294987 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e20ae3a2-361f-4111-a533-884c097032eb-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:49.908281 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.908251 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" Sep 10 12:13:49.908666 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.908271 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9hwp4" event={"ID":"e20ae3a2-361f-4111-a533-884c097032eb","Type":"ContainerDied","Data":"cb18baaf72a9eeadc4db2460660dfeba3fa020c6858e027dc1a1f1f5d832fe8e"} Sep 10 12:13:49.908666 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.908324 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb18baaf72a9eeadc4db2460660dfeba3fa020c6858e027dc1a1f1f5d832fe8e" Sep 10 12:13:49.910464 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.910438 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" event={"ID":"dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b","Type":"ContainerDied","Data":"8971ef2a6cc12245dc49dc5854d4241d3e3beb92474f82b5be1443727433b639"} Sep 10 12:13:49.910464 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.910461 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sjz76" Sep 10 12:13:49.910631 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:49.910477 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8971ef2a6cc12245dc49dc5854d4241d3e3beb92474f82b5be1443727433b639" Sep 10 12:13:50.043312 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.043290 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:50.202010 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.201933 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kgxc\" (UniqueName: \"kubernetes.io/projected/943e312e-d7f8-457e-9157-7ddf92ab4600-kube-api-access-7kgxc\") pod \"943e312e-d7f8-457e-9157-7ddf92ab4600\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " Sep 10 12:13:50.202146 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.202013 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-bundle\") pod \"943e312e-d7f8-457e-9157-7ddf92ab4600\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " Sep 10 12:13:50.202146 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.202069 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-util\") pod \"943e312e-d7f8-457e-9157-7ddf92ab4600\" (UID: \"943e312e-d7f8-457e-9157-7ddf92ab4600\") " Sep 10 12:13:50.202483 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.202456 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-bundle" (OuterVolumeSpecName: "bundle") pod "943e312e-d7f8-457e-9157-7ddf92ab4600" (UID: "943e312e-d7f8-457e-9157-7ddf92ab4600"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:13:50.204192 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.204160 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943e312e-d7f8-457e-9157-7ddf92ab4600-kube-api-access-7kgxc" (OuterVolumeSpecName: "kube-api-access-7kgxc") pod "943e312e-d7f8-457e-9157-7ddf92ab4600" (UID: "943e312e-d7f8-457e-9157-7ddf92ab4600"). InnerVolumeSpecName "kube-api-access-7kgxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:13:50.206845 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.206808 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-util" (OuterVolumeSpecName: "util") pod "943e312e-d7f8-457e-9157-7ddf92ab4600" (UID: "943e312e-d7f8-457e-9157-7ddf92ab4600"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:13:50.302632 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.302600 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-util\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:50.302632 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.302629 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kgxc\" (UniqueName: \"kubernetes.io/projected/943e312e-d7f8-457e-9157-7ddf92ab4600-kube-api-access-7kgxc\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:50.302784 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.302644 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/943e312e-d7f8-457e-9157-7ddf92ab4600-bundle\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:13:50.917288 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.917263 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" Sep 10 12:13:50.917665 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.917294 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6v2f9m" event={"ID":"943e312e-d7f8-457e-9157-7ddf92ab4600","Type":"ContainerDied","Data":"a9cea4229e3b77ba76c58f41dbec32698cfa3aefe076100bc3ad88f75600b217"} Sep 10 12:13:50.917665 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:50.917335 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9cea4229e3b77ba76c58f41dbec32698cfa3aefe076100bc3ad88f75600b217" Sep 10 12:13:53.983704 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:53.983664 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:54.785910 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:54.785872 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:55.563310 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:55.563276 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:57.826728 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:57.826689 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:58.587810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.587760 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:58.596054 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596023 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g"] Sep 10 12:13:58.596372 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596357 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41a79b70-8c6d-473f-8bbc-bc2e8b44e027" containerName="extract" Sep 10 12:13:58.596441 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596376 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="41a79b70-8c6d-473f-8bbc-bc2e8b44e027" containerName="extract" Sep 10 12:13:58.596441 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596388 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" containerName="extract" Sep 10 12:13:58.596441 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596396 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" containerName="extract" Sep 10 12:13:58.596441 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596414 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41a79b70-8c6d-473f-8bbc-bc2e8b44e027" containerName="util" Sep 10 12:13:58.596441 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596423 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="41a79b70-8c6d-473f-8bbc-bc2e8b44e027" containerName="util" Sep 10 12:13:58.596441 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596431 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" containerName="util" Sep 10 12:13:58.596441 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596439 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" containerName="util" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596454 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" containerName="pull" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596463 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" containerName="pull" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596472 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943e312e-d7f8-457e-9157-7ddf92ab4600" containerName="extract" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596480 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="943e312e-d7f8-457e-9157-7ddf92ab4600" containerName="extract" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596493 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41a79b70-8c6d-473f-8bbc-bc2e8b44e027" containerName="pull" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596502 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="41a79b70-8c6d-473f-8bbc-bc2e8b44e027" containerName="pull" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596515 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943e312e-d7f8-457e-9157-7ddf92ab4600" containerName="util" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596524 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="943e312e-d7f8-457e-9157-7ddf92ab4600" containerName="util" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596535 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20ae3a2-361f-4111-a533-884c097032eb" containerName="util" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596543 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20ae3a2-361f-4111-a533-884c097032eb" containerName="util" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596553 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20ae3a2-361f-4111-a533-884c097032eb" containerName="extract" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596588 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20ae3a2-361f-4111-a533-884c097032eb" containerName="extract" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596602 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20ae3a2-361f-4111-a533-884c097032eb" containerName="pull" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596610 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20ae3a2-361f-4111-a533-884c097032eb" containerName="pull" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596624 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943e312e-d7f8-457e-9157-7ddf92ab4600" containerName="pull" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596632 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="943e312e-d7f8-457e-9157-7ddf92ab4600" containerName="pull" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596720 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="41a79b70-8c6d-473f-8bbc-bc2e8b44e027" containerName="extract" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596734 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2c43cb-c4f2-4a78-9bf1-797ee5faf11b" containerName="extract" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596743 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e20ae3a2-361f-4111-a533-884c097032eb" containerName="extract" Sep 10 12:13:58.596809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.596753 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="943e312e-d7f8-457e-9157-7ddf92ab4600" containerName="extract" Sep 10 12:13:58.599962 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.599944 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:13:58.603217 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.603198 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 12:13:58.603326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.603290 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6hxl4\"" Sep 10 12:13:58.603647 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.603631 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 12:13:58.619005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.618985 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g"] Sep 10 12:13:58.763829 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.763805 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" (UID: \"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:13:58.763925 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.763882 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5flm\" (UniqueName: \"kubernetes.io/projected/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-kube-api-access-b5flm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" (UID: \"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:13:58.864951 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.864888 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" (UID: \"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:13:58.864951 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.864927 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5flm\" (UniqueName: \"kubernetes.io/projected/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-kube-api-access-b5flm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" (UID: \"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:13:58.865333 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.865306 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" (UID: \"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:13:58.883943 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.883916 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5flm\" (UniqueName: \"kubernetes.io/projected/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-kube-api-access-b5flm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" (UID: \"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:13:58.909812 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:58.909791 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:13:59.206821 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:59.206798 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g"] Sep 10 12:13:59.208163 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:13:59.208133 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9161ceff_dc5b_47f8_8c24_9ffcd0d4ccdc.slice/crio-b137ec714d0d5e46c988ddc27bedbda568b41b36b81461d7d914603b48a85c99 WatchSource:0}: Error finding container b137ec714d0d5e46c988ddc27bedbda568b41b36b81461d7d914603b48a85c99: Status 404 returned error can't find the container with id b137ec714d0d5e46c988ddc27bedbda568b41b36b81461d7d914603b48a85c99 Sep 10 12:13:59.263046 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:59.263022 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:59.961955 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:13:59.961919 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" event={"ID":"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc","Type":"ContainerStarted","Data":"b137ec714d0d5e46c988ddc27bedbda568b41b36b81461d7d914603b48a85c99"} Sep 10 12:14:00.234295 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:00.234192 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:00.609977 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:00.609951 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc"] Sep 10 12:14:00.614805 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:00.614783 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc" Sep 10 12:14:00.618015 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:00.617990 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qw72r\"" Sep 10 12:14:00.618135 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:00.617990 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 10 12:14:00.708068 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:00.708018 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc"] Sep 10 12:14:00.782137 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:00.782106 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmgmw\" (UniqueName: \"kubernetes.io/projected/dd855fbb-5fa1-4604-8aea-d641fca7b9cf-kube-api-access-hmgmw\") pod \"dns-operator-controller-manager-7b84cd7c9c-qm5bc\" (UID: \"dd855fbb-5fa1-4604-8aea-d641fca7b9cf\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc" Sep 10 12:14:00.883410 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:00.883324 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmgmw\" (UniqueName: \"kubernetes.io/projected/dd855fbb-5fa1-4604-8aea-d641fca7b9cf-kube-api-access-hmgmw\") pod \"dns-operator-controller-manager-7b84cd7c9c-qm5bc\" (UID: \"dd855fbb-5fa1-4604-8aea-d641fca7b9cf\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc" Sep 10 12:14:00.894757 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:00.894728 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmgmw\" (UniqueName: \"kubernetes.io/projected/dd855fbb-5fa1-4604-8aea-d641fca7b9cf-kube-api-access-hmgmw\") pod \"dns-operator-controller-manager-7b84cd7c9c-qm5bc\" (UID: \"dd855fbb-5fa1-4604-8aea-d641fca7b9cf\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc" Sep 10 12:14:00.927488 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:00.927455 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc" Sep 10 12:14:01.218335 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:01.218306 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc"] Sep 10 12:14:01.220246 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:14:01.220207 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd855fbb_5fa1_4604_8aea_d641fca7b9cf.slice/crio-22d451782c5af4d033b4c97571f8f15b210273fdf1392201bd5ad1d7f5966cf3 WatchSource:0}: Error finding container 22d451782c5af4d033b4c97571f8f15b210273fdf1392201bd5ad1d7f5966cf3: Status 404 returned error can't find the container with id 22d451782c5af4d033b4c97571f8f15b210273fdf1392201bd5ad1d7f5966cf3 Sep 10 12:14:01.374463 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:01.374377 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:01.675420 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:01.675307 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:01.978540 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:01.978461 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc" event={"ID":"dd855fbb-5fa1-4604-8aea-d641fca7b9cf","Type":"ContainerStarted","Data":"22d451782c5af4d033b4c97571f8f15b210273fdf1392201bd5ad1d7f5966cf3"} Sep 10 12:14:03.395254 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.395220 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b"] Sep 10 12:14:03.399270 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.399245 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:03.403262 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.403234 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8k8c6\"" Sep 10 12:14:03.422500 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.422472 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b"] Sep 10 12:14:03.467069 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.467038 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:03.506078 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.506052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s26kq\" (UniqueName: \"kubernetes.io/projected/cfef0946-8747-47cd-aef4-77e2787ec325-kube-api-access-s26kq\") pod \"limitador-operator-controller-manager-74495c69f8-ms58b\" (UID: \"cfef0946-8747-47cd-aef4-77e2787ec325\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:03.606972 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.606945 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s26kq\" (UniqueName: \"kubernetes.io/projected/cfef0946-8747-47cd-aef4-77e2787ec325-kube-api-access-s26kq\") pod \"limitador-operator-controller-manager-74495c69f8-ms58b\" (UID: \"cfef0946-8747-47cd-aef4-77e2787ec325\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:03.644152 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.644122 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s26kq\" (UniqueName: \"kubernetes.io/projected/cfef0946-8747-47cd-aef4-77e2787ec325-kube-api-access-s26kq\") pod \"limitador-operator-controller-manager-74495c69f8-ms58b\" (UID: \"cfef0946-8747-47cd-aef4-77e2787ec325\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:03.659165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.659003 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:03.713344 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.713309 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:03.877472 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.877422 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:03.993434 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.993347 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" event={"ID":"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc","Type":"ContainerStarted","Data":"b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d"} Sep 10 12:14:03.993667 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:03.993507 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:04.024853 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:04.024829 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b"] Sep 10 12:14:04.030262 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:14:04.030236 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfef0946_8747_47cd_aef4_77e2787ec325.slice/crio-44722665c40d4232d25290daec55bf3fa1c324a980d5eb4eae2e72fa2c6a4ead WatchSource:0}: Error finding container 44722665c40d4232d25290daec55bf3fa1c324a980d5eb4eae2e72fa2c6a4ead: Status 404 returned error can't find the container with id 44722665c40d4232d25290daec55bf3fa1c324a980d5eb4eae2e72fa2c6a4ead Sep 10 12:14:04.042370 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:04.042313 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" podStartSLOduration=1.7101384739999999 podStartE2EDuration="6.042293658s" totalImagesPullingTime="4.332155184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:04.040111895 +0000 UTC m=+483.876094482" watchObservedRunningTime="2026-09-10 12:14:04.042293658 +0000 UTC m=+483.878276253" Sep 10 12:14:04.124056 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:04.124022 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:04.999823 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:04.999788 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" event={"ID":"cfef0946-8747-47cd-aef4-77e2787ec325","Type":"ContainerStarted","Data":"44722665c40d4232d25290daec55bf3fa1c324a980d5eb4eae2e72fa2c6a4ead"} Sep 10 12:14:05.001497 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:05.001471 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc" event={"ID":"dd855fbb-5fa1-4604-8aea-d641fca7b9cf","Type":"ContainerStarted","Data":"df2919ef9271eabeb064bc5d9f3c6167ada7146c51eb97d581dcde9a4eadabe3"} Sep 10 12:14:06.006891 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.006856 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc" Sep 10 12:14:06.172539 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.172471 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc" podStartSLOduration=2.892606881 podStartE2EDuration="6.172446798s" totalImagesPullingTime="3.279839917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:05.027377833 +0000 UTC m=+484.863360420" watchObservedRunningTime="2026-09-10 12:14:06.172446798 +0000 UTC m=+486.008429385" Sep 10 12:14:06.173540 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.173518 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-brgjj"] Sep 10 12:14:06.177123 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.177099 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-brgjj" Sep 10 12:14:06.181614 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.181573 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sx9bn\"" Sep 10 12:14:06.194379 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.194340 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-brgjj"] Sep 10 12:14:06.331423 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.331314 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmv7b\" (UniqueName: \"kubernetes.io/projected/626d00d3-fbd9-4775-a661-48d665789d14-kube-api-access-qmv7b\") pod \"authorino-operator-76b478bd78-brgjj\" (UID: \"626d00d3-fbd9-4775-a661-48d665789d14\") " pod="kuadrant-system/authorino-operator-76b478bd78-brgjj" Sep 10 12:14:06.432320 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.432288 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmv7b\" (UniqueName: \"kubernetes.io/projected/626d00d3-fbd9-4775-a661-48d665789d14-kube-api-access-qmv7b\") pod \"authorino-operator-76b478bd78-brgjj\" (UID: \"626d00d3-fbd9-4775-a661-48d665789d14\") " pod="kuadrant-system/authorino-operator-76b478bd78-brgjj" Sep 10 12:14:06.448437 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.448406 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmv7b\" (UniqueName: \"kubernetes.io/projected/626d00d3-fbd9-4775-a661-48d665789d14-kube-api-access-qmv7b\") pod \"authorino-operator-76b478bd78-brgjj\" (UID: \"626d00d3-fbd9-4775-a661-48d665789d14\") " pod="kuadrant-system/authorino-operator-76b478bd78-brgjj" Sep 10 12:14:06.469373 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.469336 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h"] Sep 10 12:14:06.472999 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.472973 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:06.475536 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.475504 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:06.478893 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.478863 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 10 12:14:06.478893 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.478880 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vxl8r\"" Sep 10 12:14:06.479058 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.478882 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 10 12:14:06.487550 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.487514 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h"] Sep 10 12:14:06.488493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.488465 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-brgjj" Sep 10 12:14:06.634309 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.634272 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhgft\" (UniqueName: \"kubernetes.io/projected/55e8951e-106b-4287-aed8-1c24972668d0-kube-api-access-bhgft\") pod \"kuadrant-console-plugin-fbdd4f445-qbk4h\" (UID: \"55e8951e-106b-4287-aed8-1c24972668d0\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:06.634480 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.634330 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/55e8951e-106b-4287-aed8-1c24972668d0-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-qbk4h\" (UID: \"55e8951e-106b-4287-aed8-1c24972668d0\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:06.634480 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.634421 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55e8951e-106b-4287-aed8-1c24972668d0-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-qbk4h\" (UID: \"55e8951e-106b-4287-aed8-1c24972668d0\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:06.735431 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.735399 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/55e8951e-106b-4287-aed8-1c24972668d0-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-qbk4h\" (UID: \"55e8951e-106b-4287-aed8-1c24972668d0\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:06.735626 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.735472 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55e8951e-106b-4287-aed8-1c24972668d0-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-qbk4h\" (UID: \"55e8951e-106b-4287-aed8-1c24972668d0\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:06.735626 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.735611 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhgft\" (UniqueName: \"kubernetes.io/projected/55e8951e-106b-4287-aed8-1c24972668d0-kube-api-access-bhgft\") pod \"kuadrant-console-plugin-fbdd4f445-qbk4h\" (UID: \"55e8951e-106b-4287-aed8-1c24972668d0\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:06.736138 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.736116 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55e8951e-106b-4287-aed8-1c24972668d0-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-qbk4h\" (UID: \"55e8951e-106b-4287-aed8-1c24972668d0\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:06.737943 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.737922 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/55e8951e-106b-4287-aed8-1c24972668d0-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-qbk4h\" (UID: \"55e8951e-106b-4287-aed8-1c24972668d0\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:06.747695 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.747672 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhgft\" (UniqueName: \"kubernetes.io/projected/55e8951e-106b-4287-aed8-1c24972668d0-kube-api-access-bhgft\") pod \"kuadrant-console-plugin-fbdd4f445-qbk4h\" (UID: \"55e8951e-106b-4287-aed8-1c24972668d0\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:06.769393 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.769373 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-brgjj"] Sep 10 12:14:06.771125 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:14:06.771099 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626d00d3_fbd9_4775_a661_48d665789d14.slice/crio-c4903b0385b980bbd450e341d5072dc839d8e948e517ce8817db2d34ec673035 WatchSource:0}: Error finding container c4903b0385b980bbd450e341d5072dc839d8e948e517ce8817db2d34ec673035: Status 404 returned error can't find the container with id c4903b0385b980bbd450e341d5072dc839d8e948e517ce8817db2d34ec673035 Sep 10 12:14:06.783646 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:06.783626 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" Sep 10 12:14:07.014042 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:07.013947 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-brgjj" event={"ID":"626d00d3-fbd9-4775-a661-48d665789d14","Type":"ContainerStarted","Data":"c4903b0385b980bbd450e341d5072dc839d8e948e517ce8817db2d34ec673035"} Sep 10 12:14:07.059766 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:14:07.059735 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55e8951e_106b_4287_aed8_1c24972668d0.slice/crio-9b2130ad74375cccfba8e65e6c70b8c9033eae62995ea9d24102c3c089362cbf WatchSource:0}: Error finding container 9b2130ad74375cccfba8e65e6c70b8c9033eae62995ea9d24102c3c089362cbf: Status 404 returned error can't find the container with id 9b2130ad74375cccfba8e65e6c70b8c9033eae62995ea9d24102c3c089362cbf Sep 10 12:14:07.061373 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:07.061350 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h"] Sep 10 12:14:07.143999 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:07.143960 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:08.022343 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:08.022309 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" event={"ID":"55e8951e-106b-4287-aed8-1c24972668d0","Type":"ContainerStarted","Data":"9b2130ad74375cccfba8e65e6c70b8c9033eae62995ea9d24102c3c089362cbf"} Sep 10 12:14:09.035121 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:09.035084 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-brgjj" event={"ID":"626d00d3-fbd9-4775-a661-48d665789d14","Type":"ContainerStarted","Data":"b5f9adc6e0d0e8df9f218cff99fa742344fa19cc5a28d5586ad4785f0ca3922b"} Sep 10 12:14:09.035685 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:09.035479 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-brgjj" Sep 10 12:14:09.076056 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:09.075997 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-brgjj" podStartSLOduration=1.5915936400000001 podStartE2EDuration="3.075975414s" totalImagesPullingTime="1.484381774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:09.072679997 +0000 UTC m=+488.908662596" watchObservedRunningTime="2026-09-10 12:14:09.075975414 +0000 UTC m=+488.911957999" Sep 10 12:14:09.386610 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:09.386551 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:09.494889 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:09.494862 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:09.858674 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:09.858626 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:09.959818 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:09.959784 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:10.046168 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:10.046129 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" event={"ID":"cfef0946-8747-47cd-aef4-77e2787ec325","Type":"ContainerStarted","Data":"993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed"} Sep 10 12:14:10.046726 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:10.046219 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:10.263311 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:10.263228 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:10.386108 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:10.386079 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:13.066379 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:13.066284 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" event={"ID":"55e8951e-106b-4287-aed8-1c24972668d0","Type":"ContainerStarted","Data":"235d09b3e80144c15d4e8d36c78396feca0abc843ac4bc6f9223795391eca871"} Sep 10 12:14:13.085037 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:13.084988 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" podStartSLOduration=4.644238576 podStartE2EDuration="10.084971142s" totalImagesPullingTime="5.440732566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:10.076661562 +0000 UTC m=+489.912644149" watchObservedRunningTime="2026-09-10 12:14:13.084971142 +0000 UTC m=+492.920953728" Sep 10 12:14:13.086998 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:13.086962 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-qbk4h" podStartSLOduration=1.530243123 podStartE2EDuration="7.086953507s" totalImagesPullingTime="5.556710384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:13.084468986 +0000 UTC m=+492.920451572" watchObservedRunningTime="2026-09-10 12:14:13.086953507 +0000 UTC m=+492.922936117" Sep 10 12:14:15.003490 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:15.003453 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:15.543067 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:15.543029 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:15.661507 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:15.661464 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:17.016765 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.016732 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qm5bc" Sep 10 12:14:17.366604 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.366547 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g"] Sep 10 12:14:17.366796 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.366768 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" containerName="manager" containerID="cri-o://b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d" gracePeriod=2 Sep 10 12:14:17.370622 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.370555 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:17.370992 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.370966 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g"] Sep 10 12:14:17.382953 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.382929 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b"] Sep 10 12:14:17.383126 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.383103 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" containerName="manager" containerID="cri-o://993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed" gracePeriod=2 Sep 10 12:14:17.385428 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.385404 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:17.386412 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.386364 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:17.395284 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.395257 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b"] Sep 10 12:14:17.397241 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.397213 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:17.399633 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.399610 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ms58b\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:17.407767 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.407742 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg"] Sep 10 12:14:17.408087 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.408075 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" containerName="manager" Sep 10 12:14:17.408139 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.408088 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" containerName="manager" Sep 10 12:14:17.408139 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.408098 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" containerName="manager" Sep 10 12:14:17.408139 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.408103 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" containerName="manager" Sep 10 12:14:17.408233 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.408158 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" containerName="manager" Sep 10 12:14:17.408233 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.408169 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" containerName="manager" Sep 10 12:14:17.411068 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.411053 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:17.413498 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.413473 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ms58b\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:17.415082 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.415062 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg"] Sep 10 12:14:17.415985 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.415964 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:17.418331 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.418316 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg" Sep 10 12:14:17.429615 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.429538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mgrh\" (UniqueName: \"kubernetes.io/projected/52ff0c82-6ce2-4e1c-8811-699cfb728c94-kube-api-access-9mgrh\") pod \"limitador-operator-controller-manager-74495c69f8-4mkfg\" (UID: \"52ff0c82-6ce2-4e1c-8811-699cfb728c94\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg" Sep 10 12:14:17.429797 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.429649 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76hcl\" (UniqueName: \"kubernetes.io/projected/c1027d48-f6ef-4148-80f2-bde2b580c279-kube-api-access-76hcl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-r8fjg\" (UID: \"c1027d48-f6ef-4148-80f2-bde2b580c279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:17.429797 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.429682 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1027d48-f6ef-4148-80f2-bde2b580c279-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-r8fjg\" (UID: \"c1027d48-f6ef-4148-80f2-bde2b580c279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:17.431228 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.431202 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg"] Sep 10 12:14:17.436710 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.436685 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg"] Sep 10 12:14:17.457489 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.457455 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:17.460157 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.460122 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ms58b\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:17.530779 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.530697 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mgrh\" (UniqueName: \"kubernetes.io/projected/52ff0c82-6ce2-4e1c-8811-699cfb728c94-kube-api-access-9mgrh\") pod \"limitador-operator-controller-manager-74495c69f8-4mkfg\" (UID: \"52ff0c82-6ce2-4e1c-8811-699cfb728c94\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg" Sep 10 12:14:17.530779 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.530763 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76hcl\" (UniqueName: \"kubernetes.io/projected/c1027d48-f6ef-4148-80f2-bde2b580c279-kube-api-access-76hcl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-r8fjg\" (UID: \"c1027d48-f6ef-4148-80f2-bde2b580c279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:17.530975 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.530796 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1027d48-f6ef-4148-80f2-bde2b580c279-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-r8fjg\" (UID: \"c1027d48-f6ef-4148-80f2-bde2b580c279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:17.531172 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.531154 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1027d48-f6ef-4148-80f2-bde2b580c279-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-r8fjg\" (UID: \"c1027d48-f6ef-4148-80f2-bde2b580c279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:17.545251 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.545196 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76hcl\" (UniqueName: \"kubernetes.io/projected/c1027d48-f6ef-4148-80f2-bde2b580c279-kube-api-access-76hcl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-r8fjg\" (UID: \"c1027d48-f6ef-4148-80f2-bde2b580c279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:17.546388 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.546341 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mgrh\" (UniqueName: \"kubernetes.io/projected/52ff0c82-6ce2-4e1c-8811-699cfb728c94-kube-api-access-9mgrh\") pod \"limitador-operator-controller-manager-74495c69f8-4mkfg\" (UID: \"52ff0c82-6ce2-4e1c-8811-699cfb728c94\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg" Sep 10 12:14:17.609690 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.609487 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:17.622744 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.622719 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:17.625304 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.625274 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:17.626921 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.626903 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:17.627768 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.627746 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ms58b\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:17.630014 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.629992 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:17.631161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.631142 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-extensions-socket-volume\") pod \"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc\" (UID: \"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc\") " Sep 10 12:14:17.631219 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.631205 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s26kq\" (UniqueName: \"kubernetes.io/projected/cfef0946-8747-47cd-aef4-77e2787ec325-kube-api-access-s26kq\") pod \"cfef0946-8747-47cd-aef4-77e2787ec325\" (UID: \"cfef0946-8747-47cd-aef4-77e2787ec325\") " Sep 10 12:14:17.631281 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.631237 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5flm\" (UniqueName: \"kubernetes.io/projected/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-kube-api-access-b5flm\") pod \"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc\" (UID: \"9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc\") " Sep 10 12:14:17.631618 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.631587 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" (UID: "9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:14:17.632084 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:17.632063 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ms58b\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:17.633336 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.633314 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfef0946-8747-47cd-aef4-77e2787ec325-kube-api-access-s26kq" (OuterVolumeSpecName: "kube-api-access-s26kq") pod "cfef0946-8747-47cd-aef4-77e2787ec325" (UID: "cfef0946-8747-47cd-aef4-77e2787ec325"). InnerVolumeSpecName "kube-api-access-s26kq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:14:17.633400 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.633320 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-kube-api-access-b5flm" (OuterVolumeSpecName: "kube-api-access-b5flm") pod "9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" (UID: "9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc"). InnerVolumeSpecName "kube-api-access-b5flm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:14:17.732300 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.732259 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-extensions-socket-volume\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:14:17.732300 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.732294 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s26kq\" (UniqueName: \"kubernetes.io/projected/cfef0946-8747-47cd-aef4-77e2787ec325-kube-api-access-s26kq\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:14:17.732300 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.732303 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5flm\" (UniqueName: \"kubernetes.io/projected/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc-kube-api-access-b5flm\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:14:17.735318 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.735290 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:17.805090 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.805051 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:17.812247 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:17.812210 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg" Sep 10 12:14:18.097985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.097948 2555 generic.go:356] "Generic (PLEG): container finished" podID="cfef0946-8747-47cd-aef4-77e2787ec325" containerID="993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed" exitCode=0 Sep 10 12:14:18.098444 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.097992 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:18.098444 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.098037 2555 scope.go:117] "RemoveContainer" containerID="993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed" Sep 10 12:14:18.099725 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.099701 2555 generic.go:356] "Generic (PLEG): container finished" podID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" containerID="b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d" exitCode=0 Sep 10 12:14:18.099825 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.099757 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:18.101555 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:18.101533 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:18.104298 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:18.104272 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ms58b\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:18.109553 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.109257 2555 scope.go:117] "RemoveContainer" containerID="993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed" Sep 10 12:14:18.109553 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:18.109442 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:18.109718 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:18.109688 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed\": container with ID starting with 993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed not found: ID does not exist" containerID="993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed" Sep 10 12:14:18.109788 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.109723 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed"} err="failed to get container status \"993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed\": rpc error: code = NotFound desc = could not find container \"993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed\": container with ID starting with 993746b993b259ba4f5e10672d34f4626073a76e3b2a21eec27fc31cc650b1ed not found: ID does not exist" Sep 10 12:14:18.109788 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.109746 2555 scope.go:117] "RemoveContainer" containerID="b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d" Sep 10 12:14:18.112737 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:14:18.112712 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ff0c82_6ce2_4e1c_8811_699cfb728c94.slice/crio-a13feb8caa0c68620265c01ef19cb0f692e491758deb37bab5d1b884a1e3885a WatchSource:0}: Error finding container a13feb8caa0c68620265c01ef19cb0f692e491758deb37bab5d1b884a1e3885a: Status 404 returned error can't find the container with id a13feb8caa0c68620265c01ef19cb0f692e491758deb37bab5d1b884a1e3885a Sep 10 12:14:18.112839 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.112787 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg"] Sep 10 12:14:18.112904 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:18.112880 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ms58b\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:18.114167 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:14:18.114138 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1027d48_f6ef_4148_80f2_bde2b580c279.slice/crio-6b290cb8f7ee0920b0e1375113f926296679b3ad9753af3403ac09b28008a512 WatchSource:0}: Error finding container 6b290cb8f7ee0920b0e1375113f926296679b3ad9753af3403ac09b28008a512: Status 404 returned error can't find the container with id 6b290cb8f7ee0920b0e1375113f926296679b3ad9753af3403ac09b28008a512 Sep 10 12:14:18.116482 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:18.116444 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-57r9g\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-57r9g" Sep 10 12:14:18.118552 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.118450 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg"] Sep 10 12:14:18.120818 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:18.120782 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ms58b\" is forbidden: User \"system:node:ip-10-0-128-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-140.ec2.internal' and this object" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ms58b" Sep 10 12:14:18.123453 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.123430 2555 scope.go:117] "RemoveContainer" containerID="b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d" Sep 10 12:14:18.124322 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:18.123902 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d\": container with ID starting with b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d not found: ID does not exist" containerID="b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d" Sep 10 12:14:18.124322 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.123943 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d"} err="failed to get container status \"b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d\": rpc error: code = NotFound desc = could not find container \"b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d\": container with ID starting with b00300b0eeecca9405c5d1270ae86cf1ccfabc32c38d3d9f7fd3b5d22fd7675d not found: ID does not exist" Sep 10 12:14:18.767533 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.767495 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc" path="/var/lib/kubelet/pods/9161ceff-dc5b-47f8-8c24-9ffcd0d4ccdc/volumes" Sep 10 12:14:18.767850 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:18.767836 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfef0946-8747-47cd-aef4-77e2787ec325" path="/var/lib/kubelet/pods/cfef0946-8747-47cd-aef4-77e2787ec325/volumes" Sep 10 12:14:19.108431 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:19.108394 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" event={"ID":"c1027d48-f6ef-4148-80f2-bde2b580c279","Type":"ContainerStarted","Data":"c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf"} Sep 10 12:14:19.108900 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:19.108463 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:19.108900 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:19.108487 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" event={"ID":"c1027d48-f6ef-4148-80f2-bde2b580c279","Type":"ContainerStarted","Data":"6b290cb8f7ee0920b0e1375113f926296679b3ad9753af3403ac09b28008a512"} Sep 10 12:14:19.111050 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:19.111023 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg" event={"ID":"52ff0c82-6ce2-4e1c-8811-699cfb728c94","Type":"ContainerStarted","Data":"2249aeda9c68ab124eefb2a43947c2cb002146fa17cd15317742ae36e461f0e9"} Sep 10 12:14:19.111174 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:19.111066 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg" event={"ID":"52ff0c82-6ce2-4e1c-8811-699cfb728c94","Type":"ContainerStarted","Data":"a13feb8caa0c68620265c01ef19cb0f692e491758deb37bab5d1b884a1e3885a"} Sep 10 12:14:19.111174 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:19.111102 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg" Sep 10 12:14:19.146327 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:19.146281 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" podStartSLOduration=2.146267155 podStartE2EDuration="2.146267155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:19.144375252 +0000 UTC m=+498.980357837" watchObservedRunningTime="2026-09-10 12:14:19.146267155 +0000 UTC m=+498.982249741" Sep 10 12:14:19.197822 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:19.197765 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg" podStartSLOduration=2.197750694 podStartE2EDuration="2.197750694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:19.195813344 +0000 UTC m=+499.031795943" watchObservedRunningTime="2026-09-10 12:14:19.197750694 +0000 UTC m=+499.033733280" Sep 10 12:14:20.048642 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:20.048615 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-brgjj" Sep 10 12:14:20.307620 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:20.307516 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:20.412857 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:20.412822 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:25.099103 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:25.099062 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:25.201183 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:25.201144 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:30.119168 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:30.119139 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4mkfg" Sep 10 12:14:30.119632 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:30.119319 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:30.293793 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:30.293754 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:30.389900 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:30.389813 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:30.740480 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:30.740383 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:30.849218 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:30.849145 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:30.962211 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:30.962178 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:35.268549 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:35.268514 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg"] Sep 10 12:14:35.268959 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:35.268732 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" podUID="c1027d48-f6ef-4148-80f2-bde2b580c279" containerName="manager" containerID="cri-o://c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf" gracePeriod=10 Sep 10 12:14:35.552485 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:35.552429 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:35.669983 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:35.669960 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1027d48-f6ef-4148-80f2-bde2b580c279-extensions-socket-volume\") pod \"c1027d48-f6ef-4148-80f2-bde2b580c279\" (UID: \"c1027d48-f6ef-4148-80f2-bde2b580c279\") " Sep 10 12:14:35.670120 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:35.669994 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76hcl\" (UniqueName: \"kubernetes.io/projected/c1027d48-f6ef-4148-80f2-bde2b580c279-kube-api-access-76hcl\") pod \"c1027d48-f6ef-4148-80f2-bde2b580c279\" (UID: \"c1027d48-f6ef-4148-80f2-bde2b580c279\") " Sep 10 12:14:35.670367 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:35.670338 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1027d48-f6ef-4148-80f2-bde2b580c279-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c1027d48-f6ef-4148-80f2-bde2b580c279" (UID: "c1027d48-f6ef-4148-80f2-bde2b580c279"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:14:35.671993 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:35.671972 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1027d48-f6ef-4148-80f2-bde2b580c279-kube-api-access-76hcl" (OuterVolumeSpecName: "kube-api-access-76hcl") pod "c1027d48-f6ef-4148-80f2-bde2b580c279" (UID: "c1027d48-f6ef-4148-80f2-bde2b580c279"). InnerVolumeSpecName "kube-api-access-76hcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:14:35.771063 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:35.771038 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1027d48-f6ef-4148-80f2-bde2b580c279-extensions-socket-volume\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:14:35.771063 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:35.771059 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76hcl\" (UniqueName: \"kubernetes.io/projected/c1027d48-f6ef-4148-80f2-bde2b580c279-kube-api-access-76hcl\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:14:36.207262 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:36.207229 2555 generic.go:356] "Generic (PLEG): container finished" podID="c1027d48-f6ef-4148-80f2-bde2b580c279" containerID="c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf" exitCode=0 Sep 10 12:14:36.207414 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:36.207271 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" Sep 10 12:14:36.207414 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:36.207317 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" event={"ID":"c1027d48-f6ef-4148-80f2-bde2b580c279","Type":"ContainerDied","Data":"c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf"} Sep 10 12:14:36.207414 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:36.207367 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg" event={"ID":"c1027d48-f6ef-4148-80f2-bde2b580c279","Type":"ContainerDied","Data":"6b290cb8f7ee0920b0e1375113f926296679b3ad9753af3403ac09b28008a512"} Sep 10 12:14:36.207414 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:36.207395 2555 scope.go:117] "RemoveContainer" containerID="c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf" Sep 10 12:14:36.219820 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:36.219800 2555 scope.go:117] "RemoveContainer" containerID="c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf" Sep 10 12:14:36.220120 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:14:36.220102 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf\": container with ID starting with c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf not found: ID does not exist" containerID="c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf" Sep 10 12:14:36.220170 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:36.220128 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf"} err="failed to get container status \"c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf\": rpc error: code = NotFound desc = could not find container \"c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf\": container with ID starting with c1b874de16b16ec45326e940d483829c443bffad8b9f1c271977009d24a13cdf not found: ID does not exist" Sep 10 12:14:36.237473 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:36.237450 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg"] Sep 10 12:14:36.242931 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:36.242909 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-r8fjg"] Sep 10 12:14:36.768274 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:36.768235 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1027d48-f6ef-4148-80f2-bde2b580c279" path="/var/lib/kubelet/pods/c1027d48-f6ef-4148-80f2-bde2b580c279/volumes" Sep 10 12:14:37.144925 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:37.144892 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:37.262547 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:37.262516 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:41.690255 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:41.690216 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:41.785954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:41.785923 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:46.499765 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:46.499725 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:46.599853 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:46.599817 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:51.789973 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.789940 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78"] Sep 10 12:14:51.790330 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.790282 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1027d48-f6ef-4148-80f2-bde2b580c279" containerName="manager" Sep 10 12:14:51.790330 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.790292 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1027d48-f6ef-4148-80f2-bde2b580c279" containerName="manager" Sep 10 12:14:51.790406 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.790360 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1027d48-f6ef-4148-80f2-bde2b580c279" containerName="manager" Sep 10 12:14:51.800938 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.800908 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:51.806866 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.806847 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.814302 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.814280 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qsgqj\"" Sep 10 12:14:51.814535 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.814372 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 12:14:51.815791 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.815771 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78"] Sep 10 12:14:51.893111 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.893084 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1244b3a-b287-4e2e-a978-018634803eb7-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.893240 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.893154 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxcp5\" (UniqueName: \"kubernetes.io/projected/b1244b3a-b287-4e2e-a978-018634803eb7-kube-api-access-gxcp5\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.893240 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.893178 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.893240 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.893194 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.893377 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.893356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1244b3a-b287-4e2e-a978-018634803eb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.893421 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.893408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.893471 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.893439 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1244b3a-b287-4e2e-a978-018634803eb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.893512 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.893482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.893549 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.893532 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994348 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994321 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994365 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1244b3a-b287-4e2e-a978-018634803eb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994395 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994415 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1244b3a-b287-4e2e-a978-018634803eb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994436 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994493 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994805 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994625 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1244b3a-b287-4e2e-a978-018634803eb7-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994805 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994699 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxcp5\" (UniqueName: \"kubernetes.io/projected/b1244b3a-b287-4e2e-a978-018634803eb7-kube-api-access-gxcp5\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994805 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994735 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994957 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994883 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.994957 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994911 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.995054 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.994978 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.995108 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.995080 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.995234 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.995213 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1244b3a-b287-4e2e-a978-018634803eb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.996875 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.996853 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1244b3a-b287-4e2e-a978-018634803eb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:51.996954 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:51.996857 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1244b3a-b287-4e2e-a978-018634803eb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:52.003758 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:52.003739 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1244b3a-b287-4e2e-a978-018634803eb7-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:52.003981 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:52.003958 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxcp5\" (UniqueName: \"kubernetes.io/projected/b1244b3a-b287-4e2e-a978-018634803eb7-kube-api-access-gxcp5\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9bv78\" (UID: \"b1244b3a-b287-4e2e-a978-018634803eb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:52.117283 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:52.117252 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:52.203517 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:52.203471 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:52.400371 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:52.400342 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78"] Sep 10 12:14:52.401118 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:14:52.401093 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1244b3a_b287_4e2e_a978_018634803eb7.slice/crio-f22ca74f9181411eb3e820701a7110f09ccd7bed462c9f5ea1f72a099ee4ece5 WatchSource:0}: Error finding container f22ca74f9181411eb3e820701a7110f09ccd7bed462c9f5ea1f72a099ee4ece5: Status 404 returned error can't find the container with id f22ca74f9181411eb3e820701a7110f09ccd7bed462c9f5ea1f72a099ee4ece5 Sep 10 12:14:53.300675 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:53.300592 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" event={"ID":"b1244b3a-b287-4e2e-a978-018634803eb7","Type":"ContainerStarted","Data":"f22ca74f9181411eb3e820701a7110f09ccd7bed462c9f5ea1f72a099ee4ece5"} Sep 10 12:14:55.270553 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:55.270516 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 12:14:55.270808 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:55.270602 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 12:14:55.270808 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:55.270632 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 12:14:56.320032 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:56.319999 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" event={"ID":"b1244b3a-b287-4e2e-a978-018634803eb7","Type":"ContainerStarted","Data":"836255996a4552372238c637a25f24a8b774766f185c57c04a13ed50f1feef55"} Sep 10 12:14:56.355184 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:56.355137 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" podStartSLOduration=2.487877256 podStartE2EDuration="5.355123076s" totalImagesPullingTime="2.86724582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:56.353643334 +0000 UTC m=+536.189625921" watchObservedRunningTime="2026-09-10 12:14:56.355123076 +0000 UTC m=+536.191105662" Sep 10 12:14:57.117791 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.117760 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:57.122223 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.122198 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:57.325667 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.325639 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:57.326492 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.326472 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:14:57.494781 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.494704 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:57.494973 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.494954 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-c5zxr"] Sep 10 12:14:57.502580 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.498835 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:14:57.504336 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.504159 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 12:14:57.507652 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.507627 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-c5zxr"] Sep 10 12:14:57.581061 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.581031 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-c5zxr"] Sep 10 12:14:57.601817 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.601771 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:57.639833 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.639798 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9877a446-702e-4076-86d5-284cb4f04185-config-file\") pod \"limitador-limitador-8588749977-c5zxr\" (UID: \"9877a446-702e-4076-86d5-284cb4f04185\") " pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:14:57.639955 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.639890 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdsk5\" (UniqueName: \"kubernetes.io/projected/9877a446-702e-4076-86d5-284cb4f04185-kube-api-access-pdsk5\") pod \"limitador-limitador-8588749977-c5zxr\" (UID: \"9877a446-702e-4076-86d5-284cb4f04185\") " pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:14:57.723657 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.723624 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:57.740633 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.740607 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9877a446-702e-4076-86d5-284cb4f04185-config-file\") pod \"limitador-limitador-8588749977-c5zxr\" (UID: \"9877a446-702e-4076-86d5-284cb4f04185\") " pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:14:57.740737 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.740658 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdsk5\" (UniqueName: \"kubernetes.io/projected/9877a446-702e-4076-86d5-284cb4f04185-kube-api-access-pdsk5\") pod \"limitador-limitador-8588749977-c5zxr\" (UID: \"9877a446-702e-4076-86d5-284cb4f04185\") " pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:14:57.741197 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.741178 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9877a446-702e-4076-86d5-284cb4f04185-config-file\") pod \"limitador-limitador-8588749977-c5zxr\" (UID: \"9877a446-702e-4076-86d5-284cb4f04185\") " pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:14:57.751466 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.751410 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdsk5\" (UniqueName: \"kubernetes.io/projected/9877a446-702e-4076-86d5-284cb4f04185-kube-api-access-pdsk5\") pod \"limitador-limitador-8588749977-c5zxr\" (UID: \"9877a446-702e-4076-86d5-284cb4f04185\") " pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:14:57.814073 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.814051 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:14:57.905626 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.905593 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:14:57.909624 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.909602 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" Sep 10 12:14:57.927078 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.927058 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:14:57.952080 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:57.952048 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:14:58.042366 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.042288 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d2d6\" (UniqueName: \"kubernetes.io/projected/57bf3a59-775b-45ff-ba73-37c351091527-kube-api-access-7d2d6\") pod \"limitador-limitador-84994f7ffc-8snml\" (UID: \"57bf3a59-775b-45ff-ba73-37c351091527\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" Sep 10 12:14:58.042485 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.042413 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57bf3a59-775b-45ff-ba73-37c351091527-config-file\") pod \"limitador-limitador-84994f7ffc-8snml\" (UID: \"57bf3a59-775b-45ff-ba73-37c351091527\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" Sep 10 12:14:58.090658 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.090635 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-c5zxr"] Sep 10 12:14:58.092535 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:14:58.092508 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9877a446_702e_4076_86d5_284cb4f04185.slice/crio-2432434e0d64a398b6e9118dc8a585bd152b2eeec433c4484b9570646226c11f WatchSource:0}: Error finding container 2432434e0d64a398b6e9118dc8a585bd152b2eeec433c4484b9570646226c11f: Status 404 returned error can't find the container with id 2432434e0d64a398b6e9118dc8a585bd152b2eeec433c4484b9570646226c11f Sep 10 12:14:58.142935 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.142902 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d2d6\" (UniqueName: \"kubernetes.io/projected/57bf3a59-775b-45ff-ba73-37c351091527-kube-api-access-7d2d6\") pod \"limitador-limitador-84994f7ffc-8snml\" (UID: \"57bf3a59-775b-45ff-ba73-37c351091527\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" Sep 10 12:14:58.143059 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.143009 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57bf3a59-775b-45ff-ba73-37c351091527-config-file\") pod \"limitador-limitador-84994f7ffc-8snml\" (UID: \"57bf3a59-775b-45ff-ba73-37c351091527\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" Sep 10 12:14:58.143666 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.143646 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57bf3a59-775b-45ff-ba73-37c351091527-config-file\") pod \"limitador-limitador-84994f7ffc-8snml\" (UID: \"57bf3a59-775b-45ff-ba73-37c351091527\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" Sep 10 12:14:58.151916 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.151897 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d2d6\" (UniqueName: \"kubernetes.io/projected/57bf3a59-775b-45ff-ba73-37c351091527-kube-api-access-7d2d6\") pod \"limitador-limitador-84994f7ffc-8snml\" (UID: \"57bf3a59-775b-45ff-ba73-37c351091527\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" Sep 10 12:14:58.219872 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.219852 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" Sep 10 12:14:58.332630 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.332531 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" event={"ID":"9877a446-702e-4076-86d5-284cb4f04185","Type":"ContainerStarted","Data":"2432434e0d64a398b6e9118dc8a585bd152b2eeec433c4484b9570646226c11f"} Sep 10 12:14:58.383254 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.383218 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:58.485083 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.485047 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:58.500102 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.500079 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:14:58.502453 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:14:58.502425 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57bf3a59_775b_45ff_ba73_37c351091527.slice/crio-500317f061b6397d9f53edb54ca0bd5510d1c48d17ae2e5758139093ed0a79aa WatchSource:0}: Error finding container 500317f061b6397d9f53edb54ca0bd5510d1c48d17ae2e5758139093ed0a79aa: Status 404 returned error can't find the container with id 500317f061b6397d9f53edb54ca0bd5510d1c48d17ae2e5758139093ed0a79aa Sep 10 12:14:58.652281 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.652249 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-mh4hc"] Sep 10 12:14:58.656882 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.656863 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mh4hc" Sep 10 12:14:58.661587 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.661548 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-glkkw\"" Sep 10 12:14:58.666955 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.666935 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mh4hc"] Sep 10 12:14:58.748351 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.748321 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d69tt\" (UniqueName: \"kubernetes.io/projected/e38e5ddb-b76a-4053-af2b-7855e58fa84e-kube-api-access-d69tt\") pod \"authorino-59c974bd48-mh4hc\" (UID: \"e38e5ddb-b76a-4053-af2b-7855e58fa84e\") " pod="kuadrant-system/authorino-59c974bd48-mh4hc" Sep 10 12:14:58.849580 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.849533 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d69tt\" (UniqueName: \"kubernetes.io/projected/e38e5ddb-b76a-4053-af2b-7855e58fa84e-kube-api-access-d69tt\") pod \"authorino-59c974bd48-mh4hc\" (UID: \"e38e5ddb-b76a-4053-af2b-7855e58fa84e\") " pod="kuadrant-system/authorino-59c974bd48-mh4hc" Sep 10 12:14:58.859796 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.859772 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d69tt\" (UniqueName: \"kubernetes.io/projected/e38e5ddb-b76a-4053-af2b-7855e58fa84e-kube-api-access-d69tt\") pod \"authorino-59c974bd48-mh4hc\" (UID: \"e38e5ddb-b76a-4053-af2b-7855e58fa84e\") " pod="kuadrant-system/authorino-59c974bd48-mh4hc" Sep 10 12:14:58.967492 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:58.967403 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mh4hc" Sep 10 12:14:59.245830 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:59.245787 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mh4hc"] Sep 10 12:14:59.247615 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:14:59.247579 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode38e5ddb_b76a_4053_af2b_7855e58fa84e.slice/crio-4d8ac66ea644b409bc0bb2c09204b0c3ccf7794412abedef3b93274a26a7bcd8 WatchSource:0}: Error finding container 4d8ac66ea644b409bc0bb2c09204b0c3ccf7794412abedef3b93274a26a7bcd8: Status 404 returned error can't find the container with id 4d8ac66ea644b409bc0bb2c09204b0c3ccf7794412abedef3b93274a26a7bcd8 Sep 10 12:14:59.340754 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:59.340722 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mh4hc" event={"ID":"e38e5ddb-b76a-4053-af2b-7855e58fa84e","Type":"ContainerStarted","Data":"4d8ac66ea644b409bc0bb2c09204b0c3ccf7794412abedef3b93274a26a7bcd8"} Sep 10 12:14:59.342084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:14:59.342059 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" event={"ID":"57bf3a59-775b-45ff-ba73-37c351091527","Type":"ContainerStarted","Data":"500317f061b6397d9f53edb54ca0bd5510d1c48d17ae2e5758139093ed0a79aa"} Sep 10 12:15:00.350374 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:00.350340 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" event={"ID":"9877a446-702e-4076-86d5-284cb4f04185","Type":"ContainerStarted","Data":"0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf"} Sep 10 12:15:00.350758 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:00.350456 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:15:01.357928 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:01.357825 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mh4hc" event={"ID":"e38e5ddb-b76a-4053-af2b-7855e58fa84e","Type":"ContainerStarted","Data":"8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea"} Sep 10 12:15:01.380329 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:01.380278 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-mh4hc" podStartSLOduration=1.536734493 podStartE2EDuration="3.380264231s" totalImagesPullingTime="1.843529738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:01.379870178 +0000 UTC m=+541.215852763" watchObservedRunningTime="2026-09-10 12:15:01.380264231 +0000 UTC m=+541.216246837" Sep 10 12:15:01.381183 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:01.381156 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" podStartSLOduration=2.907252254 podStartE2EDuration="4.381149588s" totalImagesPullingTime="1.473897334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:00.387505769 +0000 UTC m=+540.223488354" watchObservedRunningTime="2026-09-10 12:15:01.381149588 +0000 UTC m=+541.217132180" Sep 10 12:15:09.404186 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:09.404149 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" event={"ID":"57bf3a59-775b-45ff-ba73-37c351091527","Type":"ContainerStarted","Data":"2890242b376bff0ce51d6a78ab9d24ef1400342cba76d00efcd3d659b3edae4d"} Sep 10 12:15:09.404660 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:09.404233 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" Sep 10 12:15:09.433339 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:09.433290 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" podStartSLOduration=2.341564279 podStartE2EDuration="12.433277084s" totalImagesPullingTime="10.091712805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:09.432077401 +0000 UTC m=+549.268059986" watchObservedRunningTime="2026-09-10 12:15:09.433277084 +0000 UTC m=+549.269259678" Sep 10 12:15:11.359332 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:11.359302 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:15:20.410841 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:20.410809 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-8snml" Sep 10 12:15:20.481232 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:20.481201 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-c5zxr"] Sep 10 12:15:20.481414 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:20.481390 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" podUID="9877a446-702e-4076-86d5-284cb4f04185" containerName="limitador" containerID="cri-o://0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf" gracePeriod=30 Sep 10 12:15:21.021319 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.021292 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:15:21.117836 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.117813 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9877a446-702e-4076-86d5-284cb4f04185-config-file\") pod \"9877a446-702e-4076-86d5-284cb4f04185\" (UID: \"9877a446-702e-4076-86d5-284cb4f04185\") " Sep 10 12:15:21.118007 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.117940 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdsk5\" (UniqueName: \"kubernetes.io/projected/9877a446-702e-4076-86d5-284cb4f04185-kube-api-access-pdsk5\") pod \"9877a446-702e-4076-86d5-284cb4f04185\" (UID: \"9877a446-702e-4076-86d5-284cb4f04185\") " Sep 10 12:15:21.118175 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.118155 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9877a446-702e-4076-86d5-284cb4f04185-config-file" (OuterVolumeSpecName: "config-file") pod "9877a446-702e-4076-86d5-284cb4f04185" (UID: "9877a446-702e-4076-86d5-284cb4f04185"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:15:21.119943 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.119912 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9877a446-702e-4076-86d5-284cb4f04185-kube-api-access-pdsk5" (OuterVolumeSpecName: "kube-api-access-pdsk5") pod "9877a446-702e-4076-86d5-284cb4f04185" (UID: "9877a446-702e-4076-86d5-284cb4f04185"). InnerVolumeSpecName "kube-api-access-pdsk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:15:21.218572 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.218545 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdsk5\" (UniqueName: \"kubernetes.io/projected/9877a446-702e-4076-86d5-284cb4f04185-kube-api-access-pdsk5\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:15:21.218676 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.218584 2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9877a446-702e-4076-86d5-284cb4f04185-config-file\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:15:21.471739 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.471673 2555 generic.go:356] "Generic (PLEG): container finished" podID="9877a446-702e-4076-86d5-284cb4f04185" containerID="0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf" exitCode=0 Sep 10 12:15:21.471739 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.471720 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" Sep 10 12:15:21.472143 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.471763 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" event={"ID":"9877a446-702e-4076-86d5-284cb4f04185","Type":"ContainerDied","Data":"0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf"} Sep 10 12:15:21.472143 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.471818 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-c5zxr" event={"ID":"9877a446-702e-4076-86d5-284cb4f04185","Type":"ContainerDied","Data":"2432434e0d64a398b6e9118dc8a585bd152b2eeec433c4484b9570646226c11f"} Sep 10 12:15:21.472143 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.471848 2555 scope.go:117] "RemoveContainer" containerID="0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf" Sep 10 12:15:21.481430 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.481413 2555 scope.go:117] "RemoveContainer" containerID="0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf" Sep 10 12:15:21.481756 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:15:21.481734 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf\": container with ID starting with 0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf not found: ID does not exist" containerID="0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf" Sep 10 12:15:21.481836 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.481765 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf"} err="failed to get container status \"0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf\": rpc error: code = NotFound desc = could not find container \"0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf\": container with ID starting with 0d5d25dbfc2e3ea5c98e6237b0ca26681eff9999510f4732d90b0e5af9920dcf not found: ID does not exist" Sep 10 12:15:21.496663 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.496642 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-c5zxr"] Sep 10 12:15:21.503322 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:21.503302 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-c5zxr"] Sep 10 12:15:22.767915 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:22.767881 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9877a446-702e-4076-86d5-284cb4f04185" path="/var/lib/kubelet/pods/9877a446-702e-4076-86d5-284cb4f04185/volumes" Sep 10 12:15:23.840897 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:23.840854 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:24.001467 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:24.001432 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:24.414328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:24.414280 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:36.942131 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:36.942098 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:37.125017 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.124982 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:37.297203 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.297137 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-4gpjs"] Sep 10 12:15:37.297475 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.297463 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9877a446-702e-4076-86d5-284cb4f04185" containerName="limitador" Sep 10 12:15:37.297521 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.297477 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9877a446-702e-4076-86d5-284cb4f04185" containerName="limitador" Sep 10 12:15:37.297557 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.297552 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9877a446-702e-4076-86d5-284cb4f04185" containerName="limitador" Sep 10 12:15:37.302197 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.302176 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" Sep 10 12:15:37.305176 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.305156 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 10 12:15:37.314441 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.314419 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-4gpjs"] Sep 10 12:15:37.404845 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.404824 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-4gpjs"] Sep 10 12:15:37.405024 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:15:37.405007 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ffpqf tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" podUID="d36371a4-c2e9-4736-8c8d-514dacfe481c" Sep 10 12:15:37.441038 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.441014 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d36371a4-c2e9-4736-8c8d-514dacfe481c-tls-cert\") pod \"authorino-6d4dfc649f-4gpjs\" (UID: \"d36371a4-c2e9-4736-8c8d-514dacfe481c\") " pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" Sep 10 12:15:37.441143 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.441073 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffpqf\" (UniqueName: \"kubernetes.io/projected/d36371a4-c2e9-4736-8c8d-514dacfe481c-kube-api-access-ffpqf\") pod \"authorino-6d4dfc649f-4gpjs\" (UID: \"d36371a4-c2e9-4736-8c8d-514dacfe481c\") " pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" Sep 10 12:15:37.445326 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.445305 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6694896d7f-fztjb"] Sep 10 12:15:37.447720 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.447699 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6694896d7f-fztjb" Sep 10 12:15:37.461829 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.461809 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6694896d7f-fztjb"] Sep 10 12:15:37.541486 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.541458 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d36371a4-c2e9-4736-8c8d-514dacfe481c-tls-cert\") pod \"authorino-6d4dfc649f-4gpjs\" (UID: \"d36371a4-c2e9-4736-8c8d-514dacfe481c\") " pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" Sep 10 12:15:37.541615 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.541516 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bprbq\" (UniqueName: \"kubernetes.io/projected/48cd6962-c824-4800-9f6e-16f744f6d4ce-kube-api-access-bprbq\") pod \"authorino-6694896d7f-fztjb\" (UID: \"48cd6962-c824-4800-9f6e-16f744f6d4ce\") " pod="kuadrant-system/authorino-6694896d7f-fztjb" Sep 10 12:15:37.541615 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.541548 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/48cd6962-c824-4800-9f6e-16f744f6d4ce-tls-cert\") pod \"authorino-6694896d7f-fztjb\" (UID: \"48cd6962-c824-4800-9f6e-16f744f6d4ce\") " pod="kuadrant-system/authorino-6694896d7f-fztjb" Sep 10 12:15:37.541615 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.541601 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffpqf\" (UniqueName: \"kubernetes.io/projected/d36371a4-c2e9-4736-8c8d-514dacfe481c-kube-api-access-ffpqf\") pod \"authorino-6d4dfc649f-4gpjs\" (UID: \"d36371a4-c2e9-4736-8c8d-514dacfe481c\") " pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" Sep 10 12:15:37.543973 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.543955 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d36371a4-c2e9-4736-8c8d-514dacfe481c-tls-cert\") pod \"authorino-6d4dfc649f-4gpjs\" (UID: \"d36371a4-c2e9-4736-8c8d-514dacfe481c\") " pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" Sep 10 12:15:37.551182 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.551134 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffpqf\" (UniqueName: \"kubernetes.io/projected/d36371a4-c2e9-4736-8c8d-514dacfe481c-kube-api-access-ffpqf\") pod \"authorino-6d4dfc649f-4gpjs\" (UID: \"d36371a4-c2e9-4736-8c8d-514dacfe481c\") " pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" Sep 10 12:15:37.559522 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.559502 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" Sep 10 12:15:37.565491 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.565474 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" Sep 10 12:15:37.642908 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.642882 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bprbq\" (UniqueName: \"kubernetes.io/projected/48cd6962-c824-4800-9f6e-16f744f6d4ce-kube-api-access-bprbq\") pod \"authorino-6694896d7f-fztjb\" (UID: \"48cd6962-c824-4800-9f6e-16f744f6d4ce\") " pod="kuadrant-system/authorino-6694896d7f-fztjb" Sep 10 12:15:37.643024 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.642920 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/48cd6962-c824-4800-9f6e-16f744f6d4ce-tls-cert\") pod \"authorino-6694896d7f-fztjb\" (UID: \"48cd6962-c824-4800-9f6e-16f744f6d4ce\") " pod="kuadrant-system/authorino-6694896d7f-fztjb" Sep 10 12:15:37.645162 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.645141 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/48cd6962-c824-4800-9f6e-16f744f6d4ce-tls-cert\") pod \"authorino-6694896d7f-fztjb\" (UID: \"48cd6962-c824-4800-9f6e-16f744f6d4ce\") " pod="kuadrant-system/authorino-6694896d7f-fztjb" Sep 10 12:15:37.652166 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.652142 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bprbq\" (UniqueName: \"kubernetes.io/projected/48cd6962-c824-4800-9f6e-16f744f6d4ce-kube-api-access-bprbq\") pod \"authorino-6694896d7f-fztjb\" (UID: \"48cd6962-c824-4800-9f6e-16f744f6d4ce\") " pod="kuadrant-system/authorino-6694896d7f-fztjb" Sep 10 12:15:37.744205 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.744185 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d36371a4-c2e9-4736-8c8d-514dacfe481c-tls-cert\") pod \"d36371a4-c2e9-4736-8c8d-514dacfe481c\" (UID: \"d36371a4-c2e9-4736-8c8d-514dacfe481c\") " Sep 10 12:15:37.744299 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.744223 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffpqf\" (UniqueName: \"kubernetes.io/projected/d36371a4-c2e9-4736-8c8d-514dacfe481c-kube-api-access-ffpqf\") pod \"d36371a4-c2e9-4736-8c8d-514dacfe481c\" (UID: \"d36371a4-c2e9-4736-8c8d-514dacfe481c\") " Sep 10 12:15:37.745959 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.745934 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36371a4-c2e9-4736-8c8d-514dacfe481c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d36371a4-c2e9-4736-8c8d-514dacfe481c" (UID: "d36371a4-c2e9-4736-8c8d-514dacfe481c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:15:37.746136 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.746121 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36371a4-c2e9-4736-8c8d-514dacfe481c-kube-api-access-ffpqf" (OuterVolumeSpecName: "kube-api-access-ffpqf") pod "d36371a4-c2e9-4736-8c8d-514dacfe481c" (UID: "d36371a4-c2e9-4736-8c8d-514dacfe481c"). InnerVolumeSpecName "kube-api-access-ffpqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:15:37.756388 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.756372 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6694896d7f-fztjb" Sep 10 12:15:37.845402 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.845364 2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d36371a4-c2e9-4736-8c8d-514dacfe481c-tls-cert\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:15:37.845402 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:37.845384 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffpqf\" (UniqueName: \"kubernetes.io/projected/d36371a4-c2e9-4736-8c8d-514dacfe481c-kube-api-access-ffpqf\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:15:38.028171 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.028136 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6694896d7f-fztjb"] Sep 10 12:15:38.029434 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:15:38.029407 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48cd6962_c824_4800_9f6e_16f744f6d4ce.slice/crio-0b6f1160caedeb7c85f695fa3db0022eaca87553d4e78d9108b08f3840aaa694 WatchSource:0}: Error finding container 0b6f1160caedeb7c85f695fa3db0022eaca87553d4e78d9108b08f3840aaa694: Status 404 returned error can't find the container with id 0b6f1160caedeb7c85f695fa3db0022eaca87553d4e78d9108b08f3840aaa694 Sep 10 12:15:38.567940 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.567908 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6694896d7f-fztjb" event={"ID":"48cd6962-c824-4800-9f6e-16f744f6d4ce","Type":"ContainerStarted","Data":"b9d2942e4cb3a364370091446e947f529b93e983c7523036bd9d61b30943e215"} Sep 10 12:15:38.568073 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.567955 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6694896d7f-fztjb" event={"ID":"48cd6962-c824-4800-9f6e-16f744f6d4ce","Type":"ContainerStarted","Data":"0b6f1160caedeb7c85f695fa3db0022eaca87553d4e78d9108b08f3840aaa694"} Sep 10 12:15:38.568073 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.567921 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-4gpjs" Sep 10 12:15:38.589854 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.589808 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6694896d7f-fztjb" podStartSLOduration=1.154035381 podStartE2EDuration="1.58979245s" totalImagesPullingTime="435.757069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:38.588138005 +0000 UTC m=+578.424120615" watchObservedRunningTime="2026-09-10 12:15:38.58979245 +0000 UTC m=+578.425775035" Sep 10 12:15:38.627018 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.626948 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-4gpjs"] Sep 10 12:15:38.635054 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.635026 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mh4hc"] Sep 10 12:15:38.635234 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.635196 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-mh4hc" podUID="e38e5ddb-b76a-4053-af2b-7855e58fa84e" containerName="authorino" containerID="cri-o://8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea" gracePeriod=30 Sep 10 12:15:38.638858 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.638835 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-4gpjs"] Sep 10 12:15:38.767943 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.767903 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d36371a4-c2e9-4736-8c8d-514dacfe481c" path="/var/lib/kubelet/pods/d36371a4-c2e9-4736-8c8d-514dacfe481c/volumes" Sep 10 12:15:38.872944 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:38.872920 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mh4hc" Sep 10 12:15:39.056855 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.056776 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d69tt\" (UniqueName: \"kubernetes.io/projected/e38e5ddb-b76a-4053-af2b-7855e58fa84e-kube-api-access-d69tt\") pod \"e38e5ddb-b76a-4053-af2b-7855e58fa84e\" (UID: \"e38e5ddb-b76a-4053-af2b-7855e58fa84e\") " Sep 10 12:15:39.058809 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.058787 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e38e5ddb-b76a-4053-af2b-7855e58fa84e-kube-api-access-d69tt" (OuterVolumeSpecName: "kube-api-access-d69tt") pod "e38e5ddb-b76a-4053-af2b-7855e58fa84e" (UID: "e38e5ddb-b76a-4053-af2b-7855e58fa84e"). InnerVolumeSpecName "kube-api-access-d69tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:15:39.158025 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.157994 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d69tt\" (UniqueName: \"kubernetes.io/projected/e38e5ddb-b76a-4053-af2b-7855e58fa84e-kube-api-access-d69tt\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:15:39.581024 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.580993 2555 generic.go:356] "Generic (PLEG): container finished" podID="e38e5ddb-b76a-4053-af2b-7855e58fa84e" containerID="8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea" exitCode=0 Sep 10 12:15:39.581211 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.581062 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mh4hc" Sep 10 12:15:39.581211 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.581084 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mh4hc" event={"ID":"e38e5ddb-b76a-4053-af2b-7855e58fa84e","Type":"ContainerDied","Data":"8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea"} Sep 10 12:15:39.581211 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.581133 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mh4hc" event={"ID":"e38e5ddb-b76a-4053-af2b-7855e58fa84e","Type":"ContainerDied","Data":"4d8ac66ea644b409bc0bb2c09204b0c3ccf7794412abedef3b93274a26a7bcd8"} Sep 10 12:15:39.581211 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.581158 2555 scope.go:117] "RemoveContainer" containerID="8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea" Sep 10 12:15:39.590264 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.590245 2555 scope.go:117] "RemoveContainer" containerID="8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea" Sep 10 12:15:39.590497 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:15:39.590479 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea\": container with ID starting with 8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea not found: ID does not exist" containerID="8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea" Sep 10 12:15:39.590546 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.590504 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea"} err="failed to get container status \"8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea\": rpc error: code = NotFound desc = could not find container \"8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea\": container with ID starting with 8c3481da22be9bbd1494bbed468e85cfe525becf96e8c72abaa56689e51cadea not found: ID does not exist" Sep 10 12:15:39.605553 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.605530 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mh4hc"] Sep 10 12:15:39.611138 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:39.611120 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mh4hc"] Sep 10 12:15:40.768084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:40.768052 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e38e5ddb-b76a-4053-af2b-7855e58fa84e" path="/var/lib/kubelet/pods/e38e5ddb-b76a-4053-af2b-7855e58fa84e/volumes" Sep 10 12:15:43.676656 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:43.676619 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:43.929176 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:43.929091 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:44.112682 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.112651 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5dcf4d6db-wln7b"] Sep 10 12:15:44.113063 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.113046 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e38e5ddb-b76a-4053-af2b-7855e58fa84e" containerName="authorino" Sep 10 12:15:44.113153 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.113066 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e38e5ddb-b76a-4053-af2b-7855e58fa84e" containerName="authorino" Sep 10 12:15:44.113204 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.113186 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e38e5ddb-b76a-4053-af2b-7855e58fa84e" containerName="authorino" Sep 10 12:15:44.116501 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.116480 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.120549 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.120522 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 10 12:15:44.121834 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.121770 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 10 12:15:44.121947 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.121832 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 10 12:15:44.122188 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.122168 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zzq8x\"" Sep 10 12:15:44.131422 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.131402 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dcf4d6db-wln7b"] Sep 10 12:15:44.194538 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.194476 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-webhook-cert\") pod \"maas-controller-5dcf4d6db-wln7b\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.194538 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.194505 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-metrics-certs\") pod \"maas-controller-5dcf4d6db-wln7b\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.194714 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.194545 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrdh\" (UniqueName: \"kubernetes.io/projected/df8d882b-5b69-4cfb-9edc-339f4d7f5771-kube-api-access-rcrdh\") pod \"maas-controller-5dcf4d6db-wln7b\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.248012 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.247973 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:44.295478 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.295455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-webhook-cert\") pod \"maas-controller-5dcf4d6db-wln7b\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.295597 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.295480 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-metrics-certs\") pod \"maas-controller-5dcf4d6db-wln7b\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.295597 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.295513 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrdh\" (UniqueName: \"kubernetes.io/projected/df8d882b-5b69-4cfb-9edc-339f4d7f5771-kube-api-access-rcrdh\") pod \"maas-controller-5dcf4d6db-wln7b\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.298065 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.298045 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-webhook-cert\") pod \"maas-controller-5dcf4d6db-wln7b\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.298160 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.298139 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-metrics-certs\") pod \"maas-controller-5dcf4d6db-wln7b\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.309220 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.309200 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrdh\" (UniqueName: \"kubernetes.io/projected/df8d882b-5b69-4cfb-9edc-339f4d7f5771-kube-api-access-rcrdh\") pod \"maas-controller-5dcf4d6db-wln7b\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.377331 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.377304 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:44.426435 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.426409 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:44.460694 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.460623 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:44.709078 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:44.709042 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dcf4d6db-wln7b"] Sep 10 12:15:44.709460 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:15:44.709138 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8d882b_5b69_4cfb_9edc_339f4d7f5771.slice/crio-6331001521f9c40d2bb70b2937089df1c609b0d536577587ada02f172015baf4 WatchSource:0}: Error finding container 6331001521f9c40d2bb70b2937089df1c609b0d536577587ada02f172015baf4: Status 404 returned error can't find the container with id 6331001521f9c40d2bb70b2937089df1c609b0d536577587ada02f172015baf4 Sep 10 12:15:45.620899 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:45.620844 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" event={"ID":"df8d882b-5b69-4cfb-9edc-339f4d7f5771","Type":"ContainerStarted","Data":"6331001521f9c40d2bb70b2937089df1c609b0d536577587ada02f172015baf4"} Sep 10 12:15:47.423803 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:47.423715 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:47.561785 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:47.561754 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:47.633930 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:47.633899 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" event={"ID":"df8d882b-5b69-4cfb-9edc-339f4d7f5771","Type":"ContainerStarted","Data":"9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8"} Sep 10 12:15:47.634088 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:47.634021 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:51.651478 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:51.651447 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:58.414292 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.414237 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" podStartSLOduration=11.951294908 podStartE2EDuration="14.414221868s" totalImagesPullingTime="2.46292696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:47.664681208 +0000 UTC m=+587.500663793" watchObservedRunningTime="2026-09-10 12:15:58.414221868 +0000 UTC m=+598.250204454" Sep 10 12:15:58.416582 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.416541 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5dcf4d6db-wln7b"] Sep 10 12:15:58.416799 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.416776 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" podUID="df8d882b-5b69-4cfb-9edc-339f4d7f5771" containerName="manager" containerID="cri-o://9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8" gracePeriod=30 Sep 10 12:15:58.418270 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.418245 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:58.662497 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.662475 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:58.694844 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.694782 2555 generic.go:356] "Generic (PLEG): container finished" podID="df8d882b-5b69-4cfb-9edc-339f4d7f5771" containerID="9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8" exitCode=0 Sep 10 12:15:58.694844 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.694822 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" Sep 10 12:15:58.695005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.694876 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" event={"ID":"df8d882b-5b69-4cfb-9edc-339f4d7f5771","Type":"ContainerDied","Data":"9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8"} Sep 10 12:15:58.695005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.694941 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dcf4d6db-wln7b" event={"ID":"df8d882b-5b69-4cfb-9edc-339f4d7f5771","Type":"ContainerDied","Data":"6331001521f9c40d2bb70b2937089df1c609b0d536577587ada02f172015baf4"} Sep 10 12:15:58.695005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.694972 2555 scope.go:117] "RemoveContainer" containerID="9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8" Sep 10 12:15:58.706088 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.705964 2555 scope.go:117] "RemoveContainer" containerID="9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8" Sep 10 12:15:58.706335 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:15:58.706314 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8\": container with ID starting with 9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8 not found: ID does not exist" containerID="9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8" Sep 10 12:15:58.706400 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.706344 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8"} err="failed to get container status \"9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8\": rpc error: code = NotFound desc = could not find container \"9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8\": container with ID starting with 9b1488228a02a7f4334293b3099c9b2b4b2d615a5beab5c6bc3acd4846538cb8 not found: ID does not exist" Sep 10 12:15:58.722748 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.722724 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-webhook-cert\") pod \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " Sep 10 12:15:58.722843 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.722784 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcrdh\" (UniqueName: \"kubernetes.io/projected/df8d882b-5b69-4cfb-9edc-339f4d7f5771-kube-api-access-rcrdh\") pod \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " Sep 10 12:15:58.722898 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.722840 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-metrics-certs\") pod \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\" (UID: \"df8d882b-5b69-4cfb-9edc-339f4d7f5771\") " Sep 10 12:15:58.724953 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.724925 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "df8d882b-5b69-4cfb-9edc-339f4d7f5771" (UID: "df8d882b-5b69-4cfb-9edc-339f4d7f5771"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:15:58.725053 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.724979 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df8d882b-5b69-4cfb-9edc-339f4d7f5771-kube-api-access-rcrdh" (OuterVolumeSpecName: "kube-api-access-rcrdh") pod "df8d882b-5b69-4cfb-9edc-339f4d7f5771" (UID: "df8d882b-5b69-4cfb-9edc-339f4d7f5771"). InnerVolumeSpecName "kube-api-access-rcrdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:15:58.725053 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.725031 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "df8d882b-5b69-4cfb-9edc-339f4d7f5771" (UID: "df8d882b-5b69-4cfb-9edc-339f4d7f5771"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:15:58.824379 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.824344 2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-webhook-cert\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:15:58.824379 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.824376 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcrdh\" (UniqueName: \"kubernetes.io/projected/df8d882b-5b69-4cfb-9edc-339f4d7f5771-kube-api-access-rcrdh\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:15:58.824597 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:58.824387 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df8d882b-5b69-4cfb-9edc-339f4d7f5771-metrics-certs\") on node \"ip-10-0-128-140.ec2.internal\" DevicePath \"\"" Sep 10 12:15:59.024768 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:59.024689 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5dcf4d6db-wln7b"] Sep 10 12:15:59.027003 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:15:59.026979 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5dcf4d6db-wln7b"] Sep 10 12:16:00.578017 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:00.577990 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/2.log" Sep 10 12:16:00.579517 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:00.579495 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/2.log" Sep 10 12:16:00.768860 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:00.768829 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df8d882b-5b69-4cfb-9edc-339f4d7f5771" path="/var/lib/kubelet/pods/df8d882b-5b69-4cfb-9edc-339f4d7f5771/volumes" Sep 10 12:16:16.962429 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:16.962392 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:17.090385 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:17.090352 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:18.439958 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.439919 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:18.537206 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.537168 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:18.598005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.597971 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7"] Sep 10 12:16:18.598333 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.598321 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df8d882b-5b69-4cfb-9edc-339f4d7f5771" containerName="manager" Sep 10 12:16:18.598379 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.598336 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="df8d882b-5b69-4cfb-9edc-339f4d7f5771" containerName="manager" Sep 10 12:16:18.598421 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.598399 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="df8d882b-5b69-4cfb-9edc-339f4d7f5771" containerName="manager" Sep 10 12:16:18.600631 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.600614 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.603696 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.603675 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 10 12:16:18.604860 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.604830 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 10 12:16:18.604860 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.604857 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 10 12:16:18.605005 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.604839 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 12:16:18.615422 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.615396 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7"] Sep 10 12:16:18.641648 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.641613 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:18.681028 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.680990 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57673729-1daf-4012-b4ef-842409fb23ab-maas-api-tls\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.681192 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.681161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57673729-1daf-4012-b4ef-842409fb23ab-metrics-certs\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.681292 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.681277 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npcmn\" (UniqueName: \"kubernetes.io/projected/57673729-1daf-4012-b4ef-842409fb23ab-kube-api-access-npcmn\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.681340 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.681329 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57673729-1daf-4012-b4ef-842409fb23ab-openshift-service-ca\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.757482 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.757411 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:18.782151 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.782127 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57673729-1daf-4012-b4ef-842409fb23ab-maas-api-tls\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.782256 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.782169 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57673729-1daf-4012-b4ef-842409fb23ab-metrics-certs\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.782256 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.782227 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npcmn\" (UniqueName: \"kubernetes.io/projected/57673729-1daf-4012-b4ef-842409fb23ab-kube-api-access-npcmn\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.782337 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.782269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57673729-1daf-4012-b4ef-842409fb23ab-openshift-service-ca\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.782931 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.782911 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57673729-1daf-4012-b4ef-842409fb23ab-openshift-service-ca\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.784483 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.784464 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57673729-1daf-4012-b4ef-842409fb23ab-metrics-certs\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.784585 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.784553 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57673729-1daf-4012-b4ef-842409fb23ab-maas-api-tls\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.799138 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.799109 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npcmn\" (UniqueName: \"kubernetes.io/projected/57673729-1daf-4012-b4ef-842409fb23ab-kube-api-access-npcmn\") pod \"maas-api-78c4dbb577-vqsr7\" (UID: \"57673729-1daf-4012-b4ef-842409fb23ab\") " pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:18.911238 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:18.911211 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:19.132162 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:19.132122 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:19.192268 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:19.192238 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7"] Sep 10 12:16:19.194087 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:16:19.194060 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57673729_1daf_4012_b4ef_842409fb23ab.slice/crio-9da1eb2762a864572057606d243a2d7f212bba5eded970282948d00f13a5e84c WatchSource:0}: Error finding container 9da1eb2762a864572057606d243a2d7f212bba5eded970282948d00f13a5e84c: Status 404 returned error can't find the container with id 9da1eb2762a864572057606d243a2d7f212bba5eded970282948d00f13a5e84c Sep 10 12:16:19.195330 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:19.195313 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:16:19.231257 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:19.231228 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:19.410848 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:19.410759 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:16:19.813203 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:19.813125 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" event={"ID":"57673729-1daf-4012-b4ef-842409fb23ab","Type":"ContainerStarted","Data":"9da1eb2762a864572057606d243a2d7f212bba5eded970282948d00f13a5e84c"} Sep 10 12:16:21.827442 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:21.827406 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" event={"ID":"57673729-1daf-4012-b4ef-842409fb23ab","Type":"ContainerStarted","Data":"ca71ff4869f393165ba23aa5838f8f2b5d692d69c3df9c4c571b183722a33068"} Sep 10 12:16:21.827835 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:21.827528 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:27.844814 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:27.844786 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" Sep 10 12:16:27.874267 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:27.874207 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-78c4dbb577-vqsr7" podStartSLOduration=7.788948776 podStartE2EDuration="9.874193423s" totalImagesPullingTime="2.085244647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:16:21.858852697 +0000 UTC m=+621.694835284" watchObservedRunningTime="2026-09-10 12:16:27.874193423 +0000 UTC m=+627.710176010" Sep 10 12:16:28.367719 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:28.367688 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9bv78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 10 12:16:28.367883 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:28.367743 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" podUID="b1244b3a-b287-4e2e-a978-018634803eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 10 12:16:28.877077 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:28.877043 2555 generic.go:356] "Generic (PLEG): container finished" podID="b1244b3a-b287-4e2e-a978-018634803eb7" containerID="836255996a4552372238c637a25f24a8b774766f185c57c04a13ed50f1feef55" exitCode=0 Sep 10 12:16:28.877439 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:28.877117 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" event={"ID":"b1244b3a-b287-4e2e-a978-018634803eb7","Type":"ContainerDied","Data":"836255996a4552372238c637a25f24a8b774766f185c57c04a13ed50f1feef55"} Sep 10 12:16:28.877484 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:28.877455 2555 scope.go:117] "RemoveContainer" containerID="836255996a4552372238c637a25f24a8b774766f185c57c04a13ed50f1feef55" Sep 10 12:16:28.878438 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:28.878406 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 12:16:28.878499 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:28.878484 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 12:16:28.878535 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:28.878521 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 12:16:28.983656 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:28.983549 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:29.885110 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:29.885073 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" event={"ID":"b1244b3a-b287-4e2e-a978-018634803eb7","Type":"ContainerStarted","Data":"c2ccc6c8c87da50557eef6e06c475d3f967b8151f1340e3e73a16147891fa9f7"} Sep 10 12:16:30.117712 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:30.117679 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:16:30.117934 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:30.117905 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9bv78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Sep 10 12:16:30.118041 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:30.117972 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" podUID="b1244b3a-b287-4e2e-a978-018634803eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Sep 10 12:16:31.117652 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:31.117616 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9bv78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Sep 10 12:16:31.118038 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:31.117681 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" podUID="b1244b3a-b287-4e2e-a978-018634803eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Sep 10 12:16:31.711740 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:31.711703 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:32.117749 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:32.117715 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9bv78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Sep 10 12:16:32.118201 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:32.117774 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" podUID="b1244b3a-b287-4e2e-a978-018634803eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Sep 10 12:16:33.118475 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:33.118440 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9bv78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Sep 10 12:16:33.119075 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:33.118493 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" podUID="b1244b3a-b287-4e2e-a978-018634803eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Sep 10 12:16:34.118320 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:34.118287 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9bv78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Sep 10 12:16:34.118505 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:34.118339 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" podUID="b1244b3a-b287-4e2e-a978-018634803eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Sep 10 12:16:35.121328 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:35.121297 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:16:35.121793 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:35.121711 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:16:35.122377 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:35.122360 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9bv78" Sep 10 12:16:49.735161 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:49.735122 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:50.240673 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:50.240638 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:16:59.522502 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.522471 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-gs492"] Sep 10 12:16:59.524937 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.524921 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.528248 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.528224 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-82bff\"" Sep 10 12:16:59.528368 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.528266 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 12:16:59.529846 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.529827 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 12:16:59.529846 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.529841 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 10 12:16:59.539069 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.539049 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-gs492"] Sep 10 12:16:59.578124 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.578095 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:59.612728 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.612701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.612822 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.612728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.612822 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.612748 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0a6b8be-1139-4166-af73-5e4cdb545c74-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.612897 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.612823 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr76s\" (UniqueName: \"kubernetes.io/projected/b0a6b8be-1139-4166-af73-5e4cdb545c74-kube-api-access-nr76s\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.612897 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.612855 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.612966 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.612936 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.713810 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.713775 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.713985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.713842 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.713985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.713909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.713985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.713933 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.713985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.713956 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0a6b8be-1139-4166-af73-5e4cdb545c74-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.713985 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.713978 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr76s\" (UniqueName: \"kubernetes.io/projected/b0a6b8be-1139-4166-af73-5e4cdb545c74-kube-api-access-nr76s\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.714240 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.714193 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.714296 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.714253 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.714296 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.714263 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.716432 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.716311 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0a6b8be-1139-4166-af73-5e4cdb545c74-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.717150 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.717124 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0a6b8be-1139-4166-af73-5e4cdb545c74-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.725681 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.725652 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr76s\" (UniqueName: \"kubernetes.io/projected/b0a6b8be-1139-4166-af73-5e4cdb545c74-kube-api-access-nr76s\") pod \"e2e-distinct-simulated-kserve-6685d86975-gs492\" (UID: \"b0a6b8be-1139-4166-af73-5e4cdb545c74\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:16:59.835287 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:16:59.835233 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:00.119138 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:00.119111 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-gs492"] Sep 10 12:17:00.124386 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:17:00.124247 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a6b8be_1139_4166_af73_5e4cdb545c74.slice/crio-51cad4c8402e974be3053d8f54818fb2ee93124efd507df8d1f6038df8a0fa6c WatchSource:0}: Error finding container 51cad4c8402e974be3053d8f54818fb2ee93124efd507df8d1f6038df8a0fa6c: Status 404 returned error can't find the container with id 51cad4c8402e974be3053d8f54818fb2ee93124efd507df8d1f6038df8a0fa6c Sep 10 12:17:00.328664 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:00.328627 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:17:01.068428 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:01.068390 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" event={"ID":"b0a6b8be-1139-4166-af73-5e4cdb545c74","Type":"ContainerStarted","Data":"51cad4c8402e974be3053d8f54818fb2ee93124efd507df8d1f6038df8a0fa6c"} Sep 10 12:17:02.075787 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:02.075755 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0a6b8be-1139-4166-af73-5e4cdb545c74" containerID="b93a9d40fa7b8a23ef04103651bf7c6e24bd612d86037a61ed93e4c08cd93159" exitCode=0 Sep 10 12:17:02.076279 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:02.075797 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" event={"ID":"b0a6b8be-1139-4166-af73-5e4cdb545c74","Type":"ContainerDied","Data":"b93a9d40fa7b8a23ef04103651bf7c6e24bd612d86037a61ed93e4c08cd93159"} Sep 10 12:17:02.076279 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:02.076086 2555 scope.go:117] "RemoveContainer" containerID="b93a9d40fa7b8a23ef04103651bf7c6e24bd612d86037a61ed93e4c08cd93159" Sep 10 12:17:03.083457 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:03.083420 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0a6b8be-1139-4166-af73-5e4cdb545c74" containerID="e4f070aa46c0c9fafac58b83af80ad1298a47965bf79f3e901612842d0ba37ef" exitCode=0 Sep 10 12:17:03.083914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:03.083506 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" event={"ID":"b0a6b8be-1139-4166-af73-5e4cdb545c74","Type":"ContainerDied","Data":"e4f070aa46c0c9fafac58b83af80ad1298a47965bf79f3e901612842d0ba37ef"} Sep 10 12:17:03.083914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:03.083584 2555 scope.go:117] "RemoveContainer" containerID="b93a9d40fa7b8a23ef04103651bf7c6e24bd612d86037a61ed93e4c08cd93159" Sep 10 12:17:03.083914 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:03.083797 2555 scope.go:117] "RemoveContainer" containerID="e4f070aa46c0c9fafac58b83af80ad1298a47965bf79f3e901612842d0ba37ef" Sep 10 12:17:03.084086 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:17:03.083991 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:17:04.091440 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:04.091415 2555 scope.go:117] "RemoveContainer" containerID="e4f070aa46c0c9fafac58b83af80ad1298a47965bf79f3e901612842d0ba37ef" Sep 10 12:17:04.091854 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:17:04.091603 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:17:04.125340 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:04.125314 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:04.953768 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:04.953735 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:17:07.001939 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:07.001901 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:09.836403 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:09.836358 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:09.836823 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:09.836429 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:09.836823 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:09.836447 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:09.836823 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:09.836459 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:09.836926 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:09.836847 2555 scope.go:117] "RemoveContainer" containerID="e4f070aa46c0c9fafac58b83af80ad1298a47965bf79f3e901612842d0ba37ef" Sep 10 12:17:09.837026 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:17:09.837006 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:17:14.959435 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:14.959375 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:15.734373 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:15.734337 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:17:21.761912 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:21.761882 2555 scope.go:117] "RemoveContainer" containerID="e4f070aa46c0c9fafac58b83af80ad1298a47965bf79f3e901612842d0ba37ef" Sep 10 12:17:22.200340 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:22.200306 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0a6b8be-1139-4166-af73-5e4cdb545c74" containerID="e09bf752992c1f3d19f870f0646859de2ff074f49d6a33615fe5005f42f8bf04" exitCode=0 Sep 10 12:17:22.200508 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:22.200377 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" event={"ID":"b0a6b8be-1139-4166-af73-5e4cdb545c74","Type":"ContainerDied","Data":"e09bf752992c1f3d19f870f0646859de2ff074f49d6a33615fe5005f42f8bf04"} Sep 10 12:17:22.200508 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:22.200437 2555 scope.go:117] "RemoveContainer" containerID="e4f070aa46c0c9fafac58b83af80ad1298a47965bf79f3e901612842d0ba37ef" Sep 10 12:17:22.200881 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:22.200866 2555 scope.go:117] "RemoveContainer" containerID="e09bf752992c1f3d19f870f0646859de2ff074f49d6a33615fe5005f42f8bf04" Sep 10 12:17:22.201123 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:17:22.201104 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:17:24.731462 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:24.731421 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:29.835883 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:29.835847 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:29.836286 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:29.835904 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:29.836286 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:29.835921 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:29.836286 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:29.835935 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:29.836286 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:29.836201 2555 scope.go:117] "RemoveContainer" containerID="e09bf752992c1f3d19f870f0646859de2ff074f49d6a33615fe5005f42f8bf04" Sep 10 12:17:29.836423 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:17:29.836363 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:17:34.778425 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:34.778387 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:36.171388 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:36.171355 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:17:43.563083 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:43.563053 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:44.762458 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:44.762421 2555 scope.go:117] "RemoveContainer" containerID="e09bf752992c1f3d19f870f0646859de2ff074f49d6a33615fe5005f42f8bf04" Sep 10 12:17:45.235277 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:45.235245 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:17:45.332083 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:45.332006 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0a6b8be-1139-4166-af73-5e4cdb545c74" containerID="53b4a63f11fedef7810f9939b28ebde9f9bd56ddf81fc40778e67c3d38fbbb74" exitCode=0 Sep 10 12:17:45.332083 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:45.332051 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" event={"ID":"b0a6b8be-1139-4166-af73-5e4cdb545c74","Type":"ContainerDied","Data":"53b4a63f11fedef7810f9939b28ebde9f9bd56ddf81fc40778e67c3d38fbbb74"} Sep 10 12:17:45.332269 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:45.332097 2555 scope.go:117] "RemoveContainer" containerID="e09bf752992c1f3d19f870f0646859de2ff074f49d6a33615fe5005f42f8bf04" Sep 10 12:17:45.332466 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:45.332445 2555 scope.go:117] "RemoveContainer" containerID="53b4a63f11fedef7810f9939b28ebde9f9bd56ddf81fc40778e67c3d38fbbb74" Sep 10 12:17:45.332706 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:17:45.332679 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:17:49.835979 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:49.835945 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:49.836345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:49.836001 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:49.836345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:49.836018 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:49.836345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:49.836031 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:17:49.836345 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:49.836307 2555 scope.go:117] "RemoveContainer" containerID="53b4a63f11fedef7810f9939b28ebde9f9bd56ddf81fc40778e67c3d38fbbb74" Sep 10 12:17:49.836521 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:17:49.836458 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:17:59.246138 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:17:59.245938 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:01.538704 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:01.538664 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8snml"] Sep 10 12:18:01.763869 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:01.763830 2555 scope.go:117] "RemoveContainer" containerID="53b4a63f11fedef7810f9939b28ebde9f9bd56ddf81fc40778e67c3d38fbbb74" Sep 10 12:18:01.764061 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:18:01.764021 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:18:08.907516 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:08.907477 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:16.762685 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:16.762652 2555 scope.go:117] "RemoveContainer" containerID="53b4a63f11fedef7810f9939b28ebde9f9bd56ddf81fc40778e67c3d38fbbb74" Sep 10 12:18:16.763045 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:18:16.762863 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:18:31.762376 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:31.762341 2555 scope.go:117] "RemoveContainer" containerID="53b4a63f11fedef7810f9939b28ebde9f9bd56ddf81fc40778e67c3d38fbbb74" Sep 10 12:18:32.607054 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:32.607021 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0a6b8be-1139-4166-af73-5e4cdb545c74" containerID="bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7" exitCode=0 Sep 10 12:18:32.607227 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:32.607084 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" event={"ID":"b0a6b8be-1139-4166-af73-5e4cdb545c74","Type":"ContainerDied","Data":"bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7"} Sep 10 12:18:32.607227 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:32.607145 2555 scope.go:117] "RemoveContainer" containerID="53b4a63f11fedef7810f9939b28ebde9f9bd56ddf81fc40778e67c3d38fbbb74" Sep 10 12:18:32.607511 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:32.607487 2555 scope.go:117] "RemoveContainer" containerID="bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7" Sep 10 12:18:32.607737 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:18:32.607710 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:18:33.453569 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:33.453533 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:33.567268 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:33.567232 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:39.835964 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:39.835933 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:18:39.836393 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:39.835989 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:18:39.836393 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:39.836008 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:18:39.836393 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:39.836025 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:18:39.836393 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:39.836346 2555 scope.go:117] "RemoveContainer" containerID="bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7" Sep 10 12:18:39.836596 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:18:39.836553 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:18:51.762791 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:18:51.762757 2555 scope.go:117] "RemoveContainer" containerID="bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7" Sep 10 12:18:51.763158 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:18:51.762980 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:19:02.762383 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:02.762351 2555 scope.go:117] "RemoveContainer" containerID="bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7" Sep 10 12:19:02.762842 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:19:02.762515 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:19:13.762700 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:13.762663 2555 scope.go:117] "RemoveContainer" containerID="bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7" Sep 10 12:19:13.763284 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:19:13.762877 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:19:26.762741 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:26.762658 2555 scope.go:117] "RemoveContainer" containerID="bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7" Sep 10 12:19:26.763213 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:19:26.762856 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:19:40.764913 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:40.764881 2555 scope.go:117] "RemoveContainer" containerID="bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7" Sep 10 12:19:40.765479 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:19:40.765101 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:19:55.762454 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:55.762414 2555 scope.go:117] "RemoveContainer" containerID="bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7" Sep 10 12:19:56.067926 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:56.067897 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0a6b8be-1139-4166-af73-5e4cdb545c74" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" exitCode=0 Sep 10 12:19:56.068053 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:56.067972 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" event={"ID":"b0a6b8be-1139-4166-af73-5e4cdb545c74","Type":"ContainerDied","Data":"ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1"} Sep 10 12:19:56.068053 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:56.068044 2555 scope.go:117] "RemoveContainer" containerID="bacce1f13f17ba9ad9be7cdc7e6878ad16abbe9636846203d290f32e8f6cd3c7" Sep 10 12:19:56.068471 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:56.068453 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:19:56.068671 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:19:56.068651 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:19:59.835887 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:59.835849 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:19:59.836264 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:59.835907 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:19:59.836264 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:59.835924 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:19:59.836264 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:59.835937 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" Sep 10 12:19:59.836264 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:19:59.836193 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:19:59.836415 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:19:59.836338 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:20:10.765284 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:20:10.765251 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:20:10.765754 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:20:10.765461 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:20:21.761959 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:20:21.761926 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:20:21.762323 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:20:21.762108 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:20:34.762508 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:20:34.762477 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:20:34.762985 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:20:34.762685 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:20:46.762513 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:20:46.762475 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:20:46.763015 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:20:46.762761 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:21:00.615669 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:00.615599 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/2.log" Sep 10 12:21:00.617445 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:00.617418 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/2.log" Sep 10 12:21:01.762112 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:01.762080 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:21:01.762489 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:21:01.762242 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:21:14.762269 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:14.762239 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:21:14.762903 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:21:14.762394 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:21:29.762002 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:29.761974 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:21:29.764353 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:21:29.762140 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:21:33.744235 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:33.744207 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6694896d7f-fztjb_48cd6962-c824-4800-9f6e-16f744f6d4ce/authorino/0.log" Sep 10 12:21:39.414524 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:39.414484 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7vkl8_d6745cec-de2e-4f98-88ce-e6976a286a39/manager/0.log" Sep 10 12:21:39.534522 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:39.534491 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vpqfx_841029a3-8110-4102-9310-55c7ab8bc762/manager/0.log" Sep 10 12:21:39.943989 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:39.943960 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wwn2v_73c771a1-369c-4909-8cec-4d0fb1c48479/manager/0.log" Sep 10 12:21:40.348165 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:40.348140 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d9854688c-m7p7n_21175ba6-0cf8-48a7-aa77-9db86931a433/manager/0.log" Sep 10 12:21:40.356055 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:40.356033 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d9854688c-m7p7n_21175ba6-0cf8-48a7-aa77-9db86931a433/copy-manifests/0.log" Sep 10 12:21:40.723203 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:40.723103 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-78c4dbb577-vqsr7_57673729-1daf-4012-b4ef-842409fb23ab/maas-api/0.log" Sep 10 12:21:41.674212 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:41.674183 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6694896d7f-fztjb_48cd6962-c824-4800-9f6e-16f744f6d4ce/authorino/0.log" Sep 10 12:21:41.809982 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:41.809958 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-brgjj_626d00d3-fbd9-4775-a661-48d665789d14/manager/0.log" Sep 10 12:21:41.939293 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:41.939226 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-qm5bc_dd855fbb-5fa1-4604-8aea-d641fca7b9cf/manager/0.log" Sep 10 12:21:42.059073 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:42.059047 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-qbk4h_55e8951e-106b-4287-aed8-1c24972668d0/kuadrant-console-plugin/0.log" Sep 10 12:21:42.311425 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:42.311360 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-8snml_57bf3a59-775b-45ff-ba73-37c351091527/limitador/0.log" Sep 10 12:21:42.434842 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:42.434820 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-4mkfg_52ff0c82-6ce2-4e1c-8811-699cfb728c94/manager/0.log" Sep 10 12:21:43.053554 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:43.053471 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64d8784dff-j4dzv_efdba391-c0ba-48a8-96a7-b6fcab1a358c/kube-auth-proxy/0.log" Sep 10 12:21:43.291318 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:43.291291 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9bv78_b1244b3a-b287-4e2e-a978-018634803eb7/istio-proxy/1.log" Sep 10 12:21:43.642486 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:43.642456 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c76cccf54-qpjb6_ac90c9b6-ead8-494f-95b6-8afc5abb5239/router/0.log" Sep 10 12:21:43.762542 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:43.762510 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:21:43.762767 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:21:43.762744 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:21:44.139877 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:44.139850 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-gs492_b0a6b8be-1139-4166-af73-5e4cdb545c74/main/5.log" Sep 10 12:21:50.886269 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:50.886232 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vgmhj/must-gather-mfz5n"] Sep 10 12:21:50.889891 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:50.889868 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vgmhj/must-gather-mfz5n" Sep 10 12:21:50.893118 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:50.893095 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vgmhj\"/\"default-dockercfg-sslq7\"" Sep 10 12:21:50.894110 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:50.894093 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vgmhj\"/\"kube-root-ca.crt\"" Sep 10 12:21:50.894450 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:50.894435 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vgmhj\"/\"openshift-service-ca.crt\"" Sep 10 12:21:50.902405 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:50.902379 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vgmhj/must-gather-mfz5n"] Sep 10 12:21:50.936509 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:50.936486 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:51.003207 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:51.003182 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gptrw\" (UniqueName: \"kubernetes.io/projected/88f0fa02-1c3f-4053-8bf9-2e05c4686ab7-kube-api-access-gptrw\") pod \"must-gather-mfz5n\" (UID: \"88f0fa02-1c3f-4053-8bf9-2e05c4686ab7\") " pod="openshift-must-gather-vgmhj/must-gather-mfz5n" Sep 10 12:21:51.003329 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:51.003314 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/88f0fa02-1c3f-4053-8bf9-2e05c4686ab7-must-gather-output\") pod \"must-gather-mfz5n\" (UID: \"88f0fa02-1c3f-4053-8bf9-2e05c4686ab7\") " pod="openshift-must-gather-vgmhj/must-gather-mfz5n" Sep 10 12:21:51.110877 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:51.105372 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/88f0fa02-1c3f-4053-8bf9-2e05c4686ab7-must-gather-output\") pod \"must-gather-mfz5n\" (UID: \"88f0fa02-1c3f-4053-8bf9-2e05c4686ab7\") " pod="openshift-must-gather-vgmhj/must-gather-mfz5n" Sep 10 12:21:51.110877 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:51.105441 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gptrw\" (UniqueName: \"kubernetes.io/projected/88f0fa02-1c3f-4053-8bf9-2e05c4686ab7-kube-api-access-gptrw\") pod \"must-gather-mfz5n\" (UID: \"88f0fa02-1c3f-4053-8bf9-2e05c4686ab7\") " pod="openshift-must-gather-vgmhj/must-gather-mfz5n" Sep 10 12:21:51.110877 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:51.106130 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/88f0fa02-1c3f-4053-8bf9-2e05c4686ab7-must-gather-output\") pod \"must-gather-mfz5n\" (UID: \"88f0fa02-1c3f-4053-8bf9-2e05c4686ab7\") " pod="openshift-must-gather-vgmhj/must-gather-mfz5n" Sep 10 12:21:51.120554 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:51.120527 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gptrw\" (UniqueName: \"kubernetes.io/projected/88f0fa02-1c3f-4053-8bf9-2e05c4686ab7-kube-api-access-gptrw\") pod \"must-gather-mfz5n\" (UID: \"88f0fa02-1c3f-4053-8bf9-2e05c4686ab7\") " pod="openshift-must-gather-vgmhj/must-gather-mfz5n" Sep 10 12:21:51.199893 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:51.199829 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vgmhj/must-gather-mfz5n" Sep 10 12:21:51.480548 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:51.480518 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vgmhj/must-gather-mfz5n"] Sep 10 12:21:51.482175 ip-10-0-128-140 kubenswrapper[2555]: W0910 12:21:51.482150 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88f0fa02_1c3f_4053_8bf9_2e05c4686ab7.slice/crio-b1c28fd52d0d7debf4a5c030a200416355d142a7cb06c9deb2e0ee09769a42f0 WatchSource:0}: Error finding container b1c28fd52d0d7debf4a5c030a200416355d142a7cb06c9deb2e0ee09769a42f0: Status 404 returned error can't find the container with id b1c28fd52d0d7debf4a5c030a200416355d142a7cb06c9deb2e0ee09769a42f0 Sep 10 12:21:51.484089 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:51.484072 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:21:51.711953 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:51.711919 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgmhj/must-gather-mfz5n" event={"ID":"88f0fa02-1c3f-4053-8bf9-2e05c4686ab7","Type":"ContainerStarted","Data":"b1c28fd52d0d7debf4a5c030a200416355d142a7cb06c9deb2e0ee09769a42f0"} Sep 10 12:21:52.723025 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:52.722921 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgmhj/must-gather-mfz5n" event={"ID":"88f0fa02-1c3f-4053-8bf9-2e05c4686ab7","Type":"ContainerStarted","Data":"75d8a2196f97924e6a4bb8195ad43c362ce584434edb0b2f8ca4ec0d2bd9f104"} Sep 10 12:21:52.723025 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:52.722977 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgmhj/must-gather-mfz5n" event={"ID":"88f0fa02-1c3f-4053-8bf9-2e05c4686ab7","Type":"ContainerStarted","Data":"5ead5db281848f60d05e1fbaa83a51993ea0654b378cfd5e877027da8f577b62"} Sep 10 12:21:52.743437 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:52.743374 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vgmhj/must-gather-mfz5n" podStartSLOduration=1.8608143099999999 podStartE2EDuration="2.743355646s" totalImagesPullingTime="882.541336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:52.742819456 +0000 UTC m=+952.578802042" watchObservedRunningTime="2026-09-10 12:21:52.743355646 +0000 UTC m=+952.579338234" Sep 10 12:21:53.268343 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:53.268300 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:54.010242 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:54.010209 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bj8j2_677825a5-038d-449f-9240-d5c10e329ae8/global-pull-secret-syncer/0.log" Sep 10 12:21:54.072627 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:54.072596 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9tms9_fccf390a-2f70-4c11-81a7-d0c709132636/konnectivity-agent/0.log" Sep 10 12:21:54.164950 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:54.164917 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-140.ec2.internal_b6df7a7611388ae31505ad66be2dace6/haproxy/0.log" Sep 10 12:21:57.579586 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:57.579409 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6694896d7f-fztjb_48cd6962-c824-4800-9f6e-16f744f6d4ce/authorino/0.log" Sep 10 12:21:57.612582 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:57.612230 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-brgjj_626d00d3-fbd9-4775-a661-48d665789d14/manager/0.log" Sep 10 12:21:57.668969 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:57.668930 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-qm5bc_dd855fbb-5fa1-4604-8aea-d641fca7b9cf/manager/0.log" Sep 10 12:21:57.737273 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:57.737241 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-qbk4h_55e8951e-106b-4287-aed8-1c24972668d0/kuadrant-console-plugin/0.log" Sep 10 12:21:57.761949 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:57.761923 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:21:57.762513 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:21:57.762485 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:21:57.830384 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:57.830296 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-8snml_57bf3a59-775b-45ff-ba73-37c351091527/limitador/0.log" Sep 10 12:21:57.867084 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:57.867032 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-4mkfg_52ff0c82-6ce2-4e1c-8811-699cfb728c94/manager/0.log" Sep 10 12:21:59.829376 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:21:59.829348 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-c59nn_b7efda6d-7e77-4bfe-845b-6e766a94b3ba/cluster-monitoring-operator/0.log" Sep 10 12:22:00.034484 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:00.034340 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xprx_6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08/node-exporter/0.log" Sep 10 12:22:00.061826 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:00.061788 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xprx_6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08/kube-rbac-proxy/0.log" Sep 10 12:22:00.097054 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:00.096487 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xprx_6fd8fca1-c0f1-4fff-84ab-71e7abc0bf08/init-textfile/0.log" Sep 10 12:22:00.758303 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:00.758235 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-g4nxc_beba4cf0-3ca7-476d-b6fc-301c0b5d3071/prometheus-operator-admission-webhook/0.log" Sep 10 12:22:03.335544 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:03.335517 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/2.log" Sep 10 12:22:03.340554 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:03.340530 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gqr7z_4ca0350c-c2c0-4510-a165-4924c1b0e626/console-operator/3.log" Sep 10 12:22:03.897481 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:03.897450 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-779965cdd5-z4bdz_aa6657d0-2ed5-4ab5-a7bd-9f2e72de7378/console/0.log" Sep 10 12:22:04.646931 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.646897 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-g8fhn_360d3ff8-fa49-49c1-a64c-cc210ba95119/volume-data-source-validator/0.log" Sep 10 12:22:04.759358 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.759315 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6"] Sep 10 12:22:04.765009 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.764985 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.779528 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.779500 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6"] Sep 10 12:22:04.847654 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.847293 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-proc\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.847654 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.847362 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-podres\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.847654 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.847454 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-lib-modules\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.847654 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.847482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pfp7\" (UniqueName: \"kubernetes.io/projected/5ca4ac2c-81ed-466c-b810-27f19905e202-kube-api-access-5pfp7\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.847654 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.847525 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-sys\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.949811 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.948843 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-sys\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.949811 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.948914 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-proc\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.949811 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.948942 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-podres\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.949811 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.949029 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-lib-modules\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.949811 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.949053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pfp7\" (UniqueName: \"kubernetes.io/projected/5ca4ac2c-81ed-466c-b810-27f19905e202-kube-api-access-5pfp7\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.949811 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.949469 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-sys\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.949811 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.949528 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-proc\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.949811 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.949647 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-podres\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.949811 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.949728 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ca4ac2c-81ed-466c-b810-27f19905e202-lib-modules\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:04.960246 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:04.960208 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pfp7\" (UniqueName: \"kubernetes.io/projected/5ca4ac2c-81ed-466c-b810-27f19905e202-kube-api-access-5pfp7\") pod \"perf-node-gather-daemonset-vwxx6\" (UID: \"5ca4ac2c-81ed-466c-b810-27f19905e202\") " pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:05.080658 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:05.080622 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:05.382836 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:05.382810 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6"] Sep 10 12:22:05.841351 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:05.841311 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" event={"ID":"5ca4ac2c-81ed-466c-b810-27f19905e202","Type":"ContainerStarted","Data":"35d17ba4211f3979b69278602ab6412f1dd6600ac81df394c05ccd702f9637f4"} Sep 10 12:22:05.842173 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:05.842141 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" event={"ID":"5ca4ac2c-81ed-466c-b810-27f19905e202","Type":"ContainerStarted","Data":"dc467d5576436cb92a11ea74a9553bbf76ace1cdab861db11df9f62754a4f9ce"} Sep 10 12:22:05.842314 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:05.842280 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:05.863680 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:05.863626 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" podStartSLOduration=1.8636075509999999 podStartE2EDuration="1.863607551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:22:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:05.860439461 +0000 UTC m=+965.696422048" watchObservedRunningTime="2026-09-10 12:22:05.863607551 +0000 UTC m=+965.699590137" Sep 10 12:22:05.976268 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:05.976241 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f2r2p_06882160-6a41-4d36-af22-75132d2644c1/dns/0.log" Sep 10 12:22:06.016597 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:06.016542 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f2r2p_06882160-6a41-4d36-af22-75132d2644c1/kube-rbac-proxy/0.log" Sep 10 12:22:06.102441 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:06.102359 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8c75j_43c48f08-c122-48e4-8f44-b47250e2fdd5/dns-node-resolver/0.log" Sep 10 12:22:06.725099 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:06.725069 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sqwkr_d733d7a3-21a9-41a1-a4c4-ffbf87537283/node-ca/0.log" Sep 10 12:22:07.799831 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:07.799802 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64d8784dff-j4dzv_efdba391-c0ba-48a8-96a7-b6fcab1a358c/kube-auth-proxy/0.log" Sep 10 12:22:07.853991 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:07.853951 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9bv78_b1244b3a-b287-4e2e-a978-018634803eb7/istio-proxy/1.log" Sep 10 12:22:07.854813 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:07.854760 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9bv78_b1244b3a-b287-4e2e-a978-018634803eb7/istio-proxy/0.log" Sep 10 12:22:07.942808 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:07.942784 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c76cccf54-qpjb6_ac90c9b6-ead8-494f-95b6-8afc5abb5239/router/0.log" Sep 10 12:22:08.637793 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:08.637757 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zxzxj_dc9957b0-fbe5-44df-9fd4-d799df941d86/serve-healthcheck-canary/0.log" Sep 10 12:22:08.762459 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:08.762429 2555 scope.go:117] "RemoveContainer" containerID="ea4343ea69e55353e23b37a5146af962438d0d18b2a58ed8f1c17e66db4492a1" Sep 10 12:22:08.762643 ip-10-0-128-140 kubenswrapper[2555]: E0910 12:22:08.762623 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-gs492_llm(b0a6b8be-1139-4166-af73-5e4cdb545c74)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-gs492" podUID="b0a6b8be-1139-4166-af73-5e4cdb545c74" Sep 10 12:22:09.137933 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:09.137897 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-j4xzv_82e21dee-d039-4ad6-8bee-56da40618432/insights-operator/0.log" Sep 10 12:22:09.138395 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:09.138374 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-j4xzv_82e21dee-d039-4ad6-8bee-56da40618432/insights-operator/1.log" Sep 10 12:22:09.255854 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:09.255823 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k428_2cfb6379-1e32-4997-b643-6ac043560089/kube-rbac-proxy/0.log" Sep 10 12:22:09.277755 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:09.277727 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k428_2cfb6379-1e32-4997-b643-6ac043560089/exporter/0.log" Sep 10 12:22:09.311028 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:09.311000 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k428_2cfb6379-1e32-4997-b643-6ac043560089/extractor/0.log" Sep 10 12:22:11.616913 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:11.616883 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7vkl8_d6745cec-de2e-4f98-88ce-e6976a286a39/manager/0.log" Sep 10 12:22:11.668552 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:11.668521 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vpqfx_841029a3-8110-4102-9310-55c7ab8bc762/manager/0.log" Sep 10 12:22:11.793433 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:11.793399 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wwn2v_73c771a1-369c-4909-8cec-4d0fb1c48479/manager/0.log" Sep 10 12:22:11.860160 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:11.860132 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vgmhj/perf-node-gather-daemonset-vwxx6" Sep 10 12:22:11.972539 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:11.972465 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d9854688c-m7p7n_21175ba6-0cf8-48a7-aa77-9db86931a433/manager/0.log" Sep 10 12:22:11.990085 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:11.990060 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d9854688c-m7p7n_21175ba6-0cf8-48a7-aa77-9db86931a433/copy-manifests/0.log" Sep 10 12:22:13.291446 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:13.291411 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-84jjm_3930088e-03c4-427f-87d1-93ec0b84c4c8/openshift-lws-operator/0.log" Sep 10 12:22:13.582194 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:13.582101 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64d8784dff-j4dzv_efdba391-c0ba-48a8-96a7-b6fcab1a358c/kube-auth-proxy/0.log" Sep 10 12:22:13.618712 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:13.618670 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9bv78_b1244b3a-b287-4e2e-a978-018634803eb7/istio-proxy/1.log" Sep 10 12:22:13.619305 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:13.619271 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9bv78_b1244b3a-b287-4e2e-a978-018634803eb7/istio-proxy/0.log" Sep 10 12:22:13.671341 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:13.671312 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c76cccf54-qpjb6_ac90c9b6-ead8-494f-95b6-8afc5abb5239/router/0.log" Sep 10 12:22:15.042528 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:15.042498 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64d8784dff-j4dzv_efdba391-c0ba-48a8-96a7-b6fcab1a358c/kube-auth-proxy/0.log" Sep 10 12:22:15.077322 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:15.077292 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9bv78_b1244b3a-b287-4e2e-a978-018634803eb7/istio-proxy/1.log" Sep 10 12:22:15.078026 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:15.077933 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9bv78_b1244b3a-b287-4e2e-a978-018634803eb7/istio-proxy/0.log" Sep 10 12:22:15.129761 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:15.129735 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c76cccf54-qpjb6_ac90c9b6-ead8-494f-95b6-8afc5abb5239/router/0.log" Sep 10 12:22:19.504173 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:19.504142 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-w2tt2_d4608600-2ca0-4cb8-a59a-19db4433938e/kube-storage-version-migrator-operator/1.log" Sep 10 12:22:19.505189 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:19.505156 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-w2tt2_d4608600-2ca0-4cb8-a59a-19db4433938e/kube-storage-version-migrator-operator/0.log" Sep 10 12:22:20.985375 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:20.985346 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whvn7_91fb1004-c0e8-4a27-8a30-9cdc9c80a7db/kube-multus-additional-cni-plugins/0.log" Sep 10 12:22:21.013605 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:21.013537 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whvn7_91fb1004-c0e8-4a27-8a30-9cdc9c80a7db/egress-router-binary-copy/0.log" Sep 10 12:22:21.033732 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:21.033693 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whvn7_91fb1004-c0e8-4a27-8a30-9cdc9c80a7db/cni-plugins/0.log" Sep 10 12:22:21.054358 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:21.054330 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whvn7_91fb1004-c0e8-4a27-8a30-9cdc9c80a7db/bond-cni-plugin/0.log" Sep 10 12:22:21.080173 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:21.080150 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whvn7_91fb1004-c0e8-4a27-8a30-9cdc9c80a7db/routeoverride-cni/0.log" Sep 10 12:22:21.101818 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:21.101801 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whvn7_91fb1004-c0e8-4a27-8a30-9cdc9c80a7db/whereabouts-cni-bincopy/0.log" Sep 10 12:22:21.126355 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:21.126335 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-whvn7_91fb1004-c0e8-4a27-8a30-9cdc9c80a7db/whereabouts-cni/0.log" Sep 10 12:22:21.199059 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:21.199036 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-znrvr_79f46949-17e0-4192-8a73-c0a0aaee0f07/kube-multus/0.log" Sep 10 12:22:21.258254 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:21.258192 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mnkdw_7c538f6f-2768-4746-877a-8c7e2cb2ecc2/network-metrics-daemon/0.log" Sep 10 12:22:21.279011 ip-10-0-128-140 kubenswrapper[2555]: I0910 12:22:21.278986 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mnkdw_7c538f6f-2768-4746-877a-8c7e2cb2ecc2/kube-rbac-proxy/0.log"