Jun 14 16:11:18.128404 ip-10-0-138-105 systemd[1]: Starting Kubernetes Kubelet... Jun 14 16:11:18.501172 ip-10-0-138-105 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 16:11:18.501172 ip-10-0-138-105 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 16:11:18.501172 ip-10-0-138-105 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 16:11:18.502205 ip-10-0-138-105 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 16:11:18.502205 ip-10-0-138-105 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 16:11:18.503230 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.503148 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 16:11:18.508122 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508106 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 16:11:18.508122 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508122 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508126 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508140 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508144 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508147 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508151 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508154 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508157 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508159 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508168 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508171 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508174 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508176 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508179 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508182 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508185 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508187 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508190 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508192 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508195 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 16:11:18.508202 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508197 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508201 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508203 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508206 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508208 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508211 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508214 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508217 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508219 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508222 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508224 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508227 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508229 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508232 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508235 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508237 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508241 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508245 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508248 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508251 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 16:11:18.508684 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508254 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508256 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508259 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508262 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508264 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508267 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508269 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508272 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508274 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508277 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508279 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508282 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508284 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508286 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508291 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508294 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508296 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508299 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508302 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 16:11:18.509191 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508305 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508307 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508310 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508313 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508315 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508320 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508324 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508328 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508331 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508333 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508336 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508339 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508342 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508344 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508347 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508350 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508353 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508356 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508358 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 16:11:18.509650 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508361 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508363 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508366 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508369 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508371 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508374 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508377 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508379 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508382 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508385 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508387 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508390 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508392 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508395 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508398 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508400 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508403 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508405 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508407 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.508410 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 16:11:18.510111 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509070 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509076 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509079 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509082 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509085 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509088 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509091 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509109 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509113 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509116 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509119 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509122 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509124 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509127 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509145 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509148 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509151 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509154 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509156 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 16:11:18.510606 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509159 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509162 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509164 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509167 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509170 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509173 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509175 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509178 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509181 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509183 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509186 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509188 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509191 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509193 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509196 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509199 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509201 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509204 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509206 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509209 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 16:11:18.511079 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509211 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509214 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509216 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509219 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509222 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509225 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509228 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509230 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509233 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509235 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509238 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509241 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509244 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509247 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509249 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509252 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509254 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509257 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509259 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509262 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 16:11:18.511577 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509264 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509267 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509269 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509273 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509275 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509277 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509280 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509283 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509285 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509288 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509290 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509293 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509296 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509298 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509301 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509303 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509305 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509311 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509314 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 14 16:11:18.512064 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509317 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509320 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509323 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509325 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509331 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509334 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509337 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509340 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509342 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509345 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509348 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509351 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509354 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509357 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509359 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509362 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509364 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509367 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509370 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 16:11:18.512552 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509372 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509376 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509713 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509718 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509721 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509724 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509726 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509729 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509732 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509734 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509739 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509743 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509746 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509749 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509752 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509756 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509760 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509763 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509766 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 16:11:18.513013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509769 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509771 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509774 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509777 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509780 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509782 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509785 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509787 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509790 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509792 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509795 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509797 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509800 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509802 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509805 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509807 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509810 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509812 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509815 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509832 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 16:11:18.513511 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509835 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509838 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509842 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509845 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509851 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509855 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509857 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509860 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509863 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509866 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509868 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509871 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509873 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509876 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509878 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509881 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509883 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509886 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509889 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509892 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 16:11:18.513997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509894 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509896 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509899 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509902 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509904 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509906 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509909 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509911 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509914 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509916 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509920 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509923 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509926 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509928 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509931 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509933 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509937 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509940 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509944 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 16:11:18.514537 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509946 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509949 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509952 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509954 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509957 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509959 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509962 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509964 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509967 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509969 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509971 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509974 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509977 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509979 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509982 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509984 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509987 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509989 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509992 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509994 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 16:11:18.514997 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509997 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.509999 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510002 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510067 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510077 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510082 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510086 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510090 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510093 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510100 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510105 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510108 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510112 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510116 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510120 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510123 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510126 2575 flags.go:64] FLAG: --cgroup-root="" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510129 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510146 2575 flags.go:64] FLAG: --client-ca-file="" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510149 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510152 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510156 2575 flags.go:64] FLAG: --cluster-domain="" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510159 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 16:11:18.515503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510162 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510166 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510169 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510173 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510175 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510179 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510182 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510185 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510188 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510191 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510194 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510197 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510201 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510204 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510207 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510210 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510213 2575 flags.go:64] FLAG: --enable-server="true" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510216 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510221 2575 flags.go:64] FLAG: --event-burst="100" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510224 2575 flags.go:64] FLAG: --event-qps="50" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510228 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510231 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510234 2575 flags.go:64] FLAG: --eviction-hard="" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510238 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 16:11:18.516084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510241 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510244 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510247 2575 flags.go:64] FLAG: --eviction-soft="" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510250 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510252 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510255 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510258 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510261 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510264 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510266 2575 flags.go:64] FLAG: --feature-gates="" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510270 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510273 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510276 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510279 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510282 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510285 2575 flags.go:64] FLAG: --help="false" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510288 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510291 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510294 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510297 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510300 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510303 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510306 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 16:11:18.516679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510308 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510311 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510314 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510319 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510322 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510325 2575 flags.go:64] FLAG: --kube-reserved="" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510328 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510331 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510334 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510337 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510340 2575 flags.go:64] FLAG: --lock-file="" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510343 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510346 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510349 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510354 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510357 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510359 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510362 2575 flags.go:64] FLAG: --logging-format="text" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510365 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510369 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510372 2575 flags.go:64] FLAG: --manifest-url="" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510374 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510379 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510382 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510386 2575 flags.go:64] FLAG: --max-pods="110" Jun 14 16:11:18.517408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510388 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510392 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510394 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510397 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510400 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510403 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510406 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510428 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510431 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510434 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510438 2575 flags.go:64] FLAG: --pod-cidr="" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510441 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510447 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510449 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510453 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510456 2575 flags.go:64] FLAG: --port="10250" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510459 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510462 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04d1e43f47c601553" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510465 2575 flags.go:64] FLAG: --qos-reserved="" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510468 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510471 2575 flags.go:64] FLAG: --register-node="true" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510474 2575 flags.go:64] FLAG: --register-with-taints="" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510485 2575 flags.go:64] FLAG: --registry-burst="10" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510488 2575 flags.go:64] FLAG: --registry-qps="5" Jun 14 16:11:18.518235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510491 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510494 2575 flags.go:64] FLAG: --reserved-memory="" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510497 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510500 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510503 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510506 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510509 2575 flags.go:64] FLAG: --runonce="false" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510511 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510514 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510517 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510520 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510523 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510526 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510529 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510532 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510534 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510537 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510540 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510544 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510547 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510550 2575 flags.go:64] FLAG: --system-cgroups="" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510553 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510558 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510561 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510563 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 16:11:18.518870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510568 2575 flags.go:64] FLAG: --tls-min-version="" Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510570 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510573 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510576 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510579 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510581 2575 flags.go:64] FLAG: --v="2" Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510585 2575 flags.go:64] FLAG: --version="false" Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510589 2575 flags.go:64] FLAG: --vmodule="" Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510592 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.510595 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510705 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510709 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510712 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510715 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510718 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510720 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510723 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510726 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510729 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510732 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510735 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510737 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 16:11:18.519522 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510740 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510744 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510747 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510752 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510757 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510760 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510763 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510765 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510768 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510770 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510773 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510776 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510778 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510781 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510784 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510786 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510789 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510791 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510794 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510796 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 16:11:18.520094 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510799 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510801 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510803 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510808 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510811 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510815 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510818 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510821 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510823 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510827 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510830 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510832 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510835 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510838 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510840 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510844 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510848 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510850 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510853 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 16:11:18.520654 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510855 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510858 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510860 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510863 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510865 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510868 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510871 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510873 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510876 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510878 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510881 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510884 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510886 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510889 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510891 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510894 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510896 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510899 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510901 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510903 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 16:11:18.521113 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510906 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510908 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510911 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510913 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510916 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510918 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510920 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510923 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510926 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510930 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510933 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510935 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510939 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510942 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510945 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510949 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510952 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510954 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510958 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510960 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 16:11:18.521621 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510963 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510966 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510968 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510970 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510973 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510975 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510978 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.510980 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.511624 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.519404 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.519419 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.519445 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.519451 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519515 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519520 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 16:11:18.522099 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519523 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519527 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519530 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519533 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519535 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519538 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519541 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519544 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519546 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519549 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519551 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519554 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519557 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519559 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519562 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519564 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519567 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519569 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519572 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519575 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 16:11:18.522499 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519578 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519581 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519583 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519585 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519588 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519591 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519593 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519596 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519599 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519602 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519604 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519607 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519609 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519612 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519614 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519617 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519620 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519622 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519625 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519628 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 16:11:18.522985 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519632 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519635 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519637 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519640 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519643 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519646 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519648 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519651 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519653 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519656 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519659 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519661 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519664 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519666 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519669 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519671 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519674 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519677 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519679 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519682 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 16:11:18.523489 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519685 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519688 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519691 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519693 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519696 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519698 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519701 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519703 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519708 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519711 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519714 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519716 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519719 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519722 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519724 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519727 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519730 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519734 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519738 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 16:11:18.523961 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519741 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519744 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519747 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519750 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519753 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519755 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519758 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519761 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519764 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519766 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519769 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519772 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519776 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519778 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519781 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519784 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519786 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 16:11:18.524435 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519789 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.519794 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519921 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519926 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519929 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519932 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519935 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519937 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519940 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519943 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519945 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519948 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519951 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519954 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519958 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 16:11:18.524862 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519960 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519963 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519965 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519968 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519972 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519975 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519977 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519980 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519982 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519985 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519987 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519990 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519993 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519996 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.519999 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520001 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520004 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520006 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520009 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 16:11:18.525249 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520011 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520014 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520017 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520019 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520021 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520024 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520026 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520029 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520031 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520034 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520037 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520039 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520041 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520044 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520047 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520049 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520052 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520054 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520057 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520059 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 16:11:18.525708 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520062 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520064 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520067 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520069 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520072 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520075 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520078 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520080 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520083 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520086 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520088 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520091 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520094 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520096 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520099 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520101 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520104 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520108 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520111 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520114 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 16:11:18.526214 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520117 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520120 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520123 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520126 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520128 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520148 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520153 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520156 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520159 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520161 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520164 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520168 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520171 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520174 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520176 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520179 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520182 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520185 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520188 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 16:11:18.526701 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520191 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520194 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520196 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520199 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520201 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520204 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520206 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:18.520209 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.520213 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.520309 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.522363 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.523832 2575 server.go:1019] "Starting client certificate rotation" Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.523931 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 16:11:18.527182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.523967 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 16:11:18.527505 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.526445 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 16:11:18.527687 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.527657 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 16:11:18.539163 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.539149 2575 log.go:25] "Validated CRI v1 runtime API" Jun 14 16:11:18.543410 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.543395 2575 log.go:25] "Validated CRI v1 image API" Jun 14 16:11:18.544371 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.544352 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 16:11:18.548630 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.548608 2575 fs.go:135] Filesystem UUIDs: map[60620751-e2d6-40c8-8396-585e8e30c54d:/dev/nvme0n1p4 6f8fffab-98e3-42e3-aede-01a41613ae2d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 14 16:11:18.548686 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.548631 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 16:11:18.555664 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.555550 2575 manager.go:216] Machine: {Timestamp:2026-06-14 16:11:18.554381481 +0000 UTC m=+0.318160591 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100793 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eb5f4c8c5de622556dfa229bb5d56 SystemUUID:ec2eb5f4-c8c5-de62-2556-dfa229bb5d56 BootID:34485bae-ac12-4ddc-aef0-b86be36f34bd Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:10:76:ef:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:10:76:ef:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:7b:81:65:52:9a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 16:11:18.555664 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.555653 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 16:11:18.555796 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.555728 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 16:11:18.558647 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.558620 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 16:11:18.558781 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.558650 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 16:11:18.559876 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.559864 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 16:11:18.559908 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.559880 2575 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 16:11:18.559908 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.559888 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 16:11:18.560520 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.560509 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 16:11:18.561861 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.561852 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 16:11:18.564918 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.564908 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 14 16:11:18.565032 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.565023 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 16:11:18.565352 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.565344 2575 kubelet.go:486] "Attempting to sync node with API server" Jun 14 16:11:18.565388 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.565357 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 16:11:18.565388 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.565367 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 16:11:18.565388 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.565377 2575 kubelet.go:398] "Adding apiserver pod source" Jun 14 16:11:18.565388 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.565386 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 16:11:18.565764 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.565751 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 16:11:18.565814 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.565777 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 16:11:18.567720 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.567703 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 16:11:18.567936 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.567908 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 16:11:18.569874 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.569858 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 16:11:18.569960 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.569897 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 16:11:18.570619 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570603 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 16:11:18.570687 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570629 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 16:11:18.570687 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570640 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 16:11:18.570687 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570651 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 16:11:18.570687 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570667 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 16:11:18.570687 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570675 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 16:11:18.570687 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570684 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 16:11:18.570687 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570689 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 16:11:18.570868 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570696 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 16:11:18.570868 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570703 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 16:11:18.570868 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570712 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 16:11:18.570868 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570717 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 16:11:18.570868 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570753 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 16:11:18.570868 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.570761 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 16:11:18.573927 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.573913 2575 server.go:1268] "Started kubelet" Jun 14 16:11:18.574081 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.573997 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 16:11:18.574154 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.574129 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 16:11:18.574471 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.574020 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 16:11:18.574892 ip-10-0-138-105 systemd[1]: Started Kubernetes Kubelet. Jun 14 16:11:18.576016 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.575957 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 16:11:18.576574 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.576560 2575 server.go:310] "Adding debug handlers to kubelet server" Jun 14 16:11:18.577289 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.577253 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 16:11:18.577385 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.577336 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 16:11:18.577385 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.577363 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 16:11:18.580450 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.580413 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 16:11:18.580543 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.580440 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 16:11:18.580696 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.580673 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:18.580886 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.580862 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 16:11:18.581171 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.581122 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 16:11:18.581171 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.581152 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 16:11:18.581296 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.581228 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 16:11:18.581516 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.581502 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 14 16:11:18.581516 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.581513 2575 reconciler.go:29] "Reconciler: start to sync state" Jun 14 16:11:18.581739 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.581725 2575 factory.go:55] Registering systemd factory Jun 14 16:11:18.581816 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.581746 2575 factory.go:223] Registration of the systemd container factory successfully Jun 14 16:11:18.582023 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.581995 2575 factory.go:153] Registering CRI-O factory Jun 14 16:11:18.582023 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.582014 2575 factory.go:223] Registration of the crio container factory successfully Jun 14 16:11:18.582175 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.581104 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-105.ec2.internal.18b8fe800e47c0d9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-105.ec2.internal,UID:ip-10-0-138-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-105.ec2.internal,},FirstTimestamp:2026-06-14 16:11:18.573883609 +0000 UTC m=+0.337662715,LastTimestamp:2026-06-14 16:11:18.573883609 +0000 UTC m=+0.337662715,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-105.ec2.internal,}" Jun 14 16:11:18.582175 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.582062 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 16:11:18.582175 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.582086 2575 factory.go:103] Registering Raw factory Jun 14 16:11:18.582175 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.582100 2575 manager.go:1196] Started watching for new ooms in manager Jun 14 16:11:18.582997 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.582980 2575 manager.go:349] Starting recovery of all containers Jun 14 16:11:18.587202 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.586985 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 16:11:18.587202 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.587152 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 16:11:18.593773 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.593759 2575 manager.go:354] Recovery completed Jun 14 16:11:18.595488 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.595470 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7rxq" Jun 14 16:11:18.597863 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.597851 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 16:11:18.599714 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.599697 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jun 14 16:11:18.599791 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.599723 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 16:11:18.599791 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.599733 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jun 14 16:11:18.600278 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.600262 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 16:11:18.600365 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.600263 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 16:11:18.600365 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.600294 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 16:11:18.600365 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.600310 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 14 16:11:18.600952 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.600937 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jun 14 16:11:18.601001 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.600965 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 16:11:18.601001 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.600975 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jun 14 16:11:18.601393 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.601380 2575 policy_none.go:49] "None policy: Start" Jun 14 16:11:18.601451 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.601399 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 16:11:18.601451 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.601413 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 16:11:18.601766 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.601703 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-105.ec2.internal.18b8fe800fd1dc0b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-105.ec2.internal,UID:ip-10-0-138-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-105.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-105.ec2.internal,},FirstTimestamp:2026-06-14 16:11:18.599711755 +0000 UTC m=+0.363490846,LastTimestamp:2026-06-14 16:11:18.599711755 +0000 UTC m=+0.363490846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-105.ec2.internal,}" Jun 14 16:11:18.602390 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.602295 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7rxq" Jun 14 16:11:18.603259 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.603245 2575 policy_none.go:47] "Start" Jun 14 16:11:18.642017 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.641995 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.642787 2575 manager.go:337] "Starting Device Plugin manager" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.642823 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.642836 2575 server.go:87] "Starting device plugin registration server" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.643112 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.643127 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.643309 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.643389 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.643434 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.643441 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.643451 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.643459 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.643501 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.643887 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.643935 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:18.646875 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.645734 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 16:11:18.744296 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.744273 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 16:11:18.744383 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.744269 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal"] Jun 14 16:11:18.744451 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.744432 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 16:11:18.745265 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.745250 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jun 14 16:11:18.745353 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.745282 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 16:11:18.745353 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.745299 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jun 14 16:11:18.745353 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.745326 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.746017 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.745999 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jun 14 16:11:18.746096 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.746030 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 16:11:18.746096 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.746043 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jun 14 16:11:18.747261 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.747249 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 16:11:18.747374 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.747357 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.747431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.747401 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 16:11:18.747896 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.747879 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jun 14 16:11:18.747963 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.747916 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 16:11:18.747963 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.747927 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jun 14 16:11:18.748029 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.747880 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jun 14 16:11:18.748029 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.747994 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 16:11:18.748029 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.748012 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jun 14 16:11:18.749065 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.749052 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.749109 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.749076 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 16:11:18.749684 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.749666 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jun 14 16:11:18.749684 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.749689 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 16:11:18.749824 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.749699 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jun 14 16:11:18.753332 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.753318 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.753409 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.753341 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-105.ec2.internal\": node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:18.770415 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.770400 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:18.775668 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.775653 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-105.ec2.internal\" not found" node="ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.779938 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.779923 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-105.ec2.internal\" not found" node="ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.782652 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.782636 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d8c88ad5edfec2dac26fd7fc76a13cf-config\") pod \"kube-apiserver-proxy-ip-10-0-138-105.ec2.internal\" (UID: \"9d8c88ad5edfec2dac26fd7fc76a13cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.782700 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.782662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e3a4f18987a9b25d856030bb6e77af4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"5e3a4f18987a9b25d856030bb6e77af4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.782700 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.782679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e3a4f18987a9b25d856030bb6e77af4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"5e3a4f18987a9b25d856030bb6e77af4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.870568 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.870546 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:18.882852 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.882833 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d8c88ad5edfec2dac26fd7fc76a13cf-config\") pod \"kube-apiserver-proxy-ip-10-0-138-105.ec2.internal\" (UID: \"9d8c88ad5edfec2dac26fd7fc76a13cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.882908 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.882859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e3a4f18987a9b25d856030bb6e77af4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"5e3a4f18987a9b25d856030bb6e77af4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.882908 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.882875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e3a4f18987a9b25d856030bb6e77af4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"5e3a4f18987a9b25d856030bb6e77af4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.882970 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.882918 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e3a4f18987a9b25d856030bb6e77af4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"5e3a4f18987a9b25d856030bb6e77af4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.882970 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.882929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d8c88ad5edfec2dac26fd7fc76a13cf-config\") pod \"kube-apiserver-proxy-ip-10-0-138-105.ec2.internal\" (UID: \"9d8c88ad5edfec2dac26fd7fc76a13cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.882970 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:18.882942 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e3a4f18987a9b25d856030bb6e77af4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"5e3a4f18987a9b25d856030bb6e77af4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jun 14 16:11:18.971477 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:18.971453 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:19.072215 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:19.072122 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:19.078291 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.078273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jun 14 16:11:19.082789 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.082769 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jun 14 16:11:19.172240 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:19.172208 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:19.272782 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:19.272745 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:19.373303 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:19.373234 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:19.473965 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:19.473940 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:19.523498 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.523463 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 16:11:19.524173 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.523624 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 16:11:19.575005 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:19.574978 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jun 14 16:11:19.606050 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.606014 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 16:06:18 +0000 UTC" deadline="2027-11-12 09:10:39.749813925 +0000 UTC" Jun 14 16:11:19.606050 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.606041 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12376h59m20.143775767s" Jun 14 16:11:19.637615 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:19.637587 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3a4f18987a9b25d856030bb6e77af4.slice/crio-ec73c5bfa26d1f5c3db343bdc4e7f9481e5b2a242f7c1284e416cd8de4e5d11e WatchSource:0}: Error finding container ec73c5bfa26d1f5c3db343bdc4e7f9481e5b2a242f7c1284e416cd8de4e5d11e: Status 404 returned error can't find the container with id ec73c5bfa26d1f5c3db343bdc4e7f9481e5b2a242f7c1284e416cd8de4e5d11e Jun 14 16:11:19.637832 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:19.637811 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8c88ad5edfec2dac26fd7fc76a13cf.slice/crio-129ec2152b925da63052c4b952103a241d2f8b13440c39c1510caf22910f7ddc WatchSource:0}: Error finding container 129ec2152b925da63052c4b952103a241d2f8b13440c39c1510caf22910f7ddc: Status 404 returned error can't find the container with id 129ec2152b925da63052c4b952103a241d2f8b13440c39c1510caf22910f7ddc Jun 14 16:11:19.644269 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.644249 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 16:11:19.646167 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.646107 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" event={"ID":"5e3a4f18987a9b25d856030bb6e77af4","Type":"ContainerStarted","Data":"ec73c5bfa26d1f5c3db343bdc4e7f9481e5b2a242f7c1284e416cd8de4e5d11e"} Jun 14 16:11:19.647090 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.647059 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 16:11:19.647181 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.647106 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" event={"ID":"9d8c88ad5edfec2dac26fd7fc76a13cf","Type":"ContainerStarted","Data":"129ec2152b925da63052c4b952103a241d2f8b13440c39c1510caf22910f7ddc"} Jun 14 16:11:19.682679 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.682663 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jun 14 16:11:19.690268 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.690247 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 16:11:19.692015 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.692001 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jun 14 16:11:19.701957 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.701941 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 16:11:19.959838 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:19.959761 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 16:11:20.103365 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.103332 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 16:11:20.537494 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.537468 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 16:11:20.566019 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.565993 2575 apiserver.go:52] "Watching apiserver" Jun 14 16:11:20.572465 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.572443 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 16:11:20.572881 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.572860 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-dbr5w","openshift-network-operator/iptables-alerter-qbl7w","kube-system/global-pull-secret-syncer-28jlf","kube-system/konnectivity-agent-x8dgj","kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal","openshift-dns/node-resolver-tjnmg","openshift-multus/multus-additional-cni-plugins-2rxrc","openshift-ovn-kubernetes/ovnkube-node-pjbzj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv","openshift-cluster-node-tuning-operator/tuned-9wtsg","openshift-image-registry/node-ca-q82zg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal","openshift-multus/multus-cpmjd","openshift-multus/network-metrics-daemon-kzd85"] Jun 14 16:11:20.574294 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.574273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.575357 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.575303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.576327 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.576306 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 16:11:20.576571 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.576552 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 16:11:20.576662 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.576585 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 16:11:20.576662 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.576605 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ncjqj\"" Jun 14 16:11:20.576779 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.576585 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 16:11:20.576779 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.576702 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 16:11:20.576938 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.576919 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:20.577017 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.576990 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:20.577571 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.577549 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 16:11:20.577678 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.577601 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 16:11:20.577839 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.577817 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tvkd7\"" Jun 14 16:11:20.578306 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.578288 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:20.581086 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.580172 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4k4jw\"" Jun 14 16:11:20.581086 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.580455 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 16:11:20.581086 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.580660 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 16:11:20.581086 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.580926 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 16:11:20.581894 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.581872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.582837 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.582820 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.584662 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.584306 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.584662 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.584339 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 16:11:20.584662 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.584309 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 16:11:20.584662 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.584647 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 16:11:20.584662 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.584650 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 16:11:20.584939 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.584888 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 16:11:20.584999 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.584942 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m44wd\"" Jun 14 16:11:20.584999 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.584982 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fz6b5\"" Jun 14 16:11:20.585087 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.585049 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 16:11:20.585564 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.585300 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 16:11:20.585564 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.585331 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 16:11:20.586283 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.586252 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 16:11:20.586283 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.586242 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 16:11:20.586574 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.586559 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:20.586648 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.586618 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:20.586757 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.586737 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 16:11:20.586853 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.586826 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bcrml\"" Jun 14 16:11:20.587967 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.587904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.589414 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.589395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.589652 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.589634 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 16:11:20.589746 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.589723 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qfbb7\"" Jun 14 16:11:20.591102 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.591078 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:20.591335 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.591316 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mnnb6\"" Jun 14 16:11:20.591730 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.591605 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 16:11:20.591730 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.591633 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 16:11:20.591730 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.591662 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 16:11:20.592011 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.591993 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:20.592069 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.592052 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:20.592463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-node-log\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.592463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64597af5-39c6-4da0-87e1-7bcb067ede1f-hosts-file\") pod \"node-resolver-tjnmg\" (UID: \"64597af5-39c6-4da0-87e1-7bcb067ede1f\") " pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.592463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.592463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cb2f507-666f-4258-b490-139f61fa335e-etc-tuned\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.592463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592431 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8ppx\" (UniqueName: \"kubernetes.io/projected/64597af5-39c6-4da0-87e1-7bcb067ede1f-kube-api-access-p8ppx\") pod \"node-resolver-tjnmg\" (UID: \"64597af5-39c6-4da0-87e1-7bcb067ede1f\") " pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.592463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592453 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-run-ovn\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592493 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-cni-bin\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee27d852-135d-428e-b595-3088ddbf944b-ovnkube-config\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592546 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-cnibin\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-os-release\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-systemd\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-var-lib-kubelet\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee27d852-135d-428e-b595-3088ddbf944b-ovn-node-metrics-cert\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jvrq\" (UniqueName: \"kubernetes.io/projected/ee27d852-135d-428e-b595-3088ddbf944b-kube-api-access-7jvrq\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592717 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-kubelet\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592772 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-var-lib-openvswitch\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-log-socket\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.592867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592858 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee27d852-135d-428e-b595-3088ddbf944b-env-overrides\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-systemd-units\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592886 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-cni-netd\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.592947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-etc-openvswitch\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593012 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee27d852-135d-428e-b595-3088ddbf944b-ovnkube-script-lib\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d55727f0-c2f2-4f11-a204-e8138466d477-cni-binary-copy\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d55727f0-c2f2-4f11-a204-e8138466d477-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-modprobe-d\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-sysconfig\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-run\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd99c833-5d8a-4c0f-b177-16e44ec4c5e4-konnectivity-ca\") pod \"konnectivity-agent-x8dgj\" (UID: \"cd99c833-5d8a-4c0f-b177-16e44ec4c5e4\") " pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593227 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593239 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593248 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-run-systemd\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-run-openvswitch\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593310 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wkwh5\"" Jun 14 16:11:20.593533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64597af5-39c6-4da0-87e1-7bcb067ede1f-tmp-dir\") pod \"node-resolver-tjnmg\" (UID: \"64597af5-39c6-4da0-87e1-7bcb067ede1f\") " pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593369 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d55727f0-c2f2-4f11-a204-e8138466d477-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb5gm\" (UniqueName: \"kubernetes.io/projected/d55727f0-c2f2-4f11-a204-e8138466d477-kube-api-access-vb5gm\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593434 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-sysctl-d\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-run-netns\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-sysctl-conf\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593550 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-sys\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-host\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593593 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd99c833-5d8a-4c0f-b177-16e44ec4c5e4-agent-certs\") pod \"konnectivity-agent-x8dgj\" (UID: \"cd99c833-5d8a-4c0f-b177-16e44ec4c5e4\") " pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593618 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-system-cni-dir\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-kubernetes\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-lib-modules\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593731 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cb2f507-666f-4258-b490-139f61fa335e-tmp\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkbhc\" (UniqueName: \"kubernetes.io/projected/4cb2f507-666f-4258-b490-139f61fa335e-kube-api-access-rkbhc\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:20.594322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593825 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdgkq\" (UniqueName: \"kubernetes.io/projected/3541cb76-3850-4307-95a7-ad4356fb71f1-kube-api-access-hdgkq\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:20.594946 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.593847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-slash\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.616349 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.616330 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gj52c" Jun 14 16:11:20.624543 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.624526 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gj52c" Jun 14 16:11:20.682693 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.682668 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 16:11:20.694646 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694618 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkbhc\" (UniqueName: \"kubernetes.io/projected/4cb2f507-666f-4258-b490-139f61fa335e-kube-api-access-rkbhc\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.694758 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694654 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8ppx\" (UniqueName: \"kubernetes.io/projected/64597af5-39c6-4da0-87e1-7bcb067ede1f-kube-api-access-p8ppx\") pod \"node-resolver-tjnmg\" (UID: \"64597af5-39c6-4da0-87e1-7bcb067ede1f\") " pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.694758 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-cnibin\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.694758 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-var-lib-kubelet\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.694758 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jvrq\" (UniqueName: \"kubernetes.io/projected/ee27d852-135d-428e-b595-3088ddbf944b-kube-api-access-7jvrq\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.694758 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-system-cni-dir\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.695025 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694770 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-hostroot\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.695025 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-cni-netd\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.695025 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694855 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-cnibin\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.695025 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694863 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-var-lib-kubelet\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.695025 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694921 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-cni-netd\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.695025 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.694964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:20.695025 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695035 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-etc-openvswitch\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d55727f0-c2f2-4f11-a204-e8138466d477-cni-binary-copy\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695090 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-etc-openvswitch\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695109 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d55727f0-c2f2-4f11-a204-e8138466d477-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.695155 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695160 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-run\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79eecdfa-bf81-4295-9a47-4089823923f9-host\") pod \"node-ca-q82zg\" (UID: \"79eecdfa-bf81-4295-9a47-4089823923f9\") " pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.695232 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs podName:3541cb76-3850-4307-95a7-ad4356fb71f1 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:21.195210565 +0000 UTC m=+2.958989657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs") pod "network-metrics-daemon-kzd85" (UID: "3541cb76-3850-4307-95a7-ad4356fb71f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-run-multus-certs\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695290 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd99c833-5d8a-4c0f-b177-16e44ec4c5e4-konnectivity-ca\") pod \"konnectivity-agent-x8dgj\" (UID: \"cd99c833-5d8a-4c0f-b177-16e44ec4c5e4\") " pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:20.695330 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-sysctl-d\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-sysctl-conf\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695364 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-sys\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695431 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-multus-socket-dir-parent\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695456 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-var-lib-cni-bin\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-var-lib-kubelet\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-run-netns\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695534 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-host\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-socket-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-var-lib-cni-multus\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695631 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-multus-conf-dir\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd99c833-5d8a-4c0f-b177-16e44ec4c5e4-agent-certs\") pod \"konnectivity-agent-x8dgj\" (UID: \"cd99c833-5d8a-4c0f-b177-16e44ec4c5e4\") " pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-system-cni-dir\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-kubernetes\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-lib-modules\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.695830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695748 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d55727f0-c2f2-4f11-a204-e8138466d477-cni-binary-copy\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cb2f507-666f-4258-b490-139f61fa335e-tmp\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-device-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695791 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d55727f0-c2f2-4f11-a204-e8138466d477-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695155 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695807 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-run-k8s-cni-cncf-io\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695882 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-run-netns\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695945 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-slash\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-node-log\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64597af5-39c6-4da0-87e1-7bcb067ede1f-hosts-file\") pod \"node-resolver-tjnmg\" (UID: \"64597af5-39c6-4da0-87e1-7bcb067ede1f\") " pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696009 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-sysctl-d\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696010 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-lib-modules\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.695908 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-host\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696023 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696051 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-kubernetes\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cb2f507-666f-4258-b490-139f61fa335e-etc-tuned\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.696644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696112 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-run\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696123 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-run-netns\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696126 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-sysctl-conf\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696175 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-sys\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79eecdfa-bf81-4295-9a47-4089823923f9-serviceca\") pod \"node-ca-q82zg\" (UID: \"79eecdfa-bf81-4295-9a47-4089823923f9\") " pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696238 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqnpq\" (UniqueName: \"kubernetes.io/projected/066ee268-854c-4e75-9a3f-46791967ef38-kube-api-access-kqnpq\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696248 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696299 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-node-log\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696321 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-slash\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696344 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-run-ovn\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696345 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd99c833-5d8a-4c0f-b177-16e44ec4c5e4-konnectivity-ca\") pod \"konnectivity-agent-x8dgj\" (UID: \"cd99c833-5d8a-4c0f-b177-16e44ec4c5e4\") " pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696255 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-run-ovn\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696350 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696382 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-system-cni-dir\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-cni-bin\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee27d852-135d-428e-b595-3088ddbf944b-ovnkube-config\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696428 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64597af5-39c6-4da0-87e1-7bcb067ede1f-hosts-file\") pod \"node-resolver-tjnmg\" (UID: \"64597af5-39c6-4da0-87e1-7bcb067ede1f\") " pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-os-release\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.697431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696532 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-cni-bin\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696575 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-systemd\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696616 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83b85971-813a-4b24-b5f4-4ab6ad5b5516-dbus\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696677 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-etc-kubernetes\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c-iptables-alerter-script\") pod \"iptables-alerter-qbl7w\" (UID: \"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c\") " pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee27d852-135d-428e-b595-3088ddbf944b-ovn-node-metrics-cert\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696776 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-systemd\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-kubelet\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696847 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-host-kubelet\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-var-lib-openvswitch\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-log-socket\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697035 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee27d852-135d-428e-b595-3088ddbf944b-ovnkube-config\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee27d852-135d-428e-b595-3088ddbf944b-env-overrides\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-cnibin\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697175 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-var-lib-openvswitch\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-systemd-units\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697248 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.698297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.696804 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d55727f0-c2f2-4f11-a204-e8138466d477-os-release\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697278 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-log-socket\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2qc7\" (UniqueName: \"kubernetes.io/projected/79eecdfa-bf81-4295-9a47-4089823923f9-kube-api-access-n2qc7\") pod \"node-ca-q82zg\" (UID: \"79eecdfa-bf81-4295-9a47-4089823923f9\") " pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-multus-cni-dir\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-systemd-units\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgkq\" (UniqueName: \"kubernetes.io/projected/3541cb76-3850-4307-95a7-ad4356fb71f1-kube-api-access-hdgkq\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee27d852-135d-428e-b595-3088ddbf944b-ovnkube-script-lib\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-modprobe-d\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697545 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee27d852-135d-428e-b595-3088ddbf944b-env-overrides\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697593 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-sysconfig\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/066ee268-854c-4e75-9a3f-46791967ef38-cni-binary-copy\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697634 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-modprobe-d\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktgbx\" (UniqueName: \"kubernetes.io/projected/aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c-kube-api-access-ktgbx\") pod \"iptables-alerter-qbl7w\" (UID: \"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c\") " pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697671 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cb2f507-666f-4258-b490-139f61fa335e-etc-sysconfig\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-run-systemd\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-run-openvswitch\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64597af5-39c6-4da0-87e1-7bcb067ede1f-tmp-dir\") pod \"node-resolver-tjnmg\" (UID: \"64597af5-39c6-4da0-87e1-7bcb067ede1f\") " pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.699056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d55727f0-c2f2-4f11-a204-e8138466d477-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697794 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-run-systemd\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697813 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb5gm\" (UniqueName: \"kubernetes.io/projected/d55727f0-c2f2-4f11-a204-e8138466d477-kube-api-access-vb5gm\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83b85971-813a-4b24-b5f4-4ab6ad5b5516-kubelet-config\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-os-release\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rszb7\" (UniqueName: \"kubernetes.io/projected/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-kube-api-access-rszb7\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697918 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee27d852-135d-428e-b595-3088ddbf944b-run-openvswitch\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c-host-slash\") pod \"iptables-alerter-qbl7w\" (UID: \"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c\") " pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697987 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee27d852-135d-428e-b595-3088ddbf944b-ovnkube-script-lib\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.697975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-registration-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.698039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-sys-fs\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.698064 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6fp8\" (UniqueName: \"kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8\") pod \"network-check-target-dbr5w\" (UID: \"4d7d3a64-2b45-427e-8090-302c6f730801\") " pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.698082 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64597af5-39c6-4da0-87e1-7bcb067ede1f-tmp-dir\") pod \"node-resolver-tjnmg\" (UID: \"64597af5-39c6-4da0-87e1-7bcb067ede1f\") " pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.698089 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/066ee268-854c-4e75-9a3f-46791967ef38-multus-daemon-config\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.699897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.698409 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d55727f0-c2f2-4f11-a204-e8138466d477-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.700567 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.700180 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cb2f507-666f-4258-b490-139f61fa335e-etc-tuned\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.700567 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.700250 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd99c833-5d8a-4c0f-b177-16e44ec4c5e4-agent-certs\") pod \"konnectivity-agent-x8dgj\" (UID: \"cd99c833-5d8a-4c0f-b177-16e44ec4c5e4\") " pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:20.700567 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.700259 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee27d852-135d-428e-b595-3088ddbf944b-ovn-node-metrics-cert\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.700567 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.700430 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cb2f507-666f-4258-b490-139f61fa335e-tmp\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.702951 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.702874 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8ppx\" (UniqueName: \"kubernetes.io/projected/64597af5-39c6-4da0-87e1-7bcb067ede1f-kube-api-access-p8ppx\") pod \"node-resolver-tjnmg\" (UID: \"64597af5-39c6-4da0-87e1-7bcb067ede1f\") " pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.703102 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.702957 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkbhc\" (UniqueName: \"kubernetes.io/projected/4cb2f507-666f-4258-b490-139f61fa335e-kube-api-access-rkbhc\") pod \"tuned-9wtsg\" (UID: \"4cb2f507-666f-4258-b490-139f61fa335e\") " pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.703102 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.703054 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jvrq\" (UniqueName: \"kubernetes.io/projected/ee27d852-135d-428e-b595-3088ddbf944b-kube-api-access-7jvrq\") pod \"ovnkube-node-pjbzj\" (UID: \"ee27d852-135d-428e-b595-3088ddbf944b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.707255 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.707232 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdgkq\" (UniqueName: \"kubernetes.io/projected/3541cb76-3850-4307-95a7-ad4356fb71f1-kube-api-access-hdgkq\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:20.707885 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.707861 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb5gm\" (UniqueName: \"kubernetes.io/projected/d55727f0-c2f2-4f11-a204-e8138466d477-kube-api-access-vb5gm\") pod \"multus-additional-cni-plugins-2rxrc\" (UID: \"d55727f0-c2f2-4f11-a204-e8138466d477\") " pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.798729 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83b85971-813a-4b24-b5f4-4ab6ad5b5516-kubelet-config\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:20.798729 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-os-release\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.798729 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798725 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rszb7\" (UniqueName: \"kubernetes.io/projected/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-kube-api-access-rszb7\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c-host-slash\") pod \"iptables-alerter-qbl7w\" (UID: \"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c\") " pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-registration-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798816 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-os-release\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798834 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c-host-slash\") pod \"iptables-alerter-qbl7w\" (UID: \"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c\") " pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798861 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83b85971-813a-4b24-b5f4-4ab6ad5b5516-kubelet-config\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-sys-fs\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fp8\" (UniqueName: \"kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8\") pod \"network-check-target-dbr5w\" (UID: \"4d7d3a64-2b45-427e-8090-302c6f730801\") " pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798930 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-registration-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/066ee268-854c-4e75-9a3f-46791967ef38-multus-daemon-config\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.798966 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-sys-fs\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.799018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799019 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-system-cni-dir\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-hostroot\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79eecdfa-bf81-4295-9a47-4089823923f9-host\") pod \"node-ca-q82zg\" (UID: \"79eecdfa-bf81-4295-9a47-4089823923f9\") " pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799114 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-system-cni-dir\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799119 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-hostroot\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-run-multus-certs\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799202 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-multus-socket-dir-parent\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799202 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79eecdfa-bf81-4295-9a47-4089823923f9-host\") pod \"node-ca-q82zg\" (UID: \"79eecdfa-bf81-4295-9a47-4089823923f9\") " pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.799214 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-var-lib-cni-bin\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-var-lib-kubelet\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799256 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-var-lib-cni-bin\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799273 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-multus-socket-dir-parent\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799290 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-socket-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799307 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-var-lib-kubelet\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.799529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799313 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-run-multus-certs\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.799324 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret podName:83b85971-813a-4b24-b5f4-4ab6ad5b5516 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:21.299304667 +0000 UTC m=+3.063083754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret") pod "global-pull-secret-syncer-28jlf" (UID: "83b85971-813a-4b24-b5f4-4ab6ad5b5516") : object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-var-lib-cni-multus\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799359 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-var-lib-cni-multus\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799377 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-multus-conf-dir\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799395 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-socket-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-device-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-run-k8s-cni-cncf-io\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799435 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-multus-conf-dir\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799456 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-run-netns\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799476 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-run-k8s-cni-cncf-io\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799485 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-device-dir\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79eecdfa-bf81-4295-9a47-4089823923f9-serviceca\") pod \"node-ca-q82zg\" (UID: \"79eecdfa-bf81-4295-9a47-4089823923f9\") " pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799514 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-host-run-netns\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqnpq\" (UniqueName: \"kubernetes.io/projected/066ee268-854c-4e75-9a3f-46791967ef38-kube-api-access-kqnpq\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799550 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83b85971-813a-4b24-b5f4-4ab6ad5b5516-dbus\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-etc-kubernetes\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.800326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799598 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c-iptables-alerter-script\") pod \"iptables-alerter-qbl7w\" (UID: \"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c\") " pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-cnibin\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799640 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/066ee268-854c-4e75-9a3f-46791967ef38-multus-daemon-config\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799691 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83b85971-813a-4b24-b5f4-4ab6ad5b5516-dbus\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799703 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-etc-kubernetes\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799703 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2qc7\" (UniqueName: \"kubernetes.io/projected/79eecdfa-bf81-4295-9a47-4089823923f9-kube-api-access-n2qc7\") pod \"node-ca-q82zg\" (UID: \"79eecdfa-bf81-4295-9a47-4089823923f9\") " pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799744 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-cnibin\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-multus-cni-dir\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799823 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/066ee268-854c-4e75-9a3f-46791967ef38-cni-binary-copy\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktgbx\" (UniqueName: \"kubernetes.io/projected/aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c-kube-api-access-ktgbx\") pod \"iptables-alerter-qbl7w\" (UID: \"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c\") " pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799889 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79eecdfa-bf81-4295-9a47-4089823923f9-serviceca\") pod \"node-ca-q82zg\" (UID: \"79eecdfa-bf81-4295-9a47-4089823923f9\") " pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.799890 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/066ee268-854c-4e75-9a3f-46791967ef38-multus-cni-dir\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.800269 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c-iptables-alerter-script\") pod \"iptables-alerter-qbl7w\" (UID: \"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c\") " pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.801002 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.800327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/066ee268-854c-4e75-9a3f-46791967ef38-cni-binary-copy\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.805129 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.805108 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 16:11:20.805129 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.805149 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 16:11:20.805299 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.805164 2575 projected.go:196] Error preparing data for projected volume kube-api-access-p6fp8 for pod openshift-network-diagnostics/network-check-target-dbr5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:20.805299 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:20.805234 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8 podName:4d7d3a64-2b45-427e-8090-302c6f730801 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:21.305216926 +0000 UTC m=+3.068996044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fp8" (UniqueName: "kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8") pod "network-check-target-dbr5w" (UID: "4d7d3a64-2b45-427e-8090-302c6f730801") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:20.807825 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.807797 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqnpq\" (UniqueName: \"kubernetes.io/projected/066ee268-854c-4e75-9a3f-46791967ef38-kube-api-access-kqnpq\") pod \"multus-cpmjd\" (UID: \"066ee268-854c-4e75-9a3f-46791967ef38\") " pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.808044 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.808023 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2qc7\" (UniqueName: \"kubernetes.io/projected/79eecdfa-bf81-4295-9a47-4089823923f9-kube-api-access-n2qc7\") pod \"node-ca-q82zg\" (UID: \"79eecdfa-bf81-4295-9a47-4089823923f9\") " pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:20.808125 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.808026 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rszb7\" (UniqueName: \"kubernetes.io/projected/07355a6b-acd6-40a2-8b1e-d73eb40d76e3-kube-api-access-rszb7\") pod \"aws-ebs-csi-driver-node-z4pmv\" (UID: \"07355a6b-acd6-40a2-8b1e-d73eb40d76e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.808313 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.808283 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktgbx\" (UniqueName: \"kubernetes.io/projected/aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c-kube-api-access-ktgbx\") pod \"iptables-alerter-qbl7w\" (UID: \"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c\") " pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.888623 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.888594 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" Jun 14 16:11:20.895370 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.895348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" Jun 14 16:11:20.905047 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.905025 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:20.911428 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.911403 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:20.917507 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.917490 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tjnmg" Jun 14 16:11:20.924782 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.924765 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" Jun 14 16:11:20.930307 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.930285 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cpmjd" Jun 14 16:11:20.937886 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.937868 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qbl7w" Jun 14 16:11:20.943522 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:20.943501 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q82zg" Jun 14 16:11:21.203325 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.203249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:21.203462 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:21.203366 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:21.203462 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:21.203434 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs podName:3541cb76-3850-4307-95a7-ad4356fb71f1 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:22.203415143 +0000 UTC m=+3.967194222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs") pod "network-metrics-daemon-kzd85" (UID: "3541cb76-3850-4307-95a7-ad4356fb71f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:21.303543 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.303510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:21.303701 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:21.303642 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:21.303762 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:21.303721 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret podName:83b85971-813a-4b24-b5f4-4ab6ad5b5516 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:22.303705338 +0000 UTC m=+4.067484420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret") pod "global-pull-secret-syncer-28jlf" (UID: "83b85971-813a-4b24-b5f4-4ab6ad5b5516") : object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:21.403977 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.403922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fp8\" (UniqueName: \"kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8\") pod \"network-check-target-dbr5w\" (UID: \"4d7d3a64-2b45-427e-8090-302c6f730801\") " pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:21.404169 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:21.404079 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 16:11:21.404169 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:21.404151 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 16:11:21.404169 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:21.404167 2575 projected.go:196] Error preparing data for projected volume kube-api-access-p6fp8 for pod openshift-network-diagnostics/network-check-target-dbr5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:21.404338 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:21.404230 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8 podName:4d7d3a64-2b45-427e-8090-302c6f730801 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:22.40421181 +0000 UTC m=+4.167990891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fp8" (UniqueName: "kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8") pod "network-check-target-dbr5w" (UID: "4d7d3a64-2b45-427e-8090-302c6f730801") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:21.497572 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:21.497345 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79eecdfa_bf81_4295_9a47_4089823923f9.slice/crio-5b7df221abbccd459801685e1d6c0e97eaef9d96ee21d38079e2fedd9e49087b WatchSource:0}: Error finding container 5b7df221abbccd459801685e1d6c0e97eaef9d96ee21d38079e2fedd9e49087b: Status 404 returned error can't find the container with id 5b7df221abbccd459801685e1d6c0e97eaef9d96ee21d38079e2fedd9e49087b Jun 14 16:11:21.498647 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:21.498612 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066ee268_854c_4e75_9a3f_46791967ef38.slice/crio-28bb4935e7189ed4814d9f89a3713bd056ad690a74d31f0417493fe345677a11 WatchSource:0}: Error finding container 28bb4935e7189ed4814d9f89a3713bd056ad690a74d31f0417493fe345677a11: Status 404 returned error can't find the container with id 28bb4935e7189ed4814d9f89a3713bd056ad690a74d31f0417493fe345677a11 Jun 14 16:11:21.499682 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:21.499655 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeff1d36_3dd2_4863_a7ac_d63be6fa0e9c.slice/crio-fddaca77dc6188dcbb4d5cbc75fed0aa6628f10510cac77ef33333466116c14b WatchSource:0}: Error finding container fddaca77dc6188dcbb4d5cbc75fed0aa6628f10510cac77ef33333466116c14b: Status 404 returned error can't find the container with id fddaca77dc6188dcbb4d5cbc75fed0aa6628f10510cac77ef33333466116c14b Jun 14 16:11:21.502875 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:21.502848 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd99c833_5d8a_4c0f_b177_16e44ec4c5e4.slice/crio-035f039615adcdb1b7a2da886afe4690d8af524128c5963aa4001368e6a67f42 WatchSource:0}: Error finding container 035f039615adcdb1b7a2da886afe4690d8af524128c5963aa4001368e6a67f42: Status 404 returned error can't find the container with id 035f039615adcdb1b7a2da886afe4690d8af524128c5963aa4001368e6a67f42 Jun 14 16:11:21.504394 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:21.504367 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee27d852_135d_428e_b595_3088ddbf944b.slice/crio-a80369700f012a6919464c363b4d6284dc5d9ea43234b525de7d6b395ef9e093 WatchSource:0}: Error finding container a80369700f012a6919464c363b4d6284dc5d9ea43234b525de7d6b395ef9e093: Status 404 returned error can't find the container with id a80369700f012a6919464c363b4d6284dc5d9ea43234b525de7d6b395ef9e093 Jun 14 16:11:21.505668 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:11:21.505594 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64597af5_39c6_4da0_87e1_7bcb067ede1f.slice/crio-534c2e5697a50fd6c19f06b62953847a3170b6add0efbdcad4ebe50dd57343cb WatchSource:0}: Error finding container 534c2e5697a50fd6c19f06b62953847a3170b6add0efbdcad4ebe50dd57343cb: Status 404 returned error can't find the container with id 534c2e5697a50fd6c19f06b62953847a3170b6add0efbdcad4ebe50dd57343cb Jun 14 16:11:21.627919 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.627869 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 16:06:20 +0000 UTC" deadline="2027-11-14 18:24:31.998439657 +0000 UTC" Jun 14 16:11:21.627919 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.627917 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12434h13m10.370526471s" Jun 14 16:11:21.651632 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.651603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" event={"ID":"4cb2f507-666f-4258-b490-139f61fa335e","Type":"ContainerStarted","Data":"bea9c223546d2e0468053792ab89079c0abc3bf8eb3e08352e3abe2a6ecbbd34"} Jun 14 16:11:21.653936 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.653905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" event={"ID":"ee27d852-135d-428e-b595-3088ddbf944b","Type":"ContainerStarted","Data":"a80369700f012a6919464c363b4d6284dc5d9ea43234b525de7d6b395ef9e093"} Jun 14 16:11:21.656475 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.656450 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tjnmg" event={"ID":"64597af5-39c6-4da0-87e1-7bcb067ede1f","Type":"ContainerStarted","Data":"534c2e5697a50fd6c19f06b62953847a3170b6add0efbdcad4ebe50dd57343cb"} Jun 14 16:11:21.657492 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.657462 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qbl7w" event={"ID":"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c","Type":"ContainerStarted","Data":"fddaca77dc6188dcbb4d5cbc75fed0aa6628f10510cac77ef33333466116c14b"} Jun 14 16:11:21.658582 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.658551 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cpmjd" event={"ID":"066ee268-854c-4e75-9a3f-46791967ef38","Type":"ContainerStarted","Data":"28bb4935e7189ed4814d9f89a3713bd056ad690a74d31f0417493fe345677a11"} Jun 14 16:11:21.660312 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.660291 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" event={"ID":"9d8c88ad5edfec2dac26fd7fc76a13cf","Type":"ContainerStarted","Data":"d358ce995e51f4ec4932f4781d86c6dad6e9a39aee2536a458cc514726d6fcac"} Jun 14 16:11:21.661469 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.661444 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" event={"ID":"07355a6b-acd6-40a2-8b1e-d73eb40d76e3","Type":"ContainerStarted","Data":"cad07a416c32440934b4cc04fda950cdf1920e03efa8a4afbf296a2ee4e06a9c"} Jun 14 16:11:21.662708 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.662673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" event={"ID":"d55727f0-c2f2-4f11-a204-e8138466d477","Type":"ContainerStarted","Data":"5e8d137e8ed7db40a71d0d934651bcd24eb7cacdf2c3bdfcbd5e59ec253410c6"} Jun 14 16:11:21.663825 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.663807 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x8dgj" event={"ID":"cd99c833-5d8a-4c0f-b177-16e44ec4c5e4","Type":"ContainerStarted","Data":"035f039615adcdb1b7a2da886afe4690d8af524128c5963aa4001368e6a67f42"} Jun 14 16:11:21.664882 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:21.664865 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q82zg" event={"ID":"79eecdfa-bf81-4295-9a47-4089823923f9","Type":"ContainerStarted","Data":"5b7df221abbccd459801685e1d6c0e97eaef9d96ee21d38079e2fedd9e49087b"} Jun 14 16:11:22.210354 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.210265 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:22.210530 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.210431 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:22.210530 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.210505 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs podName:3541cb76-3850-4307-95a7-ad4356fb71f1 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:24.210485851 +0000 UTC m=+5.974264944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs") pod "network-metrics-daemon-kzd85" (UID: "3541cb76-3850-4307-95a7-ad4356fb71f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:22.311443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.311407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:22.311622 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.311592 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:22.311684 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.311659 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret podName:83b85971-813a-4b24-b5f4-4ab6ad5b5516 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:24.31163902 +0000 UTC m=+6.075418102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret") pod "global-pull-secret-syncer-28jlf" (UID: "83b85971-813a-4b24-b5f4-4ab6ad5b5516") : object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:22.412575 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.412538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fp8\" (UniqueName: \"kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8\") pod \"network-check-target-dbr5w\" (UID: \"4d7d3a64-2b45-427e-8090-302c6f730801\") " pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:22.412742 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.412715 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 16:11:22.412742 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.412738 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 16:11:22.412860 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.412751 2575 projected.go:196] Error preparing data for projected volume kube-api-access-p6fp8 for pod openshift-network-diagnostics/network-check-target-dbr5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:22.412860 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.412809 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8 podName:4d7d3a64-2b45-427e-8090-302c6f730801 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:24.412790946 +0000 UTC m=+6.176570041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fp8" (UniqueName: "kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8") pod "network-check-target-dbr5w" (UID: "4d7d3a64-2b45-427e-8090-302c6f730801") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:22.628596 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.628505 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 16:06:20 +0000 UTC" deadline="2027-11-08 00:03:10.748121959 +0000 UTC" Jun 14 16:11:22.628596 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.628547 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12271h51m48.119580236s" Jun 14 16:11:22.646973 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.646155 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:22.646973 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.646277 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:22.646973 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.646366 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:22.646973 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.646447 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:22.646973 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.646807 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:22.646973 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:22.646897 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:22.700842 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.700736 2575 generic.go:356] "Generic (PLEG): container finished" podID="5e3a4f18987a9b25d856030bb6e77af4" containerID="51028668a07be114ea7af4133887616047465d95afb95296612d30a664445b4b" exitCode=0 Jun 14 16:11:22.700842 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.700815 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" event={"ID":"5e3a4f18987a9b25d856030bb6e77af4","Type":"ContainerDied","Data":"51028668a07be114ea7af4133887616047465d95afb95296612d30a664445b4b"} Jun 14 16:11:22.714052 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:22.714004 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" podStartSLOduration=3.713985277 podStartE2EDuration="3.713985277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:21.673873615 +0000 UTC m=+3.437652727" watchObservedRunningTime="2026-06-14 16:11:22.713985277 +0000 UTC m=+4.477764372" Jun 14 16:11:23.720743 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:23.720700 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" event={"ID":"5e3a4f18987a9b25d856030bb6e77af4","Type":"ContainerStarted","Data":"c64ac2c0a2c4814f2446c52256e083e915b6d9084d21d5f3091d1815e171f9af"} Jun 14 16:11:24.226654 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:24.226614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:24.226856 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.226811 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:24.226923 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.226878 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs podName:3541cb76-3850-4307-95a7-ad4356fb71f1 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:28.226858955 +0000 UTC m=+9.990638049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs") pod "network-metrics-daemon-kzd85" (UID: "3541cb76-3850-4307-95a7-ad4356fb71f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:24.327604 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:24.327562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:24.327808 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.327791 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:24.327889 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.327878 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret podName:83b85971-813a-4b24-b5f4-4ab6ad5b5516 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:28.327841726 +0000 UTC m=+10.091620818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret") pod "global-pull-secret-syncer-28jlf" (UID: "83b85971-813a-4b24-b5f4-4ab6ad5b5516") : object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:24.428856 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:24.428819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fp8\" (UniqueName: \"kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8\") pod \"network-check-target-dbr5w\" (UID: \"4d7d3a64-2b45-427e-8090-302c6f730801\") " pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:24.429028 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.429002 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 16:11:24.429086 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.429031 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 16:11:24.429086 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.429046 2575 projected.go:196] Error preparing data for projected volume kube-api-access-p6fp8 for pod openshift-network-diagnostics/network-check-target-dbr5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:24.429216 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.429115 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8 podName:4d7d3a64-2b45-427e-8090-302c6f730801 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:28.429096615 +0000 UTC m=+10.192875705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fp8" (UniqueName: "kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8") pod "network-check-target-dbr5w" (UID: "4d7d3a64-2b45-427e-8090-302c6f730801") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:24.644558 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:24.644014 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:24.644558 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.644160 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:24.644558 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:24.644333 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:24.644558 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.644448 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:24.644558 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:24.644533 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:24.644928 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:24.644611 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:26.643862 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:26.643833 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:26.644300 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:26.643976 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:26.644300 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:26.644248 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:26.644424 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:26.644347 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:26.644424 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:26.644216 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:26.644539 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:26.644422 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:28.260963 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:28.260922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:28.261449 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.261186 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:28.261449 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.261256 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs podName:3541cb76-3850-4307-95a7-ad4356fb71f1 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:36.261235047 +0000 UTC m=+18.025014129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs") pod "network-metrics-daemon-kzd85" (UID: "3541cb76-3850-4307-95a7-ad4356fb71f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:28.362385 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:28.361836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:28.362385 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.361988 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:28.362385 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.362046 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret podName:83b85971-813a-4b24-b5f4-4ab6ad5b5516 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:36.362028339 +0000 UTC m=+18.125807440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret") pod "global-pull-secret-syncer-28jlf" (UID: "83b85971-813a-4b24-b5f4-4ab6ad5b5516") : object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:28.462464 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:28.462434 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fp8\" (UniqueName: \"kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8\") pod \"network-check-target-dbr5w\" (UID: \"4d7d3a64-2b45-427e-8090-302c6f730801\") " pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:28.462643 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.462612 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 16:11:28.462643 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.462632 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 16:11:28.462643 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.462642 2575 projected.go:196] Error preparing data for projected volume kube-api-access-p6fp8 for pod openshift-network-diagnostics/network-check-target-dbr5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:28.462802 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.462706 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8 podName:4d7d3a64-2b45-427e-8090-302c6f730801 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:36.462685957 +0000 UTC m=+18.226465058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fp8" (UniqueName: "kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8") pod "network-check-target-dbr5w" (UID: "4d7d3a64-2b45-427e-8090-302c6f730801") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:28.645976 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:28.645481 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:28.645976 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.645586 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:28.645976 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:28.645671 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:28.645976 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.645812 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:28.645976 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:28.645857 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:28.645976 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:28.645972 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:30.643903 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:30.643868 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:30.644374 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:30.643998 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:30.644374 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:30.644062 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:30.644374 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:30.644162 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:30.644374 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:30.643868 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:30.644374 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:30.644260 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:32.644286 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:32.644254 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:32.644725 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:32.644255 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:32.644725 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:32.644384 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:32.644725 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:32.644260 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:32.644725 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:32.644461 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:32.644725 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:32.644575 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:34.643640 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:34.643612 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:34.643640 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:34.643632 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:34.643640 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:34.643612 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:34.644125 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:34.643734 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:34.644125 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:34.643773 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:34.644125 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:34.643905 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:36.319443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:36.319408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:36.319985 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.319600 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:36.319985 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.319685 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs podName:3541cb76-3850-4307-95a7-ad4356fb71f1 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:52.319663913 +0000 UTC m=+34.083443007 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs") pod "network-metrics-daemon-kzd85" (UID: "3541cb76-3850-4307-95a7-ad4356fb71f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:36.420143 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:36.420091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:36.420315 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.420246 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:36.420315 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.420309 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret podName:83b85971-813a-4b24-b5f4-4ab6ad5b5516 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:52.420294343 +0000 UTC m=+34.184073421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret") pod "global-pull-secret-syncer-28jlf" (UID: "83b85971-813a-4b24-b5f4-4ab6ad5b5516") : object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:36.520583 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:36.520545 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fp8\" (UniqueName: \"kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8\") pod \"network-check-target-dbr5w\" (UID: \"4d7d3a64-2b45-427e-8090-302c6f730801\") " pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:36.520774 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.520748 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 16:11:36.520774 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.520777 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 16:11:36.520926 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.520791 2575 projected.go:196] Error preparing data for projected volume kube-api-access-p6fp8 for pod openshift-network-diagnostics/network-check-target-dbr5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:36.520926 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.520853 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8 podName:4d7d3a64-2b45-427e-8090-302c6f730801 nodeName:}" failed. No retries permitted until 2026-06-14 16:11:52.520833179 +0000 UTC m=+34.284612263 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fp8" (UniqueName: "kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8") pod "network-check-target-dbr5w" (UID: "4d7d3a64-2b45-427e-8090-302c6f730801") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:36.646995 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:36.646875 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:36.646995 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:36.646914 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:36.647226 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:36.647008 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:36.647226 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.647016 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:36.647226 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.647105 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:36.647226 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:36.647199 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:38.645406 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:38.645377 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:38.645883 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:38.645483 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:38.645883 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:38.645545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:38.645883 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:38.645632 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:38.645883 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:38.645709 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:38.645883 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:38.645753 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:40.644950 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.644753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:40.645580 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:40.645002 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:40.645580 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.644874 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:40.645580 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:40.645093 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:40.645580 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.644818 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:40.645580 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:40.645186 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:40.756469 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.756362 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cpmjd" event={"ID":"066ee268-854c-4e75-9a3f-46791967ef38","Type":"ContainerStarted","Data":"f2aa93d1d5266ed4ae1c434fa16dcd0d1d0137db82c46162a6e9e9dbbec906aa"} Jun 14 16:11:40.758237 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.758213 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" event={"ID":"07355a6b-acd6-40a2-8b1e-d73eb40d76e3","Type":"ContainerStarted","Data":"a9708d72878fb220e814d13017de822031d033c49e10b3cd2c5a748bb24e1cc7"} Jun 14 16:11:40.759568 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.759544 2575 generic.go:356] "Generic (PLEG): container finished" podID="d55727f0-c2f2-4f11-a204-e8138466d477" containerID="c9abf93ef6ffe9cc2485fcca0b02a7d0bc75afcee538d5c844a9377a7a973686" exitCode=0 Jun 14 16:11:40.759655 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.759627 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" event={"ID":"d55727f0-c2f2-4f11-a204-e8138466d477","Type":"ContainerDied","Data":"c9abf93ef6ffe9cc2485fcca0b02a7d0bc75afcee538d5c844a9377a7a973686"} Jun 14 16:11:40.760975 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.760959 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x8dgj" event={"ID":"cd99c833-5d8a-4c0f-b177-16e44ec4c5e4","Type":"ContainerStarted","Data":"0c5121d9112d2a7a97a6e4f10389aca8ecf52629579db3b3ef0e8edb6d11b73f"} Jun 14 16:11:40.762440 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.762380 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q82zg" event={"ID":"79eecdfa-bf81-4295-9a47-4089823923f9","Type":"ContainerStarted","Data":"a030e745550e090f6fc192c17e6a1cab16396e96ae09bf6ffb1e068b6dbd0a0c"} Jun 14 16:11:40.763763 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.763743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" event={"ID":"4cb2f507-666f-4258-b490-139f61fa335e","Type":"ContainerStarted","Data":"5cf5b34c37f18f16f125135dc4939874caa8d58ccb71c9b9fa1129e8584702f3"} Jun 14 16:11:40.766033 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.766009 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" event={"ID":"ee27d852-135d-428e-b595-3088ddbf944b","Type":"ContainerStarted","Data":"31260717b3816d4c06270dcce91294c41b1d27b7d7d117dc33bc3aec7875ce01"} Jun 14 16:11:40.766121 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.766084 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" event={"ID":"ee27d852-135d-428e-b595-3088ddbf944b","Type":"ContainerStarted","Data":"48579cc6b7960938ab6957861b7881638774253307cc3938f329528252c09c0c"} Jun 14 16:11:40.767389 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.767368 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tjnmg" event={"ID":"64597af5-39c6-4da0-87e1-7bcb067ede1f","Type":"ContainerStarted","Data":"1d7aacab7be6efba5e84a6d8635ad3a715f287fac64d0e7ddec8afb1aa13cd40"} Jun 14 16:11:40.775947 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.775909 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" podStartSLOduration=21.775883817 podStartE2EDuration="21.775883817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:23.73829516 +0000 UTC m=+5.502074276" watchObservedRunningTime="2026-06-14 16:11:40.775883817 +0000 UTC m=+22.539662909" Jun 14 16:11:40.776049 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.776023 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cpmjd" podStartSLOduration=3.2602265040000002 podStartE2EDuration="21.776014458s" totalImagesPullingTime="18.515787954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:40.775858138 +0000 UTC m=+22.539637237" watchObservedRunningTime="2026-06-14 16:11:40.776014458 +0000 UTC m=+22.539793559" Jun 14 16:11:40.810830 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.810796 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9wtsg" podStartSLOduration=4.3281731709999995 podStartE2EDuration="22.810783447s" totalImagesPullingTime="18.482610276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:40.810183757 +0000 UTC m=+22.573962882" watchObservedRunningTime="2026-06-14 16:11:40.810783447 +0000 UTC m=+22.574562546" Jun 14 16:11:40.823662 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.823621 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tjnmg" podStartSLOduration=4.339966983 podStartE2EDuration="22.82360932s" totalImagesPullingTime="18.483642337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:40.823422623 +0000 UTC m=+22.587201724" watchObservedRunningTime="2026-06-14 16:11:40.82360932 +0000 UTC m=+22.587388419" Jun 14 16:11:40.836042 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:40.836002 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x8dgj" podStartSLOduration=4.413504691 podStartE2EDuration="22.835987988s" totalImagesPullingTime="18.422483297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:40.835961564 +0000 UTC m=+22.599740690" watchObservedRunningTime="2026-06-14 16:11:40.835987988 +0000 UTC m=+22.599767088" Jun 14 16:11:41.384106 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.384085 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:41.384603 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.384580 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:41.399313 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.399278 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q82zg" podStartSLOduration=3.9072298290000003 podStartE2EDuration="22.399263616s" totalImagesPullingTime="18.492033787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:40.851759328 +0000 UTC m=+22.615538428" watchObservedRunningTime="2026-06-14 16:11:41.399263616 +0000 UTC m=+23.163042718" Jun 14 16:11:41.516524 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.516500 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 16:11:41.657948 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.657822 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T16:11:41.516519625Z","UUID":"be0cfe09-4a86-4431-b38b-01382d669b81","Handler":null,"Name":"","Endpoint":""} Jun 14 16:11:41.659204 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.659184 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 16:11:41.659308 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.659224 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 16:11:41.771555 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.771486 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" event={"ID":"07355a6b-acd6-40a2-8b1e-d73eb40d76e3","Type":"ContainerStarted","Data":"b15762f48b46829702df7ec65429ffa93a025e950caacadcf91debfb2f9373f7"} Jun 14 16:11:41.775261 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.775232 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" event={"ID":"ee27d852-135d-428e-b595-3088ddbf944b","Type":"ContainerStarted","Data":"f6529db8e9976a5b2239627ed2dea83b6f0ce20b25c6d47133c13a7bd14451f7"} Jun 14 16:11:41.775407 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.775322 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" event={"ID":"ee27d852-135d-428e-b595-3088ddbf944b","Type":"ContainerStarted","Data":"bc157eea356c8a260ad74d0a7f37852bef4d3a8dd415a985e313fc052b8a3bf7"} Jun 14 16:11:41.775407 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.775375 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" event={"ID":"ee27d852-135d-428e-b595-3088ddbf944b","Type":"ContainerStarted","Data":"ba4d306b9092ef264ac22dfe161fff6a959730f3ed33af0386eab87a9d4529b6"} Jun 14 16:11:41.775519 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.775420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" event={"ID":"ee27d852-135d-428e-b595-3088ddbf944b","Type":"ContainerStarted","Data":"9fae87f3520e4ea4f299c913723fd731a203c6d16ed57cd7e5ddb1d2cf148093"} Jun 14 16:11:41.776788 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.776724 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qbl7w" event={"ID":"aeff1d36-3dd2-4863-a7ac-d63be6fa0e9c","Type":"ContainerStarted","Data":"0f063ee759d455ad94e4820a9e3a587db6e15ba4f4948173ed7403480f820094"} Jun 14 16:11:41.777567 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.777497 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:41.778021 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.778004 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x8dgj" Jun 14 16:11:41.790154 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:41.790092 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qbl7w" podStartSLOduration=4.293138228 podStartE2EDuration="22.790080462s" totalImagesPullingTime="18.496942234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:41.78931657 +0000 UTC m=+23.553095670" watchObservedRunningTime="2026-06-14 16:11:41.790080462 +0000 UTC m=+23.553859585" Jun 14 16:11:42.644183 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:42.644027 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:42.644305 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:42.644031 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:42.644305 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:42.644259 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:42.644373 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:42.644031 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:42.644373 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:42.644336 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:42.644433 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:42.644421 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:42.783682 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:42.783602 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" event={"ID":"07355a6b-acd6-40a2-8b1e-d73eb40d76e3","Type":"ContainerStarted","Data":"401f34188718afaa328fd76e080e67a1624f359132bf73eab5ae8e2b2020c096"} Jun 14 16:11:42.798849 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:42.798766 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4pmv" podStartSLOduration=4.148751954 podStartE2EDuration="24.798751224s" totalImagesPullingTime="20.64999927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:42.79842416 +0000 UTC m=+24.562203277" watchObservedRunningTime="2026-06-14 16:11:42.798751224 +0000 UTC m=+24.562530324" Jun 14 16:11:43.792776 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:43.792740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" event={"ID":"ee27d852-135d-428e-b595-3088ddbf944b","Type":"ContainerStarted","Data":"1af711f51cf4343b85c822290294676f4a466ed281a76a8cea1dce514b6a20e9"} Jun 14 16:11:44.644185 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:44.644096 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:44.644185 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:44.644096 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:44.644399 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:44.644238 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:44.644399 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:44.644287 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:44.644492 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:44.644436 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:44.644492 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:44.644479 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:46.643811 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:46.643784 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:46.643811 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:46.643798 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:46.644490 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:46.643790 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:46.644490 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:46.643884 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:46.644490 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:46.643950 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:46.644490 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:46.644039 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:46.800520 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:46.800488 2575 generic.go:356] "Generic (PLEG): container finished" podID="d55727f0-c2f2-4f11-a204-e8138466d477" containerID="a4e768c992f1985e632634e927d1fbfe4ff5509868177357bd4832818ce904f8" exitCode=0 Jun 14 16:11:46.800764 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:46.800585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" event={"ID":"d55727f0-c2f2-4f11-a204-e8138466d477","Type":"ContainerDied","Data":"a4e768c992f1985e632634e927d1fbfe4ff5509868177357bd4832818ce904f8"} Jun 14 16:11:46.804488 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:46.804456 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" event={"ID":"ee27d852-135d-428e-b595-3088ddbf944b","Type":"ContainerStarted","Data":"9ba2c40467cefb9d4e517f5a7bb0bab28d15b8d78e0cb1e30707a62ceff1d0f3"} Jun 14 16:11:46.804731 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:46.804717 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:46.804811 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:46.804780 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:46.820220 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:46.820201 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:47.807180 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:47.807147 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:47.821855 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:47.821833 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:11:47.847458 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:47.847415 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" podStartSLOduration=10.900786612 podStartE2EDuration="29.847399997s" totalImagesPullingTime="18.946613385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:46.848425028 +0000 UTC m=+28.612204128" watchObservedRunningTime="2026-06-14 16:11:47.847399997 +0000 UTC m=+29.611179097" Jun 14 16:11:48.644609 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:48.644574 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:48.644774 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:48.644664 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:48.644774 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:48.644688 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:48.644774 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:48.644736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:48.644900 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:48.644811 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:48.644900 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:48.644880 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:48.811233 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:48.811198 2575 generic.go:356] "Generic (PLEG): container finished" podID="d55727f0-c2f2-4f11-a204-e8138466d477" containerID="7f67442b1dd4b8e813c55d35db46bc0ade93f343af53c718bd9ed919773f80f7" exitCode=0 Jun 14 16:11:48.811661 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:48.811289 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" event={"ID":"d55727f0-c2f2-4f11-a204-e8138466d477","Type":"ContainerDied","Data":"7f67442b1dd4b8e813c55d35db46bc0ade93f343af53c718bd9ed919773f80f7"} Jun 14 16:11:50.644202 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:50.644015 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:50.644600 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:50.644040 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:50.644600 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:50.644285 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:50.644600 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:50.644054 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:50.644600 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:50.644349 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:50.644600 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:50.644439 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:50.817283 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:50.817255 2575 generic.go:356] "Generic (PLEG): container finished" podID="d55727f0-c2f2-4f11-a204-e8138466d477" containerID="9780968cad3df6e70b0576f9a54c954af2e211d60116f7153abc60a728583b37" exitCode=0 Jun 14 16:11:50.817438 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:50.817307 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" event={"ID":"d55727f0-c2f2-4f11-a204-e8138466d477","Type":"ContainerDied","Data":"9780968cad3df6e70b0576f9a54c954af2e211d60116f7153abc60a728583b37"} Jun 14 16:11:52.339889 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:52.339852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:52.340265 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.339966 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:52.340265 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.340015 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs podName:3541cb76-3850-4307-95a7-ad4356fb71f1 nodeName:}" failed. No retries permitted until 2026-06-14 16:12:24.340002771 +0000 UTC m=+66.103781849 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs") pod "network-metrics-daemon-kzd85" (UID: "3541cb76-3850-4307-95a7-ad4356fb71f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 16:11:52.440112 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:52.440079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:52.440280 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.440227 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:52.440330 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.440284 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret podName:83b85971-813a-4b24-b5f4-4ab6ad5b5516 nodeName:}" failed. No retries permitted until 2026-06-14 16:12:24.440267475 +0000 UTC m=+66.204046564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret") pod "global-pull-secret-syncer-28jlf" (UID: "83b85971-813a-4b24-b5f4-4ab6ad5b5516") : object "kube-system"/"original-pull-secret" not registered Jun 14 16:11:52.540763 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:52.540727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fp8\" (UniqueName: \"kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8\") pod \"network-check-target-dbr5w\" (UID: \"4d7d3a64-2b45-427e-8090-302c6f730801\") " pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:52.540934 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.540919 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 16:11:52.540985 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.540945 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 16:11:52.540985 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.540961 2575 projected.go:196] Error preparing data for projected volume kube-api-access-p6fp8 for pod openshift-network-diagnostics/network-check-target-dbr5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:52.541066 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.541022 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8 podName:4d7d3a64-2b45-427e-8090-302c6f730801 nodeName:}" failed. No retries permitted until 2026-06-14 16:12:24.54100347 +0000 UTC m=+66.304782564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fp8" (UniqueName: "kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8") pod "network-check-target-dbr5w" (UID: "4d7d3a64-2b45-427e-8090-302c6f730801") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 16:11:52.644114 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:52.644033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:52.644277 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:52.644033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:52.644277 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.644169 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:52.644277 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:52.644031 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:52.644277 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.644254 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:52.644501 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:52.644324 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:54.644461 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:54.644423 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:54.644461 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:54.644444 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:54.644988 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:54.644424 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:54.644988 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:54.644563 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:54.644988 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:54.644635 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:54.644988 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:54.644666 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:56.164855 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:56.164775 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dbr5w"] Jun 14 16:11:56.165457 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:56.164912 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:56.165457 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:56.165003 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:56.167947 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:56.167920 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-28jlf"] Jun 14 16:11:56.168059 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:56.168019 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:56.168151 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:56.168115 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:56.168569 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:56.168546 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kzd85"] Jun 14 16:11:56.168672 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:56.168637 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:56.168760 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:56.168735 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:56.833225 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:56.832976 2575 generic.go:356] "Generic (PLEG): container finished" podID="d55727f0-c2f2-4f11-a204-e8138466d477" containerID="e3f945fde50b8d4db06b3d035c42dc774526f1ea4d3c0fdb795a8c2eb97b5395" exitCode=0 Jun 14 16:11:56.833225 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:56.833041 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" event={"ID":"d55727f0-c2f2-4f11-a204-e8138466d477","Type":"ContainerDied","Data":"e3f945fde50b8d4db06b3d035c42dc774526f1ea4d3c0fdb795a8c2eb97b5395"} Jun 14 16:11:57.644655 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:57.644628 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:57.644998 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:57.644720 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:57.644998 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:57.644740 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:57.644998 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:57.644824 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:57.644998 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:57.644725 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:57.644998 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:57.644900 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:11:57.838307 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:57.838278 2575 generic.go:356] "Generic (PLEG): container finished" podID="d55727f0-c2f2-4f11-a204-e8138466d477" containerID="37cec39fd984c47a050d419a76f7c5dbe0faf06dbf934b48d46ac56fad189b5a" exitCode=0 Jun 14 16:11:57.838472 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:57.838315 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" event={"ID":"d55727f0-c2f2-4f11-a204-e8138466d477","Type":"ContainerDied","Data":"37cec39fd984c47a050d419a76f7c5dbe0faf06dbf934b48d46ac56fad189b5a"} Jun 14 16:11:58.843778 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:58.843704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" event={"ID":"d55727f0-c2f2-4f11-a204-e8138466d477","Type":"ContainerStarted","Data":"00d2fedf8e2684f0aeb36cd69db5735cfb404d8898a4736270052a60d2ef7468"} Jun 14 16:11:58.865972 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:58.865932 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2rxrc" podStartSLOduration=9.868411467 podStartE2EDuration="40.865918583s" totalImagesPullingTime="30.997507116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:11:58.864867947 +0000 UTC m=+40.628647091" watchObservedRunningTime="2026-06-14 16:11:58.865918583 +0000 UTC m=+40.629697683" Jun 14 16:11:59.644061 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:59.644032 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:11:59.644249 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:59.644124 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:11:59.644249 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:59.644127 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbr5w" podUID="4d7d3a64-2b45-427e-8090-302c6f730801" Jun 14 16:11:59.644249 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:11:59.644129 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:11:59.644249 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:59.644222 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28jlf" podUID="83b85971-813a-4b24-b5f4-4ab6ad5b5516" Jun 14 16:11:59.644383 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:11:59.644281 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kzd85" podUID="3541cb76-3850-4307-95a7-ad4356fb71f1" Jun 14 16:12:01.024988 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.024962 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeReady" Jun 14 16:12:01.025376 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.025070 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 16:12:01.061990 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.061960 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b9b46c595-cxmzr"] Jun 14 16:12:01.092784 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.092761 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k7vnp"] Jun 14 16:12:01.092956 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.092933 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.096363 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.096342 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 16:12:01.096801 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.096561 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 16:12:01.096907 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.096670 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 16:12:01.097297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.097278 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ssdnm\"" Jun 14 16:12:01.102788 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.102769 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 16:12:01.123618 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.122808 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j4t6v"] Jun 14 16:12:01.124481 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.123777 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.128172 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.128153 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 16:12:01.128472 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.128187 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7m87r\"" Jun 14 16:12:01.128709 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.128689 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 16:12:01.137353 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.137335 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b9b46c595-cxmzr"] Jun 14 16:12:01.137452 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.137362 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k7vnp"] Jun 14 16:12:01.137452 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.137382 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4t6v"] Jun 14 16:12:01.137552 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.137454 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4t6v" Jun 14 16:12:01.137552 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.137466 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9cbc59c96-d9srt"] Jun 14 16:12:01.139394 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.139376 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nl86c\"" Jun 14 16:12:01.139394 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.139389 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 16:12:01.139534 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.139396 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 16:12:01.139534 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.139413 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 16:12:01.159423 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.159401 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fpq27"] Jun 14 16:12:01.159528 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.159514 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.161750 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.161727 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 16:12:01.161868 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.161758 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 16:12:01.161868 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.161853 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 16:12:01.161982 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.161906 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 16:12:01.162063 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.162033 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 16:12:01.162198 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.162166 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fv5vr\"" Jun 14 16:12:01.162302 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.162223 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 16:12:01.162302 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.162186 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 16:12:01.183526 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.183508 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9cbc59c96-d9srt"] Jun 14 16:12:01.183629 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.183544 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fpq27"] Jun 14 16:12:01.183689 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.183662 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.185338 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.185322 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 16:12:01.185560 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.185544 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 16:12:01.185741 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.185728 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 16:12:01.185863 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.185848 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 16:12:01.185952 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.185937 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2292n\"" Jun 14 16:12:01.213062 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.213038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e445f4f8-a013-40c3-8298-83200c164c3e-registry-tls\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.213062 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.213062 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e445f4f8-a013-40c3-8298-83200c164c3e-ca-trust-extracted\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.213222 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.213084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jghrq\" (UniqueName: \"kubernetes.io/projected/e445f4f8-a013-40c3-8298-83200c164c3e-kube-api-access-jghrq\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.213222 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.213105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e445f4f8-a013-40c3-8298-83200c164c3e-image-registry-private-configuration\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.213222 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.213160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e445f4f8-a013-40c3-8298-83200c164c3e-registry-certificates\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.213222 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.213195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e445f4f8-a013-40c3-8298-83200c164c3e-trusted-ca\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.213345 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.213225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e445f4f8-a013-40c3-8298-83200c164c3e-installation-pull-secrets\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.213345 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.213241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e445f4f8-a013-40c3-8298-83200c164c3e-bound-sa-token\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.314418 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c129bd5-69a6-492c-9b28-8a603d7391f9-tmp-dir\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.314418 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7tbh\" (UniqueName: \"kubernetes.io/projected/0c129bd5-69a6-492c-9b28-8a603d7391f9-kube-api-access-j7tbh\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.314418 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e445f4f8-a013-40c3-8298-83200c164c3e-trusted-ca\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.314636 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e140c399-d1d1-420b-9375-51e3a6aa6501-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.314636 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e445f4f8-a013-40c3-8298-83200c164c3e-installation-pull-secrets\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.314636 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314542 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e445f4f8-a013-40c3-8298-83200c164c3e-bound-sa-token\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.314636 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e140c399-d1d1-420b-9375-51e3a6aa6501-crio-socket\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.314636 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314598 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-service-ca\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.314636 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-oauth-serving-cert\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.314867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tj9g\" (UniqueName: \"kubernetes.io/projected/978e6708-182d-4716-8db1-eed9af2812da-kube-api-access-9tj9g\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.314867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314713 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e140c399-d1d1-420b-9375-51e3a6aa6501-data-volume\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.314867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e140c399-d1d1-420b-9375-51e3a6aa6501-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.314867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314774 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c129bd5-69a6-492c-9b28-8a603d7391f9-metrics-tls\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.314867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-serving-cert\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.314867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-oauth-config\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.314867 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4gd5\" (UniqueName: \"kubernetes.io/projected/e140c399-d1d1-420b-9375-51e3a6aa6501-kube-api-access-c4gd5\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.315287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rh2r\" (UniqueName: \"kubernetes.io/projected/90f350e0-294f-4aa6-a04a-d201ccfe6c18-kube-api-access-6rh2r\") pod \"ingress-canary-j4t6v\" (UID: \"90f350e0-294f-4aa6-a04a-d201ccfe6c18\") " pod="openshift-ingress-canary/ingress-canary-j4t6v" Jun 14 16:12:01.315287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-console-config\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.315287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.314942 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90f350e0-294f-4aa6-a04a-d201ccfe6c18-cert\") pod \"ingress-canary-j4t6v\" (UID: \"90f350e0-294f-4aa6-a04a-d201ccfe6c18\") " pod="openshift-ingress-canary/ingress-canary-j4t6v" Jun 14 16:12:01.315287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.315020 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e445f4f8-a013-40c3-8298-83200c164c3e-registry-tls\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.315287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.315035 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e445f4f8-a013-40c3-8298-83200c164c3e-ca-trust-extracted\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.315287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.315058 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jghrq\" (UniqueName: \"kubernetes.io/projected/e445f4f8-a013-40c3-8298-83200c164c3e-kube-api-access-jghrq\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.315287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.315088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e445f4f8-a013-40c3-8298-83200c164c3e-image-registry-private-configuration\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.315287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.315108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e445f4f8-a013-40c3-8298-83200c164c3e-registry-certificates\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.315287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.315122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c129bd5-69a6-492c-9b28-8a603d7391f9-config-volume\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.315287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.315243 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e445f4f8-a013-40c3-8298-83200c164c3e-trusted-ca\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.315653 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.315425 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e445f4f8-a013-40c3-8298-83200c164c3e-ca-trust-extracted\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.315970 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.315930 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e445f4f8-a013-40c3-8298-83200c164c3e-registry-certificates\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.318686 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.318666 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e445f4f8-a013-40c3-8298-83200c164c3e-image-registry-private-configuration\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.318934 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.318912 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e445f4f8-a013-40c3-8298-83200c164c3e-registry-tls\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.318978 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.318923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e445f4f8-a013-40c3-8298-83200c164c3e-installation-pull-secrets\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.323518 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.323499 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jghrq\" (UniqueName: \"kubernetes.io/projected/e445f4f8-a013-40c3-8298-83200c164c3e-kube-api-access-jghrq\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.323758 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.323737 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e445f4f8-a013-40c3-8298-83200c164c3e-bound-sa-token\") pod \"image-registry-6b9b46c595-cxmzr\" (UID: \"e445f4f8-a013-40c3-8298-83200c164c3e\") " pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.414960 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.414940 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.416115 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e140c399-d1d1-420b-9375-51e3a6aa6501-crio-socket\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.416235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-service-ca\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.416235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416160 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-oauth-serving-cert\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.416235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416200 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tj9g\" (UniqueName: \"kubernetes.io/projected/978e6708-182d-4716-8db1-eed9af2812da-kube-api-access-9tj9g\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.416235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e140c399-d1d1-420b-9375-51e3a6aa6501-data-volume\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.416425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416259 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e140c399-d1d1-420b-9375-51e3a6aa6501-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.416425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416269 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e140c399-d1d1-420b-9375-51e3a6aa6501-crio-socket\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.416425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c129bd5-69a6-492c-9b28-8a603d7391f9-metrics-tls\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.416425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-serving-cert\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.416425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-oauth-config\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.416425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416361 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4gd5\" (UniqueName: \"kubernetes.io/projected/e140c399-d1d1-420b-9375-51e3a6aa6501-kube-api-access-c4gd5\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.416425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rh2r\" (UniqueName: \"kubernetes.io/projected/90f350e0-294f-4aa6-a04a-d201ccfe6c18-kube-api-access-6rh2r\") pod \"ingress-canary-j4t6v\" (UID: \"90f350e0-294f-4aa6-a04a-d201ccfe6c18\") " pod="openshift-ingress-canary/ingress-canary-j4t6v" Jun 14 16:12:01.416425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416412 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-console-config\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.416812 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90f350e0-294f-4aa6-a04a-d201ccfe6c18-cert\") pod \"ingress-canary-j4t6v\" (UID: \"90f350e0-294f-4aa6-a04a-d201ccfe6c18\") " pod="openshift-ingress-canary/ingress-canary-j4t6v" Jun 14 16:12:01.416812 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416539 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c129bd5-69a6-492c-9b28-8a603d7391f9-config-volume\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.416812 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416553 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e140c399-d1d1-420b-9375-51e3a6aa6501-data-volume\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.416812 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c129bd5-69a6-492c-9b28-8a603d7391f9-tmp-dir\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.416812 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416586 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7tbh\" (UniqueName: \"kubernetes.io/projected/0c129bd5-69a6-492c-9b28-8a603d7391f9-kube-api-access-j7tbh\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.416812 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e140c399-d1d1-420b-9375-51e3a6aa6501-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.417103 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.416891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-oauth-serving-cert\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.417217 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.417195 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e140c399-d1d1-420b-9375-51e3a6aa6501-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.417335 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.417307 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c129bd5-69a6-492c-9b28-8a603d7391f9-tmp-dir\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.417554 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.417525 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-service-ca\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.417882 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.417863 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c129bd5-69a6-492c-9b28-8a603d7391f9-config-volume\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.418062 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.418027 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-console-config\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.418944 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.418922 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c129bd5-69a6-492c-9b28-8a603d7391f9-metrics-tls\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.419083 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.419060 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90f350e0-294f-4aa6-a04a-d201ccfe6c18-cert\") pod \"ingress-canary-j4t6v\" (UID: \"90f350e0-294f-4aa6-a04a-d201ccfe6c18\") " pod="openshift-ingress-canary/ingress-canary-j4t6v" Jun 14 16:12:01.419273 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.419256 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-oauth-config\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.419385 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.419367 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e140c399-d1d1-420b-9375-51e3a6aa6501-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.419533 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.419519 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-serving-cert\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.424629 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.424611 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4gd5\" (UniqueName: \"kubernetes.io/projected/e140c399-d1d1-420b-9375-51e3a6aa6501-kube-api-access-c4gd5\") pod \"insights-runtime-extractor-fpq27\" (UID: \"e140c399-d1d1-420b-9375-51e3a6aa6501\") " pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.425408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.424960 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rh2r\" (UniqueName: \"kubernetes.io/projected/90f350e0-294f-4aa6-a04a-d201ccfe6c18-kube-api-access-6rh2r\") pod \"ingress-canary-j4t6v\" (UID: \"90f350e0-294f-4aa6-a04a-d201ccfe6c18\") " pod="openshift-ingress-canary/ingress-canary-j4t6v" Jun 14 16:12:01.425408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.425368 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7tbh\" (UniqueName: \"kubernetes.io/projected/0c129bd5-69a6-492c-9b28-8a603d7391f9-kube-api-access-j7tbh\") pod \"dns-default-k7vnp\" (UID: \"0c129bd5-69a6-492c-9b28-8a603d7391f9\") " pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.425560 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.425539 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tj9g\" (UniqueName: \"kubernetes.io/projected/978e6708-182d-4716-8db1-eed9af2812da-kube-api-access-9tj9g\") pod \"console-9cbc59c96-d9srt\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.434214 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.434198 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:01.445266 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.445248 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4t6v" Jun 14 16:12:01.467234 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.467202 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:01.493497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.493475 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fpq27" Jun 14 16:12:01.644285 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.643691 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:12:01.644285 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.643702 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:12:01.645097 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.643756 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:12:01.645986 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.645920 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b9b46c595-cxmzr"] Jun 14 16:12:01.647097 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.646841 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 16:12:01.650064 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.649315 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 16:12:01.650064 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.649573 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wn2pg\"" Jun 14 16:12:01.650064 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.649841 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 16:12:01.650064 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.649848 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tb9hf\"" Jun 14 16:12:01.650371 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.650082 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 16:12:01.654125 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.652677 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k7vnp"] Jun 14 16:12:01.690843 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.690817 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9cbc59c96-d9srt"] Jun 14 16:12:01.697112 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:01.697089 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978e6708_182d_4716_8db1_eed9af2812da.slice/crio-9f23e7dc4508bfa2745f68c19588e5ddcb13559a093273c3cdc0de5d3bdfe767 WatchSource:0}: Error finding container 9f23e7dc4508bfa2745f68c19588e5ddcb13559a093273c3cdc0de5d3bdfe767: Status 404 returned error can't find the container with id 9f23e7dc4508bfa2745f68c19588e5ddcb13559a093273c3cdc0de5d3bdfe767 Jun 14 16:12:01.720463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.720434 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4t6v"] Jun 14 16:12:01.728343 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:01.728321 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f350e0_294f_4aa6_a04a_d201ccfe6c18.slice/crio-3146bc7cd82c51284d377efa5064be17c7e197d6efc3ea96fd44ce368ac7aac3 WatchSource:0}: Error finding container 3146bc7cd82c51284d377efa5064be17c7e197d6efc3ea96fd44ce368ac7aac3: Status 404 returned error can't find the container with id 3146bc7cd82c51284d377efa5064be17c7e197d6efc3ea96fd44ce368ac7aac3 Jun 14 16:12:01.734767 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.734742 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fpq27"] Jun 14 16:12:01.737487 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:01.737468 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode140c399_d1d1_420b_9375_51e3a6aa6501.slice/crio-3035a5abf7339bcdf7e22e582a7a73ddffd72cbef0d7ffd6e16136c1cf53daac WatchSource:0}: Error finding container 3035a5abf7339bcdf7e22e582a7a73ddffd72cbef0d7ffd6e16136c1cf53daac: Status 404 returned error can't find the container with id 3035a5abf7339bcdf7e22e582a7a73ddffd72cbef0d7ffd6e16136c1cf53daac Jun 14 16:12:01.856605 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.856533 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4t6v" event={"ID":"90f350e0-294f-4aa6-a04a-d201ccfe6c18","Type":"ContainerStarted","Data":"3146bc7cd82c51284d377efa5064be17c7e197d6efc3ea96fd44ce368ac7aac3"} Jun 14 16:12:01.857728 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.857660 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k7vnp" event={"ID":"0c129bd5-69a6-492c-9b28-8a603d7391f9","Type":"ContainerStarted","Data":"194e8d7fc82a2acb175e38a2f1274d14f7f3d4157ac78f067e53d9e424c0b3ab"} Jun 14 16:12:01.858872 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.858791 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fpq27" event={"ID":"e140c399-d1d1-420b-9375-51e3a6aa6501","Type":"ContainerStarted","Data":"3035a5abf7339bcdf7e22e582a7a73ddffd72cbef0d7ffd6e16136c1cf53daac"} Jun 14 16:12:01.860348 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.860326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" event={"ID":"e445f4f8-a013-40c3-8298-83200c164c3e","Type":"ContainerStarted","Data":"60f4be52bceb348bb286298745f9abe169af8cef8720871d05b65b43d7744e51"} Jun 14 16:12:01.860446 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.860364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" event={"ID":"e445f4f8-a013-40c3-8298-83200c164c3e","Type":"ContainerStarted","Data":"891006278da91a15418190333d9579c827da3ccd0b374990f9dce4311d00e2b3"} Jun 14 16:12:01.860446 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.860420 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:01.861497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.861480 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cbc59c96-d9srt" event={"ID":"978e6708-182d-4716-8db1-eed9af2812da","Type":"ContainerStarted","Data":"9f23e7dc4508bfa2745f68c19588e5ddcb13559a093273c3cdc0de5d3bdfe767"} Jun 14 16:12:01.880293 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:01.880251 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" podStartSLOduration=7.880240635 podStartE2EDuration="7.880240635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:01.879998914 +0000 UTC m=+43.643778028" watchObservedRunningTime="2026-06-14 16:12:01.880240635 +0000 UTC m=+43.644019755" Jun 14 16:12:05.357149 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.357112 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6"] Jun 14 16:12:05.442811 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.442778 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6"] Jun 14 16:12:05.442997 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.442837 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-rww2w"] Jun 14 16:12:05.443067 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.443004 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.446339 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.446309 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 14 16:12:05.446626 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.446583 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 16:12:05.446741 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.446662 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 14 16:12:05.446741 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.446700 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 16:12:05.446952 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.446935 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 16:12:05.447040 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.447025 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kjvq2\"" Jun 14 16:12:05.474676 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.474643 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dpnbg"] Jun 14 16:12:05.474812 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.474779 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.477373 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.477339 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 14 16:12:05.477475 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.477463 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 14 16:12:05.477644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.477623 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fxz7g\"" Jun 14 16:12:05.477769 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.477727 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 14 16:12:05.509947 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.509922 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-rww2w"] Jun 14 16:12:05.510073 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.510024 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.512681 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.512648 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 16:12:05.512787 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.512685 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 16:12:05.512787 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.512688 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 16:12:05.512904 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.512833 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ph8pl\"" Jun 14 16:12:05.551284 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/516759c0-a44b-48cd-88c8-4c9908808c0f-sys\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.551403 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.551403 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/516759c0-a44b-48cd-88c8-4c9908808c0f-root\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.551508 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.551508 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/516759c0-a44b-48cd-88c8-4c9908808c0f-metrics-client-ca\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.551508 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-textfile\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.551644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c77c569-3eac-4875-b566-6a3c1125d51a-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.551644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551538 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.551644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de2ac286-314a-476e-bec4-fd5435ff4300-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.551644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551607 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2ac286-314a-476e-bec4-fd5435ff4300-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.551816 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-wtmp\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.551816 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdhsz\" (UniqueName: \"kubernetes.io/projected/de2ac286-314a-476e-bec4-fd5435ff4300-kube-api-access-xdhsz\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.551816 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7c77c569-3eac-4875-b566-6a3c1125d51a-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.551816 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.551816 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551777 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62ppp\" (UniqueName: \"kubernetes.io/projected/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-api-access-62ppp\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.552018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de2ac286-314a-476e-bec4-fd5435ff4300-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.552018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551868 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.552018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-tls\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.552018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.551935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrx4v\" (UniqueName: \"kubernetes.io/projected/516759c0-a44b-48cd-88c8-4c9908808c0f-kube-api-access-jrx4v\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.652696 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.652667 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de2ac286-314a-476e-bec4-fd5435ff4300-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.652877 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.652705 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2ac286-314a-476e-bec4-fd5435ff4300-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.652877 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.652730 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-wtmp\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.652877 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.652839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-wtmp\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.653044 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.652920 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdhsz\" (UniqueName: \"kubernetes.io/projected/de2ac286-314a-476e-bec4-fd5435ff4300-kube-api-access-xdhsz\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.653044 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.652947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7c77c569-3eac-4875-b566-6a3c1125d51a-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.653044 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.652971 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.653044 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62ppp\" (UniqueName: \"kubernetes.io/projected/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-api-access-62ppp\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.653322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653045 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de2ac286-314a-476e-bec4-fd5435ff4300-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.653322 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:12:05.653075 2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 14 16:12:05.653322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.653322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-tls\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.653322 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:12:05.653167 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-tls podName:7c77c569-3eac-4875-b566-6a3c1125d51a nodeName:}" failed. No retries permitted until 2026-06-14 16:12:06.153126652 +0000 UTC m=+47.916905736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-rww2w" (UID: "7c77c569-3eac-4875-b566-6a3c1125d51a") : secret "kube-state-metrics-tls" not found Jun 14 16:12:05.653322 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:12:05.653283 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 16:12:05.653610 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:12:05.653420 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-tls podName:516759c0-a44b-48cd-88c8-4c9908808c0f nodeName:}" failed. No retries permitted until 2026-06-14 16:12:06.153402249 +0000 UTC m=+47.917181332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-tls") pod "node-exporter-dpnbg" (UID: "516759c0-a44b-48cd-88c8-4c9908808c0f") : secret "node-exporter-tls" not found Jun 14 16:12:05.653610 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653375 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7c77c569-3eac-4875-b566-6a3c1125d51a-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.653610 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrx4v\" (UniqueName: \"kubernetes.io/projected/516759c0-a44b-48cd-88c8-4c9908808c0f-kube-api-access-jrx4v\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.653610 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/516759c0-a44b-48cd-88c8-4c9908808c0f-sys\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.653610 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.653610 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/516759c0-a44b-48cd-88c8-4c9908808c0f-root\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.654207 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.654207 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653700 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/516759c0-a44b-48cd-88c8-4c9908808c0f-sys\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.654207 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653887 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/516759c0-a44b-48cd-88c8-4c9908808c0f-root\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.654207 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.653993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/516759c0-a44b-48cd-88c8-4c9908808c0f-metrics-client-ca\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.654207 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.654037 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-textfile\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.654207 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.654054 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de2ac286-314a-476e-bec4-fd5435ff4300-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.654207 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.654077 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c77c569-3eac-4875-b566-6a3c1125d51a-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.654207 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.654166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.654531 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.654236 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.654531 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.654354 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-textfile\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.654712 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.654638 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/516759c0-a44b-48cd-88c8-4c9908808c0f-metrics-client-ca\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.654886 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.654834 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c77c569-3eac-4875-b566-6a3c1125d51a-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.655303 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.655277 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.656665 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.656646 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2ac286-314a-476e-bec4-fd5435ff4300-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.656936 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.656912 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.656936 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.656928 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de2ac286-314a-476e-bec4-fd5435ff4300-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.657092 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.656917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.663686 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.663654 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdhsz\" (UniqueName: \"kubernetes.io/projected/de2ac286-314a-476e-bec4-fd5435ff4300-kube-api-access-xdhsz\") pod \"openshift-state-metrics-6b8d965dd5-km5h6\" (UID: \"de2ac286-314a-476e-bec4-fd5435ff4300\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:05.663921 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.663870 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62ppp\" (UniqueName: \"kubernetes.io/projected/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-api-access-62ppp\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:05.664200 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.664179 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrx4v\" (UniqueName: \"kubernetes.io/projected/516759c0-a44b-48cd-88c8-4c9908808c0f-kube-api-access-jrx4v\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:05.754994 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:05.754965 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" Jun 14 16:12:06.159038 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.159007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-tls\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:06.159216 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.159119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:06.161281 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.161256 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/516759c0-a44b-48cd-88c8-4c9908808c0f-node-exporter-tls\") pod \"node-exporter-dpnbg\" (UID: \"516759c0-a44b-48cd-88c8-4c9908808c0f\") " pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:06.161587 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.161568 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c77c569-3eac-4875-b566-6a3c1125d51a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-rww2w\" (UID: \"7c77c569-3eac-4875-b566-6a3c1125d51a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:06.386491 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.386299 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" Jun 14 16:12:06.420660 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.420592 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dpnbg" Jun 14 16:12:06.464709 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.464677 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 16:12:06.474973 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.474948 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.477367 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.477301 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 16:12:06.477367 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.477341 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 16:12:06.477565 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.477390 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 16:12:06.477565 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.477407 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 16:12:06.477565 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.477482 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2wzpj\"" Jun 14 16:12:06.477565 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.477497 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 16:12:06.477565 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.477344 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 16:12:06.477804 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.477774 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 16:12:06.477869 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.477777 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 16:12:06.477925 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.477777 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 16:12:06.482099 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.482076 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 16:12:06.564070 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564244 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564094 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564244 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564244 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564244 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-out\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcgd7\" (UniqueName: \"kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-kube-api-access-wcgd7\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564292 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-web-config\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564632 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.564632 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.564530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665225 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665193 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665398 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665398 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665398 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665398 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665398 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665398 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665746 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:12:06.665510 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 14 16:12:06.665746 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:12:06.665589 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-main-tls podName:3a26938e-428b-4f3d-af30-2df1cdb9f86a nodeName:}" failed. No retries permitted until 2026-06-14 16:12:07.165567607 +0000 UTC m=+48.929346689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a") : secret "alertmanager-main-tls" not found Jun 14 16:12:06.665746 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665607 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-out\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665746 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcgd7\" (UniqueName: \"kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-kube-api-access-wcgd7\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665746 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665746 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.665746 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665733 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-web-config\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.666055 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665771 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.666055 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.665890 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.666732 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.666435 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.666732 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.666453 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.669045 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.669022 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.669284 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.669254 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.669878 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.669562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.669878 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.669599 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-out\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.669878 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.669839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.670065 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.669917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.670065 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.669951 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-web-config\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.670870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.670775 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:06.674920 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:06.674902 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcgd7\" (UniqueName: \"kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-kube-api-access-wcgd7\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:07.170801 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.170768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:07.173731 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.173703 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:07.379653 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.379622 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86bf47dd4d-zppbn"] Jun 14 16:12:07.386757 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.386732 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:12:07.399927 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.399905 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86bf47dd4d-zppbn"] Jun 14 16:12:07.400072 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.400057 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.403120 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.403081 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 14 16:12:07.403248 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.403150 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 14 16:12:07.403248 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.403175 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 14 16:12:07.403248 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.403150 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 14 16:12:07.403248 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.403205 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4zq5l\"" Jun 14 16:12:07.403248 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.403211 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 14 16:12:07.403444 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.403182 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1hgccir2igvcc\"" Jun 14 16:12:07.473485 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.473462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.473579 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.473501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-tls\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.473620 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.473572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.473653 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.473631 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-metrics-client-ca\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.473687 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.473651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.473687 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.473674 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t5ld\" (UniqueName: \"kubernetes.io/projected/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-kube-api-access-7t5ld\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.473748 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.473725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.473780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.473759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-grpc-tls\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.574828 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.574788 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-metrics-client-ca\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.574828 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.574828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.575051 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.574860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t5ld\" (UniqueName: \"kubernetes.io/projected/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-kube-api-access-7t5ld\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.575051 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.574995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.575177 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.575052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-grpc-tls\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.575177 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.575102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.575275 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.575179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-tls\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.575275 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.575252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.575612 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.575584 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-metrics-client-ca\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.578001 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.577960 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-tls\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.578413 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.578386 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.578542 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.578521 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.578619 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.578582 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.578724 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.578706 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-grpc-tls\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.578936 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.578916 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.583037 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.583013 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t5ld\" (UniqueName: \"kubernetes.io/projected/432fb1a7-a2dc-46f4-8099-f79e85de3c5f-kube-api-access-7t5ld\") pod \"thanos-querier-86bf47dd4d-zppbn\" (UID: \"432fb1a7-a2dc-46f4-8099-f79e85de3c5f\") " pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:07.709075 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:07.709001 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:08.204242 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.204208 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-rww2w"] Jun 14 16:12:08.275059 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.274965 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-746bfdff5f-5zsz7"] Jun 14 16:12:08.294781 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.294730 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746bfdff5f-5zsz7"] Jun 14 16:12:08.294929 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.294841 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.311858 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.311834 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 16:12:08.381433 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.381398 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg7lp\" (UniqueName: \"kubernetes.io/projected/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-kube-api-access-wg7lp\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.381581 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.381437 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-serving-cert\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.381581 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.381470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-service-ca\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.381581 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.381557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-config\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.381752 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.381597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-trusted-ca-bundle\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.381752 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.381624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-oauth-serving-cert\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.381752 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.381663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-oauth-config\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.482780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.482747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-serving-cert\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.483241 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.482796 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-service-ca\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.483241 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.482823 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-config\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.483241 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.482841 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-trusted-ca-bundle\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.483241 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.482867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-oauth-serving-cert\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.483241 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.482949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-oauth-config\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.483241 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.483128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg7lp\" (UniqueName: \"kubernetes.io/projected/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-kube-api-access-wg7lp\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.483809 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.483787 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-oauth-serving-cert\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.483809 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.483799 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-config\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.483896 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.483787 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-service-ca\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.484204 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.484186 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-trusted-ca-bundle\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.486355 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.486334 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-serving-cert\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.486448 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.486368 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-oauth-config\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.492719 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.492701 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg7lp\" (UniqueName: \"kubernetes.io/projected/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-kube-api-access-wg7lp\") pod \"console-746bfdff5f-5zsz7\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.520880 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:08.520852 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c77c569_3eac_4875_b566_6a3c1125d51a.slice/crio-16afb00cd8eac02f84ba566390b72e2bca0be0ccb7088ab284f3886d809e5672 WatchSource:0}: Error finding container 16afb00cd8eac02f84ba566390b72e2bca0be0ccb7088ab284f3886d809e5672: Status 404 returned error can't find the container with id 16afb00cd8eac02f84ba566390b72e2bca0be0ccb7088ab284f3886d809e5672 Jun 14 16:12:08.524852 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:08.524243 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516759c0_a44b_48cd_88c8_4c9908808c0f.slice/crio-5ebae207d611e5efc56b95d22d829a637d26fc7b8b4097a575d4f9fa7c980f44 WatchSource:0}: Error finding container 5ebae207d611e5efc56b95d22d829a637d26fc7b8b4097a575d4f9fa7c980f44: Status 404 returned error can't find the container with id 5ebae207d611e5efc56b95d22d829a637d26fc7b8b4097a575d4f9fa7c980f44 Jun 14 16:12:08.608239 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.608180 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:08.682891 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.682828 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86bf47dd4d-zppbn"] Jun 14 16:12:08.686510 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:08.686482 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432fb1a7_a2dc_46f4_8099_f79e85de3c5f.slice/crio-7a5516c187d8f836b66af486ba8f8171d57f4fa6913986dc46e0c122588757df WatchSource:0}: Error finding container 7a5516c187d8f836b66af486ba8f8171d57f4fa6913986dc46e0c122588757df: Status 404 returned error can't find the container with id 7a5516c187d8f836b66af486ba8f8171d57f4fa6913986dc46e0c122588757df Jun 14 16:12:08.695967 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.695889 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6"] Jun 14 16:12:08.713108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.712910 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 16:12:08.809544 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.809514 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746bfdff5f-5zsz7"] Jun 14 16:12:08.882089 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.882055 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" event={"ID":"7c77c569-3eac-4875-b566-6a3c1125d51a","Type":"ContainerStarted","Data":"16afb00cd8eac02f84ba566390b72e2bca0be0ccb7088ab284f3886d809e5672"} Jun 14 16:12:08.883447 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.883424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cbc59c96-d9srt" event={"ID":"978e6708-182d-4716-8db1-eed9af2812da","Type":"ContainerStarted","Data":"732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610"} Jun 14 16:12:08.884852 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.884829 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" event={"ID":"de2ac286-314a-476e-bec4-fd5435ff4300","Type":"ContainerStarted","Data":"e71b73b8012082244a213d93ba546571a85055d4b04b788a29b55d50746ee7b9"} Jun 14 16:12:08.884976 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.884876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" event={"ID":"de2ac286-314a-476e-bec4-fd5435ff4300","Type":"ContainerStarted","Data":"05cb90c30db38dc6d0e904ff29bb020301f301eadf428a049e7ead33527706e1"} Jun 14 16:12:08.886120 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.886100 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4t6v" event={"ID":"90f350e0-294f-4aa6-a04a-d201ccfe6c18","Type":"ContainerStarted","Data":"5a82da159394b7683098d8420c4a323159c62f322419cd0cc6efacce5a15eb53"} Jun 14 16:12:08.887432 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.887412 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k7vnp" event={"ID":"0c129bd5-69a6-492c-9b28-8a603d7391f9","Type":"ContainerStarted","Data":"e016781da98dd531ad91181d6e1adb06464956efaa830859a3f0f1d28ed0e1b2"} Jun 14 16:12:08.888584 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.888532 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" event={"ID":"432fb1a7-a2dc-46f4-8099-f79e85de3c5f","Type":"ContainerStarted","Data":"7a5516c187d8f836b66af486ba8f8171d57f4fa6913986dc46e0c122588757df"} Jun 14 16:12:08.889550 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.889533 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerStarted","Data":"b0485eedaa1adfab180bb8e8e8a8d662e1f1ff9f5e43f7919c39ace5ba89241f"} Jun 14 16:12:08.890424 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.890407 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpnbg" event={"ID":"516759c0-a44b-48cd-88c8-4c9908808c0f","Type":"ContainerStarted","Data":"5ebae207d611e5efc56b95d22d829a637d26fc7b8b4097a575d4f9fa7c980f44"} Jun 14 16:12:08.904870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.904832 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9cbc59c96-d9srt" podStartSLOduration=1.080827722 podStartE2EDuration="7.904819874s" totalImagesPullingTime="6.823992152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:08.90405449 +0000 UTC m=+50.667833587" watchObservedRunningTime="2026-06-14 16:12:08.904819874 +0000 UTC m=+50.668598973" Jun 14 16:12:08.919662 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:08.919627 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j4t6v" podStartSLOduration=1.569588602 podStartE2EDuration="7.919613647s" totalImagesPullingTime="6.350025045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:08.918800926 +0000 UTC m=+50.682580026" watchObservedRunningTime="2026-06-14 16:12:08.919613647 +0000 UTC m=+50.683392746" Jun 14 16:12:08.929013 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:08.928990 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0f7df9_ef76_48bf_bd8e_6922d5ec457a.slice/crio-cd53ae8bfaa690a34acf5172a45c093735395dec93ff7677c380d5e15c9e026a WatchSource:0}: Error finding container cd53ae8bfaa690a34acf5172a45c093735395dec93ff7677c380d5e15c9e026a: Status 404 returned error can't find the container with id cd53ae8bfaa690a34acf5172a45c093735395dec93ff7677c380d5e15c9e026a Jun 14 16:12:09.675496 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.673956 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58bd9fb79f-9skxs"] Jun 14 16:12:09.697066 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.697013 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58bd9fb79f-9skxs"] Jun 14 16:12:09.697241 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.697165 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.700993 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.700214 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 14 16:12:09.700993 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.700458 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 14 16:12:09.700993 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.700671 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 16:12:09.700993 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.700709 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lflgf\"" Jun 14 16:12:09.700993 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.700837 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2jftb3u4dqn35\"" Jun 14 16:12:09.700993 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.700893 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 14 16:12:09.797844 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.797810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a73ef74-beb7-4739-aba9-d76f08a8136d-client-ca-bundle\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.798008 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.797883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a73ef74-beb7-4739-aba9-d76f08a8136d-secret-metrics-server-tls\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.798008 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.797910 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a73ef74-beb7-4739-aba9-d76f08a8136d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.798008 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.797973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a73ef74-beb7-4739-aba9-d76f08a8136d-metrics-server-audit-profiles\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.798161 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.798020 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a73ef74-beb7-4739-aba9-d76f08a8136d-audit-log\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.798161 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.798056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvrw9\" (UniqueName: \"kubernetes.io/projected/3a73ef74-beb7-4739-aba9-d76f08a8136d-kube-api-access-gvrw9\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.798161 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.798108 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a73ef74-beb7-4739-aba9-d76f08a8136d-secret-metrics-server-client-certs\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.897821 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.897775 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746bfdff5f-5zsz7" event={"ID":"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a","Type":"ContainerStarted","Data":"f418178f5a62a7f89833cfdbd5b4f8bc3f0a910c17e2baaf815bcff46775d0ed"} Jun 14 16:12:09.897990 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.897835 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746bfdff5f-5zsz7" event={"ID":"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a","Type":"ContainerStarted","Data":"cd53ae8bfaa690a34acf5172a45c093735395dec93ff7677c380d5e15c9e026a"} Jun 14 16:12:09.899196 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.898479 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a73ef74-beb7-4739-aba9-d76f08a8136d-secret-metrics-server-tls\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.899196 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.898521 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a73ef74-beb7-4739-aba9-d76f08a8136d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.899196 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.898565 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a73ef74-beb7-4739-aba9-d76f08a8136d-metrics-server-audit-profiles\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.899196 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.898620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a73ef74-beb7-4739-aba9-d76f08a8136d-audit-log\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.899196 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.898657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvrw9\" (UniqueName: \"kubernetes.io/projected/3a73ef74-beb7-4739-aba9-d76f08a8136d-kube-api-access-gvrw9\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.899196 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.899004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a73ef74-beb7-4739-aba9-d76f08a8136d-secret-metrics-server-client-certs\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.899196 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.899043 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a73ef74-beb7-4739-aba9-d76f08a8136d-audit-log\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.899196 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.899085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a73ef74-beb7-4739-aba9-d76f08a8136d-client-ca-bundle\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.899652 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.899394 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a73ef74-beb7-4739-aba9-d76f08a8136d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.899652 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.899645 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a73ef74-beb7-4739-aba9-d76f08a8136d-metrics-server-audit-profiles\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.900242 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.900213 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" event={"ID":"de2ac286-314a-476e-bec4-fd5435ff4300","Type":"ContainerStarted","Data":"99494577e1e91d7426b3eaa4c054015d9ee4d543dbaa959a0840db2f2fbd6bb6"} Jun 14 16:12:09.903959 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.903304 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k7vnp" event={"ID":"0c129bd5-69a6-492c-9b28-8a603d7391f9","Type":"ContainerStarted","Data":"ba8dc9ad55da143ba3290318f310382f884d597b3da372f66c3a6d2703c06942"} Jun 14 16:12:09.903959 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.903452 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:09.903959 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.903739 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a73ef74-beb7-4739-aba9-d76f08a8136d-secret-metrics-server-tls\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.903959 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.903844 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a73ef74-beb7-4739-aba9-d76f08a8136d-secret-metrics-server-client-certs\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.904765 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.904722 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a73ef74-beb7-4739-aba9-d76f08a8136d-client-ca-bundle\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.906116 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.906051 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fpq27" event={"ID":"e140c399-d1d1-420b-9375-51e3a6aa6501","Type":"ContainerStarted","Data":"056980441eea6f58f9e5123d68266ae5f26d17c1eedb3ac4564e0bdc2862153e"} Jun 14 16:12:09.906603 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.906548 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvrw9\" (UniqueName: \"kubernetes.io/projected/3a73ef74-beb7-4739-aba9-d76f08a8136d-kube-api-access-gvrw9\") pod \"metrics-server-58bd9fb79f-9skxs\" (UID: \"3a73ef74-beb7-4739-aba9-d76f08a8136d\") " pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:09.915312 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.915268 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-746bfdff5f-5zsz7" podStartSLOduration=1.9152522159999998 podStartE2EDuration="1.915252216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:09.915234044 +0000 UTC m=+51.679013151" watchObservedRunningTime="2026-06-14 16:12:09.915252216 +0000 UTC m=+51.679031317" Jun 14 16:12:09.935294 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:09.935188 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k7vnp" podStartSLOduration=2.5170335919999998 podStartE2EDuration="8.935169797s" totalImagesPullingTime="6.418136205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:09.934687825 +0000 UTC m=+51.698466949" watchObservedRunningTime="2026-06-14 16:12:09.935169797 +0000 UTC m=+51.698948899" Jun 14 16:12:10.009776 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.009745 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:10.144991 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.144959 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6"] Jun 14 16:12:10.159822 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.159785 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6"] Jun 14 16:12:10.159958 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.159884 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" Jun 14 16:12:10.161709 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.161683 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hn2jl\"" Jun 14 16:12:10.161834 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.161720 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 14 16:12:10.202461 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.202408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjrg9\" (UniqueName: \"kubernetes.io/projected/4cd22690-253a-4290-b6a3-6dfeab0d78e7-kube-api-access-pjrg9\") pod \"monitoring-plugin-589576dfc7-6kcx6\" (UID: \"4cd22690-253a-4290-b6a3-6dfeab0d78e7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" Jun 14 16:12:10.202461 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.202455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4cd22690-253a-4290-b6a3-6dfeab0d78e7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-6kcx6\" (UID: \"4cd22690-253a-4290-b6a3-6dfeab0d78e7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" Jun 14 16:12:10.303092 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.303063 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjrg9\" (UniqueName: \"kubernetes.io/projected/4cd22690-253a-4290-b6a3-6dfeab0d78e7-kube-api-access-pjrg9\") pod \"monitoring-plugin-589576dfc7-6kcx6\" (UID: \"4cd22690-253a-4290-b6a3-6dfeab0d78e7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" Jun 14 16:12:10.303239 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.303117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4cd22690-253a-4290-b6a3-6dfeab0d78e7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-6kcx6\" (UID: \"4cd22690-253a-4290-b6a3-6dfeab0d78e7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" Jun 14 16:12:10.305714 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.305681 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4cd22690-253a-4290-b6a3-6dfeab0d78e7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-6kcx6\" (UID: \"4cd22690-253a-4290-b6a3-6dfeab0d78e7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" Jun 14 16:12:10.311661 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.311633 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjrg9\" (UniqueName: \"kubernetes.io/projected/4cd22690-253a-4290-b6a3-6dfeab0d78e7-kube-api-access-pjrg9\") pod \"monitoring-plugin-589576dfc7-6kcx6\" (UID: \"4cd22690-253a-4290-b6a3-6dfeab0d78e7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" Jun 14 16:12:10.470439 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.470365 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" Jun 14 16:12:10.599114 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.599081 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86879889f-vxqn6"] Jun 14 16:12:10.620926 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.620902 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86879889f-vxqn6"] Jun 14 16:12:10.621065 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.621010 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.623205 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.623175 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 14 16:12:10.623318 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.623301 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 14 16:12:10.623512 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.623467 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 14 16:12:10.623626 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.623573 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 14 16:12:10.623626 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.623581 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xztfd\"" Jun 14 16:12:10.623953 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.623938 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 14 16:12:10.629665 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.628580 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 14 16:12:10.706678 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.706652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2961d10f-85ec-4cab-bb61-cbc98722471e-metrics-client-ca\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.706983 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.706683 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2961d10f-85ec-4cab-bb61-cbc98722471e-serving-certs-ca-bundle\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.706983 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.706705 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-secret-telemeter-client\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.706983 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.706748 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft68b\" (UniqueName: \"kubernetes.io/projected/2961d10f-85ec-4cab-bb61-cbc98722471e-kube-api-access-ft68b\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.706983 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.706807 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.706983 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.706822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-telemeter-client-tls\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.706983 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.706926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2961d10f-85ec-4cab-bb61-cbc98722471e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.706983 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.706958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-federate-client-tls\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.808046 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.807979 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.808046 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.808014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-telemeter-client-tls\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.808220 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.808106 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2961d10f-85ec-4cab-bb61-cbc98722471e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.808280 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.808258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-federate-client-tls\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.808328 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.808317 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2961d10f-85ec-4cab-bb61-cbc98722471e-metrics-client-ca\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.808378 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.808346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2961d10f-85ec-4cab-bb61-cbc98722471e-serving-certs-ca-bundle\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.808378 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.808363 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-secret-telemeter-client\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.808534 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.808409 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft68b\" (UniqueName: \"kubernetes.io/projected/2961d10f-85ec-4cab-bb61-cbc98722471e-kube-api-access-ft68b\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.808937 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.808897 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2961d10f-85ec-4cab-bb61-cbc98722471e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.809040 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.809008 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2961d10f-85ec-4cab-bb61-cbc98722471e-metrics-client-ca\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.809104 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.809053 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2961d10f-85ec-4cab-bb61-cbc98722471e-serving-certs-ca-bundle\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.810717 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.810697 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-federate-client-tls\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.810932 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.810909 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-secret-telemeter-client\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.811038 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.811017 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.811082 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.811068 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2961d10f-85ec-4cab-bb61-cbc98722471e-telemeter-client-tls\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.815609 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.815585 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft68b\" (UniqueName: \"kubernetes.io/projected/2961d10f-85ec-4cab-bb61-cbc98722471e-kube-api-access-ft68b\") pod \"telemeter-client-86879889f-vxqn6\" (UID: \"2961d10f-85ec-4cab-bb61-cbc98722471e\") " pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:10.932223 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:10.932198 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" Jun 14 16:12:11.467915 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.467876 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:11.468087 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.467952 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:11.473765 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.473739 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:11.583409 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.583379 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 16:12:11.592942 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.592921 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.596054 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596013 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 16:12:11.596204 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596070 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 16:12:11.596305 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596236 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 16:12:11.596305 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596279 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 16:12:11.596485 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596378 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-drmo5q0rou8b3\"" Jun 14 16:12:11.596485 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596457 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4f4xg\"" Jun 14 16:12:11.596485 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596480 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 16:12:11.596692 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596680 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 16:12:11.596756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596688 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 16:12:11.596828 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596690 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 16:12:11.596956 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.596939 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 16:12:11.597082 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.597066 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 16:12:11.597352 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.597327 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 16:12:11.597462 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.597431 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 16:12:11.599178 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.599157 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 16:12:11.601676 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.601653 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 16:12:11.603686 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.603666 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 16:12:11.718952 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.718735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.718952 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.718775 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.718952 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.718800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.718952 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.718827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-web-config\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.718952 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.718870 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.718952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.718981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config-out\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnfmv\" (UniqueName: \"kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-kube-api-access-rnfmv\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719302 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719397 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.719497 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.719452 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.820970 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.820944 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821162 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.820975 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821162 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.820993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821162 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821162 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821162 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821162 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821111 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821188 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-web-config\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821345 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config-out\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821434 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821500 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfmv\" (UniqueName: \"kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-kube-api-access-rnfmv\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.821597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.821552 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.822387 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.822036 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.822442 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.822408 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.826111 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.825867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.831757 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.829621 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.832925 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.832385 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config-out\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.838236 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.835409 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.838236 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.836068 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.838236 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.836207 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.838236 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.836421 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.838236 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.837511 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.838897 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.838663 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.839623 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.839580 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.840884 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.840253 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-web-config\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.840884 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.840554 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.840884 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.840831 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.843018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.841814 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.843018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.842612 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.843018 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.842862 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.845829 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.844770 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.845915 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.845846 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6"] Jun 14 16:12:11.846939 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.846913 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfmv\" (UniqueName: \"kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-kube-api-access-rnfmv\") pod \"prometheus-k8s-0\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.847641 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.847588 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86879889f-vxqn6"] Jun 14 16:12:11.857917 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.857845 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58bd9fb79f-9skxs"] Jun 14 16:12:11.903531 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.903498 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:11.915880 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.915781 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerStarted","Data":"29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630"} Jun 14 16:12:11.917721 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.917665 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpnbg" event={"ID":"516759c0-a44b-48cd-88c8-4c9908808c0f","Type":"ContainerStarted","Data":"28f5bf1174aaaa0be80c61393b6fdcff654f9b8e618d29e15c96b989054bdcbe"} Jun 14 16:12:11.919590 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.919565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" event={"ID":"7c77c569-3eac-4875-b566-6a3c1125d51a","Type":"ContainerStarted","Data":"14787f95b9794d3874dc74ba625aa86774da3d7ce6e878c43d33c0b4da85e11e"} Jun 14 16:12:11.923977 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:11.923957 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:12.037452 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:12.037185 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd22690_253a_4290_b6a3_6dfeab0d78e7.slice/crio-b2c7a87eda5c49cf7446161c761dc54d72addad5148c7613ebf79c7431e1fe45 WatchSource:0}: Error finding container b2c7a87eda5c49cf7446161c761dc54d72addad5148c7613ebf79c7431e1fe45: Status 404 returned error can't find the container with id b2c7a87eda5c49cf7446161c761dc54d72addad5148c7613ebf79c7431e1fe45 Jun 14 16:12:12.038940 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:12.038469 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2961d10f_85ec_4cab_bb61_cbc98722471e.slice/crio-3c0cc91272dd53a2157b49c5baf08b0bd5635447004f3f3245263f5698e28682 WatchSource:0}: Error finding container 3c0cc91272dd53a2157b49c5baf08b0bd5635447004f3f3245263f5698e28682: Status 404 returned error can't find the container with id 3c0cc91272dd53a2157b49c5baf08b0bd5635447004f3f3245263f5698e28682 Jun 14 16:12:12.039713 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:12.039689 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a73ef74_beb7_4739_aba9_d76f08a8136d.slice/crio-7e7c9cb96a9d3f6ccdeb68e17a2028c5302e6b3ac611599f0bf5296e5fac6916 WatchSource:0}: Error finding container 7e7c9cb96a9d3f6ccdeb68e17a2028c5302e6b3ac611599f0bf5296e5fac6916: Status 404 returned error can't find the container with id 7e7c9cb96a9d3f6ccdeb68e17a2028c5302e6b3ac611599f0bf5296e5fac6916 Jun 14 16:12:12.549937 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.549913 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 16:12:12.553240 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:12.553213 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9401c4_c5fb_45e0_b7ae_1d9365724fca.slice/crio-272f6ff7aa44d39ebb96476addb4cba4137f5572fb14ca1eac6d8fd6016730ce WatchSource:0}: Error finding container 272f6ff7aa44d39ebb96476addb4cba4137f5572fb14ca1eac6d8fd6016730ce: Status 404 returned error can't find the container with id 272f6ff7aa44d39ebb96476addb4cba4137f5572fb14ca1eac6d8fd6016730ce Jun 14 16:12:12.928531 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.928265 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" event={"ID":"432fb1a7-a2dc-46f4-8099-f79e85de3c5f","Type":"ContainerStarted","Data":"35f54f5e4f5c609ccf0f12cc764ec1e5e518b88203162a4ed9bf93bd54f14f6c"} Jun 14 16:12:12.929592 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.928574 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" event={"ID":"432fb1a7-a2dc-46f4-8099-f79e85de3c5f","Type":"ContainerStarted","Data":"5344607c9adb0cdca5aea8831bf739402392fea122326c5238ff83d769f6f122"} Jun 14 16:12:12.929592 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.928744 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" event={"ID":"432fb1a7-a2dc-46f4-8099-f79e85de3c5f","Type":"ContainerStarted","Data":"b0b08efda7c6f210f6ddc18ccde99f6b0c2d703e12fe7aa0f4c540b0edda27ec"} Jun 14 16:12:12.930484 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.930418 2575 generic.go:356] "Generic (PLEG): container finished" podID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerID="29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630" exitCode=0 Jun 14 16:12:12.930597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.930454 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerDied","Data":"29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630"} Jun 14 16:12:12.933193 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.933166 2575 generic.go:356] "Generic (PLEG): container finished" podID="516759c0-a44b-48cd-88c8-4c9908808c0f" containerID="28f5bf1174aaaa0be80c61393b6fdcff654f9b8e618d29e15c96b989054bdcbe" exitCode=0 Jun 14 16:12:12.933287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.933249 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpnbg" event={"ID":"516759c0-a44b-48cd-88c8-4c9908808c0f","Type":"ContainerDied","Data":"28f5bf1174aaaa0be80c61393b6fdcff654f9b8e618d29e15c96b989054bdcbe"} Jun 14 16:12:12.936504 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.936292 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fpq27" event={"ID":"e140c399-d1d1-420b-9375-51e3a6aa6501","Type":"ContainerStarted","Data":"a1811f9a5236e2409c6d513876b073ecbb63a29e8b92c3b88699784d033fa0f9"} Jun 14 16:12:12.939076 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.938989 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" event={"ID":"7c77c569-3eac-4875-b566-6a3c1125d51a","Type":"ContainerStarted","Data":"85a07c64932f9eba6ae22d786cb1a43bb83096ef4a216d3786056e37e2d46b0f"} Jun 14 16:12:12.939076 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.939041 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" event={"ID":"7c77c569-3eac-4875-b566-6a3c1125d51a","Type":"ContainerStarted","Data":"37ddbbac2789a6e8e486a364b6a3a94b9a2c914271a832759c59d38d436a57e4"} Jun 14 16:12:12.940831 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.940803 2575 generic.go:356] "Generic (PLEG): container finished" podID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerID="563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa" exitCode=0 Jun 14 16:12:12.940927 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.940879 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerDied","Data":"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa"} Jun 14 16:12:12.940982 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.940932 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerStarted","Data":"272f6ff7aa44d39ebb96476addb4cba4137f5572fb14ca1eac6d8fd6016730ce"} Jun 14 16:12:12.942979 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.942943 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" event={"ID":"2961d10f-85ec-4cab-bb61-cbc98722471e","Type":"ContainerStarted","Data":"3c0cc91272dd53a2157b49c5baf08b0bd5635447004f3f3245263f5698e28682"} Jun 14 16:12:12.945644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.945616 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" event={"ID":"de2ac286-314a-476e-bec4-fd5435ff4300","Type":"ContainerStarted","Data":"e4fb5aa819b1601b9fa5c924cb3456a2677d321dc1a282824370690ade3d4dde"} Jun 14 16:12:12.947516 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.947123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" event={"ID":"3a73ef74-beb7-4739-aba9-d76f08a8136d","Type":"ContainerStarted","Data":"7e7c9cb96a9d3f6ccdeb68e17a2028c5302e6b3ac611599f0bf5296e5fac6916"} Jun 14 16:12:12.953280 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.952192 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" event={"ID":"4cd22690-253a-4290-b6a3-6dfeab0d78e7","Type":"ContainerStarted","Data":"b2c7a87eda5c49cf7446161c761dc54d72addad5148c7613ebf79c7431e1fe45"} Jun 14 16:12:12.978034 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:12.977989 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rww2w" podStartSLOduration=4.859385521 podStartE2EDuration="7.97797345s" totalImagesPullingTime="3.118587929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:12.976563707 +0000 UTC m=+54.740342809" watchObservedRunningTime="2026-06-14 16:12:12.97797345 +0000 UTC m=+54.741752550" Jun 14 16:12:13.010842 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:13.010574 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-km5h6" podStartSLOduration=4.663711081 podStartE2EDuration="8.010554957s" totalImagesPullingTime="3.346843876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:13.010063845 +0000 UTC m=+54.773842949" watchObservedRunningTime="2026-06-14 16:12:13.010554957 +0000 UTC m=+54.774334059" Jun 14 16:12:13.962714 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:13.962654 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpnbg" event={"ID":"516759c0-a44b-48cd-88c8-4c9908808c0f","Type":"ContainerStarted","Data":"0dbe790b81fdb9b15d5a3d0df9d236920bff190c96e24a53fa8720faa4d2f205"} Jun 14 16:12:13.962714 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:13.962714 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpnbg" event={"ID":"516759c0-a44b-48cd-88c8-4c9908808c0f","Type":"ContainerStarted","Data":"b0e38f39b2668a77ad49bcda8f29023c37cf173c14ced6b941dd8fcd49870046"} Jun 14 16:12:13.984199 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:13.983859 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dpnbg" podStartSLOduration=5.753127957 podStartE2EDuration="8.983837297s" totalImagesPullingTime="3.10716913s" totalInitContainerRuntime="123.54021ms" isStatefulPod=true podCreationTimestamp="2026-06-14 16:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:13.982126454 +0000 UTC m=+55.745905581" watchObservedRunningTime="2026-06-14 16:12:13.983837297 +0000 UTC m=+55.747616402" Jun 14 16:12:14.492227 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.492065 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746bfdff5f-5zsz7"] Jun 14 16:12:14.520267 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.520237 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f7c5d55b5-4kpc2"] Jun 14 16:12:14.522874 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.522843 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.536915 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.536886 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7c5d55b5-4kpc2"] Jun 14 16:12:14.656308 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.656262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-console-config\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.656451 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.656336 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-oauth-config\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.656451 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.656413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-service-ca\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.656451 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.656436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-trusted-ca-bundle\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.656601 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.656457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-oauth-serving-cert\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.656601 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.656490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-serving-cert\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.656601 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.656554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb4sv\" (UniqueName: \"kubernetes.io/projected/79a11754-19e2-405c-b144-aefc180cf578-kube-api-access-rb4sv\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.757475 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.757393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-console-config\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.757475 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.757472 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-oauth-config\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.757695 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.757532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-service-ca\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.757695 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.757551 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-trusted-ca-bundle\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.757695 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.757673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-oauth-serving-cert\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.757828 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.757740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-serving-cert\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.757828 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.757772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4sv\" (UniqueName: \"kubernetes.io/projected/79a11754-19e2-405c-b144-aefc180cf578-kube-api-access-rb4sv\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.758310 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.758259 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-service-ca\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.758310 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.758299 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-console-config\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.758481 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.758437 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-oauth-serving-cert\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.758555 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.758532 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-trusted-ca-bundle\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.761052 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.761026 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-oauth-config\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.761249 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.761223 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-serving-cert\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.765285 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.765260 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb4sv\" (UniqueName: \"kubernetes.io/projected/79a11754-19e2-405c-b144-aefc180cf578-kube-api-access-rb4sv\") pod \"console-5f7c5d55b5-4kpc2\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:14.838291 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:14.838253 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:17.243056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.242685 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7c5d55b5-4kpc2"] Jun 14 16:12:17.248215 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:17.247667 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a11754_19e2_405c_b144_aefc180cf578.slice/crio-71d71d549dbca214732c876888f8aa89d6b03a38a2f3e067fee9544829fbbcb2 WatchSource:0}: Error finding container 71d71d549dbca214732c876888f8aa89d6b03a38a2f3e067fee9544829fbbcb2: Status 404 returned error can't find the container with id 71d71d549dbca214732c876888f8aa89d6b03a38a2f3e067fee9544829fbbcb2 Jun 14 16:12:17.984756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.984727 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" event={"ID":"432fb1a7-a2dc-46f4-8099-f79e85de3c5f","Type":"ContainerStarted","Data":"9c4a960b740f401d5eef966ecd163c8f1e6c30e0ba3d12592b8f11c66f0c9cf6"} Jun 14 16:12:17.984941 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.984801 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" event={"ID":"432fb1a7-a2dc-46f4-8099-f79e85de3c5f","Type":"ContainerStarted","Data":"2bea8feddba1bade1e79604d3d4a5b2c79824b83254f4c3bd7b37c99efe29559"} Jun 14 16:12:17.984941 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.984838 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" event={"ID":"432fb1a7-a2dc-46f4-8099-f79e85de3c5f","Type":"ContainerStarted","Data":"04131019e69180953a06daa5c87b9bedeb5b99f9d3ae7ec7d0381da754d64c78"} Jun 14 16:12:17.985060 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.985022 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:17.988988 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.988963 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerStarted","Data":"ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e"} Jun 14 16:12:17.989106 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.989023 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerStarted","Data":"c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2"} Jun 14 16:12:17.989106 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.989069 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerStarted","Data":"1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0"} Jun 14 16:12:17.989228 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.989108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerStarted","Data":"d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b"} Jun 14 16:12:17.989228 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.989180 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerStarted","Data":"c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c"} Jun 14 16:12:17.989228 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.989221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerStarted","Data":"80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77"} Jun 14 16:12:17.991591 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.991548 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fpq27" event={"ID":"e140c399-d1d1-420b-9375-51e3a6aa6501","Type":"ContainerStarted","Data":"9165e12c651c13807531a791a5f8c086236480c6b3221bb96c50967652eb5012"} Jun 14 16:12:17.992557 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.992537 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" Jun 14 16:12:17.995010 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.994987 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerStarted","Data":"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da"} Jun 14 16:12:17.995127 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.995038 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerStarted","Data":"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e"} Jun 14 16:12:17.995127 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.995066 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerStarted","Data":"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6"} Jun 14 16:12:17.995127 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.995091 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerStarted","Data":"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7"} Jun 14 16:12:17.995127 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.995115 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerStarted","Data":"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13"} Jun 14 16:12:17.995363 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.995167 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerStarted","Data":"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c"} Jun 14 16:12:17.996874 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.996849 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" event={"ID":"2961d10f-85ec-4cab-bb61-cbc98722471e","Type":"ContainerStarted","Data":"886b0e173cbcb0d0f72106ae716ee40fa024ed3eadfea54e5ae040d847e553f3"} Jun 14 16:12:17.996966 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.996893 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" event={"ID":"2961d10f-85ec-4cab-bb61-cbc98722471e","Type":"ContainerStarted","Data":"fd659ee81ed103460bc7ac819edf5bf4f3aa81acdd418071566f950701d22f7f"} Jun 14 16:12:17.996966 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.996917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" event={"ID":"2961d10f-85ec-4cab-bb61-cbc98722471e","Type":"ContainerStarted","Data":"118fc5e8315895263772e0c686b28a84bb49d6c4762c7ae9b1a992b752c6b018"} Jun 14 16:12:17.998378 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:17.998356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" event={"ID":"3a73ef74-beb7-4739-aba9-d76f08a8136d","Type":"ContainerStarted","Data":"3c74a9d3b8f5c37b5ead4180f76fe2f7e298b365cfee0eeac92fa966d78e1eb6"} Jun 14 16:12:18.000044 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.000024 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" event={"ID":"4cd22690-253a-4290-b6a3-6dfeab0d78e7","Type":"ContainerStarted","Data":"65779a4554cb12eb3aeb8f0343a707c67a3ab5376304409bb68bc72c60219843"} Jun 14 16:12:18.000256 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.000238 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" Jun 14 16:12:18.006946 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.006925 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" Jun 14 16:12:18.007074 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.007053 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7c5d55b5-4kpc2" event={"ID":"79a11754-19e2-405c-b144-aefc180cf578","Type":"ContainerStarted","Data":"88eddf8961dab2ad4da64b034f87e51dcfa26d0e53d1d6e43ab55deb1605ed09"} Jun 14 16:12:18.007119 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.007091 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7c5d55b5-4kpc2" event={"ID":"79a11754-19e2-405c-b144-aefc180cf578","Type":"ContainerStarted","Data":"71d71d549dbca214732c876888f8aa89d6b03a38a2f3e067fee9544829fbbcb2"} Jun 14 16:12:18.019568 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.019532 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86bf47dd4d-zppbn" podStartSLOduration=3.060338536 podStartE2EDuration="11.019519819s" totalImagesPullingTime="7.959181283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:18.019204834 +0000 UTC m=+59.782983933" watchObservedRunningTime="2026-06-14 16:12:18.019519819 +0000 UTC m=+59.783298983" Jun 14 16:12:18.039402 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.039359 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fpq27" podStartSLOduration=1.9642568740000002 podStartE2EDuration="17.039341721s" totalImagesPullingTime="15.075084847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:12:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:18.038984374 +0000 UTC m=+59.802763494" watchObservedRunningTime="2026-06-14 16:12:18.039341721 +0000 UTC m=+59.803120822" Jun 14 16:12:18.056230 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.056114 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" podStartSLOduration=4.032389019 podStartE2EDuration="9.056099649s" totalImagesPullingTime="5.02371063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:18.055725768 +0000 UTC m=+59.819504861" watchObservedRunningTime="2026-06-14 16:12:18.056099649 +0000 UTC m=+59.819878750" Jun 14 16:12:18.088264 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.088218 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.904080954 podStartE2EDuration="7.088200176s" totalImagesPullingTime="4.160150629s" totalInitContainerRuntime="23.968593ms" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:18.087840307 +0000 UTC m=+59.851619409" watchObservedRunningTime="2026-06-14 16:12:18.088200176 +0000 UTC m=+59.851979277" Jun 14 16:12:18.126778 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.126720 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f7c5d55b5-4kpc2" podStartSLOduration=4.126701014 podStartE2EDuration="4.126701014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:18.125647766 +0000 UTC m=+59.889426867" watchObservedRunningTime="2026-06-14 16:12:18.126701014 +0000 UTC m=+59.890480116" Jun 14 16:12:18.151675 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.151632 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.024185801 podStartE2EDuration="12.151613507s" totalImagesPullingTime="7.087451533s" totalInitContainerRuntime="39.976173ms" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:18.149606045 +0000 UTC m=+59.913385164" watchObservedRunningTime="2026-06-14 16:12:18.151613507 +0000 UTC m=+59.915392606" Jun 14 16:12:18.175500 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.175449 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86879889f-vxqn6" podStartSLOduration=3.137299583 podStartE2EDuration="8.175435135s" totalImagesPullingTime="5.038135552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:18.173814655 +0000 UTC m=+59.937593775" watchObservedRunningTime="2026-06-14 16:12:18.175435135 +0000 UTC m=+59.939214235" Jun 14 16:12:18.198610 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.198558 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-6kcx6" podStartSLOduration=3.17421346 podStartE2EDuration="8.198540806s" totalImagesPullingTime="5.024327346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:18.198006713 +0000 UTC m=+59.961785814" watchObservedRunningTime="2026-06-14 16:12:18.198540806 +0000 UTC m=+59.962319904" Jun 14 16:12:18.608289 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.608265 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:18.952896 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.952863 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7c5d55b5-4kpc2"] Jun 14 16:12:18.981640 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:18.981607 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b6f9b895f-lg5q7"] Jun 14 16:12:19.014616 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.014589 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b6f9b895f-lg5q7"] Jun 14 16:12:19.014738 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.014669 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.103489 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.103459 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-oauth-config\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.103656 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.103494 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-oauth-serving-cert\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.103824 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.103800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-console-config\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.103958 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.103935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-trusted-ca-bundle\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.104057 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.103965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtc29\" (UniqueName: \"kubernetes.io/projected/824db01c-7a60-430e-80ab-7c64256d63f9-kube-api-access-jtc29\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.104361 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.104337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-service-ca\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.105232 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.105206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-serving-cert\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.207350 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.207283 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-serving-cert\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.207481 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.207352 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-oauth-config\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.207481 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.207367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-oauth-serving-cert\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.207481 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.207396 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-console-config\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.207481 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.207412 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-trusted-ca-bundle\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.207481 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.207428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtc29\" (UniqueName: \"kubernetes.io/projected/824db01c-7a60-430e-80ab-7c64256d63f9-kube-api-access-jtc29\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.207730 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.207485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-service-ca\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.208120 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.208092 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-console-config\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.208239 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.208165 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-oauth-serving-cert\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.208377 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.208356 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-service-ca\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.208416 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.208404 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-trusted-ca-bundle\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.209956 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.209937 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-oauth-config\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.210015 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.209953 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-serving-cert\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.214859 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.214839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtc29\" (UniqueName: \"kubernetes.io/projected/824db01c-7a60-430e-80ab-7c64256d63f9-kube-api-access-jtc29\") pod \"console-5b6f9b895f-lg5q7\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.323646 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.323614 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:19.478081 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.478058 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b6f9b895f-lg5q7"] Jun 14 16:12:19.480476 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:19.480447 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824db01c_7a60_430e_80ab_7c64256d63f9.slice/crio-bf3f2f15948ec47db0f77a80d4e3ab642dc6be09c548d4356d9efcb5c577ccbb WatchSource:0}: Error finding container bf3f2f15948ec47db0f77a80d4e3ab642dc6be09c548d4356d9efcb5c577ccbb: Status 404 returned error can't find the container with id bf3f2f15948ec47db0f77a80d4e3ab642dc6be09c548d4356d9efcb5c577ccbb Jun 14 16:12:19.829736 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.829675 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjbzj" Jun 14 16:12:19.912153 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:19.912114 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k7vnp" Jun 14 16:12:20.017392 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:20.017357 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6f9b895f-lg5q7" event={"ID":"824db01c-7a60-430e-80ab-7c64256d63f9","Type":"ContainerStarted","Data":"73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b"} Jun 14 16:12:20.017573 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:20.017408 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6f9b895f-lg5q7" event={"ID":"824db01c-7a60-430e-80ab-7c64256d63f9","Type":"ContainerStarted","Data":"bf3f2f15948ec47db0f77a80d4e3ab642dc6be09c548d4356d9efcb5c577ccbb"} Jun 14 16:12:20.060857 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:20.060809 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b6f9b895f-lg5q7" podStartSLOduration=2.060794329 podStartE2EDuration="2.060794329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:20.058250455 +0000 UTC m=+61.822029572" watchObservedRunningTime="2026-06-14 16:12:20.060794329 +0000 UTC m=+61.824573429" Jun 14 16:12:21.903995 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:21.903959 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:22.869421 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:22.869394 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b9b46c595-cxmzr" Jun 14 16:12:24.354364 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.354325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:12:24.356610 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.356591 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 16:12:24.367139 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.367118 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3541cb76-3850-4307-95a7-ad4356fb71f1-metrics-certs\") pod \"network-metrics-daemon-kzd85\" (UID: \"3541cb76-3850-4307-95a7-ad4356fb71f1\") " pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:12:24.455179 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.455129 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:12:24.457596 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.457578 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 16:12:24.466967 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.466945 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wn2pg\"" Jun 14 16:12:24.468268 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.468247 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b85971-813a-4b24-b5f4-4ab6ad5b5516-original-pull-secret\") pod \"global-pull-secret-syncer-28jlf\" (UID: \"83b85971-813a-4b24-b5f4-4ab6ad5b5516\") " pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:12:24.472452 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.472440 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28jlf" Jun 14 16:12:24.475182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.475166 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kzd85" Jun 14 16:12:24.555910 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.555879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fp8\" (UniqueName: \"kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8\") pod \"network-check-target-dbr5w\" (UID: \"4d7d3a64-2b45-427e-8090-302c6f730801\") " pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:12:24.558094 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.558072 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 16:12:24.568388 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.568349 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 16:12:24.579553 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.579525 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6fp8\" (UniqueName: \"kubernetes.io/projected/4d7d3a64-2b45-427e-8090-302c6f730801-kube-api-access-p6fp8\") pod \"network-check-target-dbr5w\" (UID: \"4d7d3a64-2b45-427e-8090-302c6f730801\") " pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:12:24.611644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.611567 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-28jlf"] Jun 14 16:12:24.613993 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:24.613967 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b85971_813a_4b24_b5f4_4ab6ad5b5516.slice/crio-1ccd4258bd227e199c1512867b68ff47aff62f41fa65e1055af0fe6de65e2369 WatchSource:0}: Error finding container 1ccd4258bd227e199c1512867b68ff47aff62f41fa65e1055af0fe6de65e2369: Status 404 returned error can't find the container with id 1ccd4258bd227e199c1512867b68ff47aff62f41fa65e1055af0fe6de65e2369 Jun 14 16:12:24.635091 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.635071 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kzd85"] Jun 14 16:12:24.636971 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:24.636948 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3541cb76_3850_4307_95a7_ad4356fb71f1.slice/crio-6f4acb3bfddeef963d8b522f426c91bd786ff57059270f3cabc048b1decfaeba WatchSource:0}: Error finding container 6f4acb3bfddeef963d8b522f426c91bd786ff57059270f3cabc048b1decfaeba: Status 404 returned error can't find the container with id 6f4acb3bfddeef963d8b522f426c91bd786ff57059270f3cabc048b1decfaeba Jun 14 16:12:24.782337 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.782310 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tb9hf\"" Jun 14 16:12:24.790901 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.790881 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:12:24.838529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.838469 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:24.914389 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:24.914293 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dbr5w"] Jun 14 16:12:24.916592 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:12:24.916557 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7d3a64_2b45_427e_8090_302c6f730801.slice/crio-2d341dd4a21c6e46a0f779307b87fa089f6128c001fe1f2041c029bdbcbb35a8 WatchSource:0}: Error finding container 2d341dd4a21c6e46a0f779307b87fa089f6128c001fe1f2041c029bdbcbb35a8: Status 404 returned error can't find the container with id 2d341dd4a21c6e46a0f779307b87fa089f6128c001fe1f2041c029bdbcbb35a8 Jun 14 16:12:25.040432 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:25.040403 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-28jlf" event={"ID":"83b85971-813a-4b24-b5f4-4ab6ad5b5516","Type":"ContainerStarted","Data":"1ccd4258bd227e199c1512867b68ff47aff62f41fa65e1055af0fe6de65e2369"} Jun 14 16:12:25.041542 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:25.041518 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dbr5w" event={"ID":"4d7d3a64-2b45-427e-8090-302c6f730801","Type":"ContainerStarted","Data":"2d341dd4a21c6e46a0f779307b87fa089f6128c001fe1f2041c029bdbcbb35a8"} Jun 14 16:12:25.042545 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:25.042526 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kzd85" event={"ID":"3541cb76-3850-4307-95a7-ad4356fb71f1","Type":"ContainerStarted","Data":"6f4acb3bfddeef963d8b522f426c91bd786ff57059270f3cabc048b1decfaeba"} Jun 14 16:12:26.052517 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:26.052484 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kzd85" event={"ID":"3541cb76-3850-4307-95a7-ad4356fb71f1","Type":"ContainerStarted","Data":"57a2e20788c7a13d47d1c9ff263e35a1a1a4bb329317da6ae65f2cc7df249269"} Jun 14 16:12:27.060312 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:27.060238 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kzd85" event={"ID":"3541cb76-3850-4307-95a7-ad4356fb71f1","Type":"ContainerStarted","Data":"7d7a46fe112a58a299732fdb6fa7063c39426741fbcb9f6b68fdbb272c4415b9"} Jun 14 16:12:27.076588 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:27.076420 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kzd85" podStartSLOduration=67.849194104 podStartE2EDuration="1m9.076401471s" totalImagesPullingTime="1.227207367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:27.074318543 +0000 UTC m=+68.838097644" watchObservedRunningTime="2026-06-14 16:12:27.076401471 +0000 UTC m=+68.840180571" Jun 14 16:12:29.324479 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:29.324434 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:29.324946 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:29.324514 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:29.330503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:29.330475 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:30.010425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:30.010396 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:30.010566 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:30.010451 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:30.080981 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:30.080942 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-28jlf" event={"ID":"83b85971-813a-4b24-b5f4-4ab6ad5b5516","Type":"ContainerStarted","Data":"6aaa3500a47e804420a832087065ba2a372b865cac8f7604df6c2509ae6063aa"} Jun 14 16:12:30.082749 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:30.082719 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dbr5w" event={"ID":"4d7d3a64-2b45-427e-8090-302c6f730801","Type":"ContainerStarted","Data":"2696374c525585c1aebf99577cbbaa114154069c343ddfcd1c283b6958a3127f"} Jun 14 16:12:30.082864 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:30.082802 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:12:30.086717 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:30.086695 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:12:30.095547 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:30.095508 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-28jlf" podStartSLOduration=66.294223348 podStartE2EDuration="1m11.09549613s" totalImagesPullingTime="4.801272782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:30.094504713 +0000 UTC m=+71.858283805" watchObservedRunningTime="2026-06-14 16:12:30.09549613 +0000 UTC m=+71.859275230" Jun 14 16:12:30.109194 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:30.109154 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dbr5w" podStartSLOduration=67.613460714 podStartE2EDuration="1m12.109125809s" totalImagesPullingTime="4.495665095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:12:30.107243524 +0000 UTC m=+71.871022623" watchObservedRunningTime="2026-06-14 16:12:30.109125809 +0000 UTC m=+71.872904953" Jun 14 16:12:30.150262 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:30.150241 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9cbc59c96-d9srt"] Jun 14 16:12:37.765403 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:37.765371 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j4t6v_90f350e0-294f-4aa6-a04a-d201ccfe6c18/serve-healthcheck-canary/0.log" Jun 14 16:12:39.516948 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:39.516904 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-746bfdff5f-5zsz7" podUID="fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" containerName="console" containerID="cri-o://f418178f5a62a7f89833cfdbd5b4f8bc3f0a910c17e2baaf815bcff46775d0ed" gracePeriod=15 Jun 14 16:12:40.128732 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.128701 2575 generic.go:356] "Generic (PLEG): container finished" podID="fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" containerID="f418178f5a62a7f89833cfdbd5b4f8bc3f0a910c17e2baaf815bcff46775d0ed" exitCode=0 Jun 14 16:12:40.128960 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.128771 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746bfdff5f-5zsz7" event={"ID":"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a","Type":"ContainerDied","Data":"f418178f5a62a7f89833cfdbd5b4f8bc3f0a910c17e2baaf815bcff46775d0ed"} Jun 14 16:12:40.286393 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.286365 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:40.303183 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.303121 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-service-ca\") pod \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " Jun 14 16:12:40.303463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.303190 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-oauth-config\") pod \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " Jun 14 16:12:40.303463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.303239 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-config\") pod \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " Jun 14 16:12:40.303463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.303283 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-trusted-ca-bundle\") pod \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " Jun 14 16:12:40.303463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.303413 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg7lp\" (UniqueName: \"kubernetes.io/projected/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-kube-api-access-wg7lp\") pod \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " Jun 14 16:12:40.303463 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.303454 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-serving-cert\") pod \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " Jun 14 16:12:40.303724 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.303581 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-oauth-serving-cert\") pod \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\" (UID: \"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a\") " Jun 14 16:12:40.303985 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.303947 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-config" (OuterVolumeSpecName: "console-config") pod "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" (UID: "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:40.304451 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.304305 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" (UID: "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:40.304451 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.304362 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" (UID: "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:40.304766 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.304737 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" (UID: "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:40.306945 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.306901 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" (UID: "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:12:40.307052 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.307024 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-kube-api-access-wg7lp" (OuterVolumeSpecName: "kube-api-access-wg7lp") pod "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" (UID: "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a"). InnerVolumeSpecName "kube-api-access-wg7lp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:12:40.307115 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.307061 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" (UID: "fd0f7df9-ef76-48bf-bd8e-6922d5ec457a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:12:40.404564 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.404540 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg7lp\" (UniqueName: \"kubernetes.io/projected/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-kube-api-access-wg7lp\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:40.404564 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.404563 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-serving-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:40.404721 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.404572 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-oauth-serving-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:40.404721 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.404582 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-service-ca\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:40.404721 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.404591 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-oauth-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:40.404721 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.404598 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-console-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:40.404721 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:40.404607 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a-trusted-ca-bundle\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:41.134289 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:41.134261 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746bfdff5f-5zsz7" Jun 14 16:12:41.134678 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:41.134292 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746bfdff5f-5zsz7" event={"ID":"fd0f7df9-ef76-48bf-bd8e-6922d5ec457a","Type":"ContainerDied","Data":"cd53ae8bfaa690a34acf5172a45c093735395dec93ff7677c380d5e15c9e026a"} Jun 14 16:12:41.134678 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:41.134344 2575 scope.go:117] "RemoveContainer" containerID="f418178f5a62a7f89833cfdbd5b4f8bc3f0a910c17e2baaf815bcff46775d0ed" Jun 14 16:12:41.149443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:41.149419 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746bfdff5f-5zsz7"] Jun 14 16:12:41.154491 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:41.154470 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-746bfdff5f-5zsz7"] Jun 14 16:12:42.649521 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:42.649490 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" path="/var/lib/kubelet/pods/fd0f7df9-ef76-48bf-bd8e-6922d5ec457a/volumes" Jun 14 16:12:45.036811 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.036767 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f7c5d55b5-4kpc2" podUID="79a11754-19e2-405c-b144-aefc180cf578" containerName="console" containerID="cri-o://88eddf8961dab2ad4da64b034f87e51dcfa26d0e53d1d6e43ab55deb1605ed09" gracePeriod=15 Jun 14 16:12:45.153740 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.153709 2575 generic.go:356] "Generic (PLEG): container finished" podID="79a11754-19e2-405c-b144-aefc180cf578" containerID="88eddf8961dab2ad4da64b034f87e51dcfa26d0e53d1d6e43ab55deb1605ed09" exitCode=0 Jun 14 16:12:45.153879 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.153786 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7c5d55b5-4kpc2" event={"ID":"79a11754-19e2-405c-b144-aefc180cf578","Type":"ContainerDied","Data":"88eddf8961dab2ad4da64b034f87e51dcfa26d0e53d1d6e43ab55deb1605ed09"} Jun 14 16:12:45.324601 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.324564 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:45.349651 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.349625 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-serving-cert\") pod \"79a11754-19e2-405c-b144-aefc180cf578\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " Jun 14 16:12:45.349809 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.349689 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-service-ca\") pod \"79a11754-19e2-405c-b144-aefc180cf578\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " Jun 14 16:12:45.349809 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.349719 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb4sv\" (UniqueName: \"kubernetes.io/projected/79a11754-19e2-405c-b144-aefc180cf578-kube-api-access-rb4sv\") pod \"79a11754-19e2-405c-b144-aefc180cf578\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " Jun 14 16:12:45.349809 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.349760 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-oauth-serving-cert\") pod \"79a11754-19e2-405c-b144-aefc180cf578\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " Jun 14 16:12:45.349979 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.349897 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-console-config\") pod \"79a11754-19e2-405c-b144-aefc180cf578\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " Jun 14 16:12:45.349979 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.349961 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-oauth-config\") pod \"79a11754-19e2-405c-b144-aefc180cf578\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " Jun 14 16:12:45.350083 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.350017 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-trusted-ca-bundle\") pod \"79a11754-19e2-405c-b144-aefc180cf578\" (UID: \"79a11754-19e2-405c-b144-aefc180cf578\") " Jun 14 16:12:45.350202 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.350179 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-service-ca" (OuterVolumeSpecName: "service-ca") pod "79a11754-19e2-405c-b144-aefc180cf578" (UID: "79a11754-19e2-405c-b144-aefc180cf578"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:45.350326 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.350306 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79a11754-19e2-405c-b144-aefc180cf578" (UID: "79a11754-19e2-405c-b144-aefc180cf578"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:45.350428 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.350406 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-service-ca\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:45.350514 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.350476 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-console-config" (OuterVolumeSpecName: "console-config") pod "79a11754-19e2-405c-b144-aefc180cf578" (UID: "79a11754-19e2-405c-b144-aefc180cf578"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:45.350586 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.350564 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "79a11754-19e2-405c-b144-aefc180cf578" (UID: "79a11754-19e2-405c-b144-aefc180cf578"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:45.352070 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.352035 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79a11754-19e2-405c-b144-aefc180cf578-kube-api-access-rb4sv" (OuterVolumeSpecName: "kube-api-access-rb4sv") pod "79a11754-19e2-405c-b144-aefc180cf578" (UID: "79a11754-19e2-405c-b144-aefc180cf578"). InnerVolumeSpecName "kube-api-access-rb4sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:12:45.352220 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.352114 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79a11754-19e2-405c-b144-aefc180cf578" (UID: "79a11754-19e2-405c-b144-aefc180cf578"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:12:45.352361 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.352343 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79a11754-19e2-405c-b144-aefc180cf578" (UID: "79a11754-19e2-405c-b144-aefc180cf578"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:12:45.451806 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.451774 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb4sv\" (UniqueName: \"kubernetes.io/projected/79a11754-19e2-405c-b144-aefc180cf578-kube-api-access-rb4sv\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:45.451806 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.451799 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-oauth-serving-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:45.451806 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.451811 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-console-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:45.452006 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.451820 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-oauth-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:45.452006 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.451829 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79a11754-19e2-405c-b144-aefc180cf578-trusted-ca-bundle\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:45.452006 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:45.451838 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79a11754-19e2-405c-b144-aefc180cf578-console-serving-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:46.159281 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:46.159251 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7c5d55b5-4kpc2" Jun 14 16:12:46.159730 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:46.159255 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7c5d55b5-4kpc2" event={"ID":"79a11754-19e2-405c-b144-aefc180cf578","Type":"ContainerDied","Data":"71d71d549dbca214732c876888f8aa89d6b03a38a2f3e067fee9544829fbbcb2"} Jun 14 16:12:46.159730 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:46.159371 2575 scope.go:117] "RemoveContainer" containerID="88eddf8961dab2ad4da64b034f87e51dcfa26d0e53d1d6e43ab55deb1605ed09" Jun 14 16:12:46.182294 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:46.182271 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7c5d55b5-4kpc2"] Jun 14 16:12:46.186947 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:46.186909 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f7c5d55b5-4kpc2"] Jun 14 16:12:46.649247 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:46.649214 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79a11754-19e2-405c-b144-aefc180cf578" path="/var/lib/kubelet/pods/79a11754-19e2-405c-b144-aefc180cf578/volumes" Jun 14 16:12:50.015670 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:50.015637 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:50.020058 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:50.020033 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58bd9fb79f-9skxs" Jun 14 16:12:55.174371 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.174328 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9cbc59c96-d9srt" podUID="978e6708-182d-4716-8db1-eed9af2812da" containerName="console" containerID="cri-o://732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610" gracePeriod=15 Jun 14 16:12:55.420819 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.420794 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:55.547840 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.547762 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-oauth-serving-cert\") pod \"978e6708-182d-4716-8db1-eed9af2812da\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " Jun 14 16:12:55.547840 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.547797 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-console-config\") pod \"978e6708-182d-4716-8db1-eed9af2812da\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " Jun 14 16:12:55.547840 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.547832 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-oauth-config\") pod \"978e6708-182d-4716-8db1-eed9af2812da\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " Jun 14 16:12:55.548103 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.547967 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tj9g\" (UniqueName: \"kubernetes.io/projected/978e6708-182d-4716-8db1-eed9af2812da-kube-api-access-9tj9g\") pod \"978e6708-182d-4716-8db1-eed9af2812da\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " Jun 14 16:12:55.548103 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.548012 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-serving-cert\") pod \"978e6708-182d-4716-8db1-eed9af2812da\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " Jun 14 16:12:55.548223 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.548111 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-service-ca\") pod \"978e6708-182d-4716-8db1-eed9af2812da\" (UID: \"978e6708-182d-4716-8db1-eed9af2812da\") " Jun 14 16:12:55.548270 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.548229 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-console-config" (OuterVolumeSpecName: "console-config") pod "978e6708-182d-4716-8db1-eed9af2812da" (UID: "978e6708-182d-4716-8db1-eed9af2812da"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:55.548270 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.548237 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "978e6708-182d-4716-8db1-eed9af2812da" (UID: "978e6708-182d-4716-8db1-eed9af2812da"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:55.548434 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.548416 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-oauth-serving-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:55.548507 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.548439 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-console-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:55.548559 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.548525 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-service-ca" (OuterVolumeSpecName: "service-ca") pod "978e6708-182d-4716-8db1-eed9af2812da" (UID: "978e6708-182d-4716-8db1-eed9af2812da"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:12:55.550122 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.550098 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/978e6708-182d-4716-8db1-eed9af2812da-kube-api-access-9tj9g" (OuterVolumeSpecName: "kube-api-access-9tj9g") pod "978e6708-182d-4716-8db1-eed9af2812da" (UID: "978e6708-182d-4716-8db1-eed9af2812da"). InnerVolumeSpecName "kube-api-access-9tj9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:12:55.550460 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.550436 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "978e6708-182d-4716-8db1-eed9af2812da" (UID: "978e6708-182d-4716-8db1-eed9af2812da"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:12:55.550503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.550485 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "978e6708-182d-4716-8db1-eed9af2812da" (UID: "978e6708-182d-4716-8db1-eed9af2812da"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:12:55.648854 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.648825 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-oauth-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:55.648854 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.648847 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tj9g\" (UniqueName: \"kubernetes.io/projected/978e6708-182d-4716-8db1-eed9af2812da-kube-api-access-9tj9g\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:55.648854 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.648858 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/978e6708-182d-4716-8db1-eed9af2812da-console-serving-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:55.649066 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:55.648868 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/978e6708-182d-4716-8db1-eed9af2812da-service-ca\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:12:56.210082 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:56.210052 2575 generic.go:356] "Generic (PLEG): container finished" podID="978e6708-182d-4716-8db1-eed9af2812da" containerID="732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610" exitCode=0 Jun 14 16:12:56.210501 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:56.210099 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9cbc59c96-d9srt" Jun 14 16:12:56.210501 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:56.210123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cbc59c96-d9srt" event={"ID":"978e6708-182d-4716-8db1-eed9af2812da","Type":"ContainerDied","Data":"732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610"} Jun 14 16:12:56.210501 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:56.210189 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9cbc59c96-d9srt" event={"ID":"978e6708-182d-4716-8db1-eed9af2812da","Type":"ContainerDied","Data":"9f23e7dc4508bfa2745f68c19588e5ddcb13559a093273c3cdc0de5d3bdfe767"} Jun 14 16:12:56.210501 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:56.210209 2575 scope.go:117] "RemoveContainer" containerID="732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610" Jun 14 16:12:56.218670 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:56.218652 2575 scope.go:117] "RemoveContainer" containerID="732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610" Jun 14 16:12:56.218958 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:12:56.218929 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610\": container with ID starting with 732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610 not found: ID does not exist" containerID="732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610" Jun 14 16:12:56.219029 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:56.218972 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610"} err="failed to get container status \"732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610\": rpc error: code = NotFound desc = could not find container \"732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610\": container with ID starting with 732acfb3fdf2b0a927630fb495479bfba7d610cf76baa7674d92aeed42f9f610 not found: ID does not exist" Jun 14 16:12:56.229366 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:56.229344 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9cbc59c96-d9srt"] Jun 14 16:12:56.232797 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:56.232777 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9cbc59c96-d9srt"] Jun 14 16:12:56.649607 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:56.649565 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="978e6708-182d-4716-8db1-eed9af2812da" path="/var/lib/kubelet/pods/978e6708-182d-4716-8db1-eed9af2812da/volumes" Jun 14 16:12:57.418829 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:57.418795 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:57.437884 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:57.437856 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:12:58.235205 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:12:58.235176 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:01.090986 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:01.090940 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dbr5w" Jun 14 16:13:02.038090 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.038062 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5994d5bb97-52gqr"] Jun 14 16:13:02.038419 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.038406 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" containerName="console" Jun 14 16:13:02.038473 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.038421 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" containerName="console" Jun 14 16:13:02.038473 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.038440 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79a11754-19e2-405c-b144-aefc180cf578" containerName="console" Jun 14 16:13:02.038473 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.038445 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="79a11754-19e2-405c-b144-aefc180cf578" containerName="console" Jun 14 16:13:02.038473 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.038451 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978e6708-182d-4716-8db1-eed9af2812da" containerName="console" Jun 14 16:13:02.038473 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.038458 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="978e6708-182d-4716-8db1-eed9af2812da" containerName="console" Jun 14 16:13:02.038642 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.038504 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="79a11754-19e2-405c-b144-aefc180cf578" containerName="console" Jun 14 16:13:02.038642 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.038513 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="978e6708-182d-4716-8db1-eed9af2812da" containerName="console" Jun 14 16:13:02.038642 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.038519 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd0f7df9-ef76-48bf-bd8e-6922d5ec457a" containerName="console" Jun 14 16:13:02.074151 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.074110 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5994d5bb97-52gqr"] Jun 14 16:13:02.074283 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.074227 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.207190 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.207158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-serving-cert\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.207544 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.207203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-trusted-ca-bundle\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.207544 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.207249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-config\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.207544 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.207270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwbzs\" (UniqueName: \"kubernetes.io/projected/47f1ce53-36a8-4966-931a-aebf920b3cf4-kube-api-access-nwbzs\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.207544 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.207308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-service-ca\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.207544 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.207391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-oauth-serving-cert\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.207544 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.207419 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-oauth-config\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.308186 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.308078 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-serving-cert\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.308350 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.308242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-trusted-ca-bundle\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.308350 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.308290 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-config\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.308350 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.308322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwbzs\" (UniqueName: \"kubernetes.io/projected/47f1ce53-36a8-4966-931a-aebf920b3cf4-kube-api-access-nwbzs\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.308502 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.308384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-service-ca\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.308502 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.308445 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-oauth-serving-cert\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.308502 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.308475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-oauth-config\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.309124 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.309095 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-config\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.309258 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.309128 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-oauth-serving-cert\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.309258 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.309107 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-service-ca\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.309258 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.309201 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-trusted-ca-bundle\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.310585 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.310566 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-serving-cert\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.310744 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.310727 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-oauth-config\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.316659 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.316639 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwbzs\" (UniqueName: \"kubernetes.io/projected/47f1ce53-36a8-4966-931a-aebf920b3cf4-kube-api-access-nwbzs\") pod \"console-5994d5bb97-52gqr\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.383241 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.383211 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:02.539097 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:02.539073 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5994d5bb97-52gqr"] Jun 14 16:13:02.541007 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:13:02.540981 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f1ce53_36a8_4966_931a_aebf920b3cf4.slice/crio-8d864b68074a1adea0b2ecb0d2e23660da79550acde29496bf3eeee00dc3c527 WatchSource:0}: Error finding container 8d864b68074a1adea0b2ecb0d2e23660da79550acde29496bf3eeee00dc3c527: Status 404 returned error can't find the container with id 8d864b68074a1adea0b2ecb0d2e23660da79550acde29496bf3eeee00dc3c527 Jun 14 16:13:03.249540 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:03.249504 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994d5bb97-52gqr" event={"ID":"47f1ce53-36a8-4966-931a-aebf920b3cf4","Type":"ContainerStarted","Data":"ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e"} Jun 14 16:13:03.249890 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:03.249590 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994d5bb97-52gqr" event={"ID":"47f1ce53-36a8-4966-931a-aebf920b3cf4","Type":"ContainerStarted","Data":"8d864b68074a1adea0b2ecb0d2e23660da79550acde29496bf3eeee00dc3c527"} Jun 14 16:13:03.266513 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:03.266465 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5994d5bb97-52gqr" podStartSLOduration=1.2664510469999999 podStartE2EDuration="1.266451047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:13:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:13:03.265121251 +0000 UTC m=+105.028900350" watchObservedRunningTime="2026-06-14 16:13:03.266451047 +0000 UTC m=+105.030230147" Jun 14 16:13:05.713829 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:05.713795 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 16:13:05.714274 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:05.714079 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="alertmanager" containerID="cri-o://80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77" gracePeriod=120 Jun 14 16:13:05.714274 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:05.714186 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy-metric" containerID="cri-o://c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2" gracePeriod=120 Jun 14 16:13:05.714400 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:05.714218 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy-web" containerID="cri-o://d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b" gracePeriod=120 Jun 14 16:13:05.714456 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:05.714259 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="config-reloader" containerID="cri-o://c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c" gracePeriod=120 Jun 14 16:13:05.714506 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:05.714225 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy" containerID="cri-o://1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0" gracePeriod=120 Jun 14 16:13:05.714506 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:05.714247 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="prom-label-proxy" containerID="cri-o://ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e" gracePeriod=120 Jun 14 16:13:06.265766 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.265736 2575 generic.go:356] "Generic (PLEG): container finished" podID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerID="ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e" exitCode=0 Jun 14 16:13:06.265766 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.265760 2575 generic.go:356] "Generic (PLEG): container finished" podID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerID="c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2" exitCode=0 Jun 14 16:13:06.265766 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.265768 2575 generic.go:356] "Generic (PLEG): container finished" podID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerID="1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0" exitCode=0 Jun 14 16:13:06.266003 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.265775 2575 generic.go:356] "Generic (PLEG): container finished" podID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerID="c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c" exitCode=0 Jun 14 16:13:06.266003 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.265782 2575 generic.go:356] "Generic (PLEG): container finished" podID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerID="80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77" exitCode=0 Jun 14 16:13:06.266003 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.265803 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerDied","Data":"ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e"} Jun 14 16:13:06.266003 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.265866 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerDied","Data":"c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2"} Jun 14 16:13:06.266003 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.265891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerDied","Data":"1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0"} Jun 14 16:13:06.266003 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.265916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerDied","Data":"c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c"} Jun 14 16:13:06.266003 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.265940 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerDied","Data":"80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77"} Jun 14 16:13:06.961809 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:06.961783 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:13:07.053053 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.052976 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcgd7\" (UniqueName: \"kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-kube-api-access-wcgd7\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053053 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053012 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-volume\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053053 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053032 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-out\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053378 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053162 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053378 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053263 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-web\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053378 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053298 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-main-db\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053378 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053328 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-metrics-client-ca\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053378 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053369 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-web-config\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053652 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053397 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053652 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053440 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-main-tls\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053652 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053474 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-cluster-tls-config\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053652 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053514 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-tls-assets\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053652 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053579 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-trusted-ca-bundle\") pod \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\" (UID: \"3a26938e-428b-4f3d-af30-2df1cdb9f86a\") " Jun 14 16:13:07.053968 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.053940 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 16:13:07.054513 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.054483 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:07.054837 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.054812 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:07.056303 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.055846 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:07.056303 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.055904 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-kube-api-access-wcgd7" (OuterVolumeSpecName: "kube-api-access-wcgd7") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "kube-api-access-wcgd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:13:07.056303 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.056264 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-out" (OuterVolumeSpecName: "config-out") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 16:13:07.056652 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.056625 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:07.056931 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.056907 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-volume" (OuterVolumeSpecName: "config-volume") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:07.057277 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.057255 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:13:07.057409 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.057388 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:07.058860 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.058839 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:07.061802 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.061778 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:07.068014 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.067995 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-web-config" (OuterVolumeSpecName: "web-config") pod "3a26938e-428b-4f3d-af30-2df1cdb9f86a" (UID: "3a26938e-428b-4f3d-af30-2df1cdb9f86a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:07.154570 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154542 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-tls-assets\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154570 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154567 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154570 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154577 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcgd7\" (UniqueName: \"kubernetes.io/projected/3a26938e-428b-4f3d-af30-2df1cdb9f86a-kube-api-access-wcgd7\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154586 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-volume\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154595 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-config-out\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154603 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154612 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154621 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a26938e-428b-4f3d-af30-2df1cdb9f86a-alertmanager-main-db\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154629 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a26938e-428b-4f3d-af30-2df1cdb9f86a-metrics-client-ca\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154636 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-web-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154645 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154653 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-secret-alertmanager-main-tls\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.154756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.154661 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a26938e-428b-4f3d-af30-2df1cdb9f86a-cluster-tls-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:07.274150 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.274114 2575 generic.go:356] "Generic (PLEG): container finished" podID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerID="d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b" exitCode=0 Jun 14 16:13:07.274302 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.274196 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerDied","Data":"d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b"} Jun 14 16:13:07.274302 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.274212 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 16:13:07.274302 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.274267 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a26938e-428b-4f3d-af30-2df1cdb9f86a","Type":"ContainerDied","Data":"b0485eedaa1adfab180bb8e8e8a8d662e1f1ff9f5e43f7919c39ace5ba89241f"} Jun 14 16:13:07.274419 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.274303 2575 scope.go:117] "RemoveContainer" containerID="ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e" Jun 14 16:13:07.285153 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.285114 2575 scope.go:117] "RemoveContainer" containerID="c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2" Jun 14 16:13:07.292111 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.292095 2575 scope.go:117] "RemoveContainer" containerID="1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0" Jun 14 16:13:07.298612 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.298596 2575 scope.go:117] "RemoveContainer" containerID="d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b" Jun 14 16:13:07.302242 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.302219 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 16:13:07.306301 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.306236 2575 scope.go:117] "RemoveContainer" containerID="c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c" Jun 14 16:13:07.312114 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.312091 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 16:13:07.313661 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.313635 2575 scope.go:117] "RemoveContainer" containerID="80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77" Jun 14 16:13:07.320461 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.320444 2575 scope.go:117] "RemoveContainer" containerID="29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630" Jun 14 16:13:07.327111 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.327097 2575 scope.go:117] "RemoveContainer" containerID="ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e" Jun 14 16:13:07.327361 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:07.327342 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e\": container with ID starting with ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e not found: ID does not exist" containerID="ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e" Jun 14 16:13:07.327423 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.327373 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e"} err="failed to get container status \"ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e\": rpc error: code = NotFound desc = could not find container \"ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e\": container with ID starting with ee142b4b485869318735b669c0cfc760d34e89197c0965231c0dc3eb5ea0fe1e not found: ID does not exist" Jun 14 16:13:07.327423 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.327399 2575 scope.go:117] "RemoveContainer" containerID="c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2" Jun 14 16:13:07.327666 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:07.327646 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2\": container with ID starting with c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2 not found: ID does not exist" containerID="c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2" Jun 14 16:13:07.327712 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.327672 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2"} err="failed to get container status \"c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2\": rpc error: code = NotFound desc = could not find container \"c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2\": container with ID starting with c47a0eb85f28a209b43b1d9ff6f6db0f4ccc9bd4a7e264fe959f8a7bec59f3a2 not found: ID does not exist" Jun 14 16:13:07.327712 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.327692 2575 scope.go:117] "RemoveContainer" containerID="1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0" Jun 14 16:13:07.327896 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:07.327878 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0\": container with ID starting with 1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0 not found: ID does not exist" containerID="1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0" Jun 14 16:13:07.327941 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.327902 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0"} err="failed to get container status \"1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0\": rpc error: code = NotFound desc = could not find container \"1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0\": container with ID starting with 1f6fe878acbe3660bd3981ef8c0acf7d08cf2dc9c3635f7341dd48b40f7473f0 not found: ID does not exist" Jun 14 16:13:07.327941 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.327916 2575 scope.go:117] "RemoveContainer" containerID="d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b" Jun 14 16:13:07.328170 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:07.328152 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b\": container with ID starting with d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b not found: ID does not exist" containerID="d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b" Jun 14 16:13:07.328240 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.328177 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b"} err="failed to get container status \"d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b\": rpc error: code = NotFound desc = could not find container \"d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b\": container with ID starting with d925f74f20fa71feee151219f7867e99e469220f8de63ff75999c978dbb8df7b not found: ID does not exist" Jun 14 16:13:07.328240 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.328197 2575 scope.go:117] "RemoveContainer" containerID="c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c" Jun 14 16:13:07.328422 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:07.328406 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c\": container with ID starting with c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c not found: ID does not exist" containerID="c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c" Jun 14 16:13:07.328467 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.328426 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c"} err="failed to get container status \"c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c\": rpc error: code = NotFound desc = could not find container \"c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c\": container with ID starting with c3c9054679db32a11deee6d9b76a1368f7d06215da563e338570c1833769f97c not found: ID does not exist" Jun 14 16:13:07.328467 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.328439 2575 scope.go:117] "RemoveContainer" containerID="80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77" Jun 14 16:13:07.328626 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:07.328612 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77\": container with ID starting with 80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77 not found: ID does not exist" containerID="80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77" Jun 14 16:13:07.328684 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.328633 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77"} err="failed to get container status \"80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77\": rpc error: code = NotFound desc = could not find container \"80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77\": container with ID starting with 80d1d532c6aba12d894fa613f227287ccc77a1da95689b5acc8c8757a80b2f77 not found: ID does not exist" Jun 14 16:13:07.328684 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.328652 2575 scope.go:117] "RemoveContainer" containerID="29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630" Jun 14 16:13:07.328842 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:07.328827 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630\": container with ID starting with 29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630 not found: ID does not exist" containerID="29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630" Jun 14 16:13:07.328878 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:07.328845 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630"} err="failed to get container status \"29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630\": rpc error: code = NotFound desc = could not find container \"29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630\": container with ID starting with 29f94c300e4b283cd7c095a77f3e0e173f122ac20abeeb21b581dd772bdcd630 not found: ID does not exist" Jun 14 16:13:08.648982 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:08.648951 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" path="/var/lib/kubelet/pods/3a26938e-428b-4f3d-af30-2df1cdb9f86a/volumes" Jun 14 16:13:09.972432 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:09.972397 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 16:13:09.972853 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:09.972679 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="prometheus" containerID="cri-o://310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c" gracePeriod=600 Jun 14 16:13:09.972853 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:09.972712 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy" containerID="cri-o://57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e" gracePeriod=600 Jun 14 16:13:09.972853 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:09.972746 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy-web" containerID="cri-o://8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6" gracePeriod=600 Jun 14 16:13:09.972853 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:09.972824 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="config-reloader" containerID="cri-o://f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13" gracePeriod=600 Jun 14 16:13:09.972853 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:09.972720 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="thanos-sidecar" containerID="cri-o://03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7" gracePeriod=600 Jun 14 16:13:09.973097 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:09.972904 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy-thanos" containerID="cri-o://423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da" gracePeriod=600 Jun 14 16:13:10.216059 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.216037 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.290968 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.290895 2575 generic.go:356] "Generic (PLEG): container finished" podID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerID="423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da" exitCode=0 Jun 14 16:13:10.290968 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.290916 2575 generic.go:356] "Generic (PLEG): container finished" podID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerID="57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e" exitCode=0 Jun 14 16:13:10.290968 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.290925 2575 generic.go:356] "Generic (PLEG): container finished" podID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerID="8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6" exitCode=0 Jun 14 16:13:10.290968 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.290937 2575 generic.go:356] "Generic (PLEG): container finished" podID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerID="03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7" exitCode=0 Jun 14 16:13:10.290968 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.290944 2575 generic.go:356] "Generic (PLEG): container finished" podID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerID="f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13" exitCode=0 Jun 14 16:13:10.290968 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.290952 2575 generic.go:356] "Generic (PLEG): container finished" podID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerID="310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c" exitCode=0 Jun 14 16:13:10.290968 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.290963 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.291315 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.290945 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerDied","Data":"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da"} Jun 14 16:13:10.291315 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.291056 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerDied","Data":"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e"} Jun 14 16:13:10.291315 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.291107 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerDied","Data":"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6"} Jun 14 16:13:10.291315 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.291124 2575 scope.go:117] "RemoveContainer" containerID="423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da" Jun 14 16:13:10.291315 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.291160 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerDied","Data":"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7"} Jun 14 16:13:10.291315 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.291201 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerDied","Data":"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13"} Jun 14 16:13:10.291315 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.291241 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerDied","Data":"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c"} Jun 14 16:13:10.291315 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.291267 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9f9401c4-c5fb-45e0-b7ae-1d9365724fca","Type":"ContainerDied","Data":"272f6ff7aa44d39ebb96476addb4cba4137f5572fb14ca1eac6d8fd6016730ce"} Jun 14 16:13:10.298404 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.298385 2575 scope.go:117] "RemoveContainer" containerID="57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e" Jun 14 16:13:10.304905 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.304889 2575 scope.go:117] "RemoveContainer" containerID="8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6" Jun 14 16:13:10.311128 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.311113 2575 scope.go:117] "RemoveContainer" containerID="03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7" Jun 14 16:13:10.318022 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.317941 2575 scope.go:117] "RemoveContainer" containerID="f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13" Jun 14 16:13:10.325822 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.325805 2575 scope.go:117] "RemoveContainer" containerID="310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c" Jun 14 16:13:10.332845 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.332828 2575 scope.go:117] "RemoveContainer" containerID="563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa" Jun 14 16:13:10.339049 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.339032 2575 scope.go:117] "RemoveContainer" containerID="423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da" Jun 14 16:13:10.339311 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:10.339285 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": container with ID starting with 423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da not found: ID does not exist" containerID="423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da" Jun 14 16:13:10.339365 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.339312 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da"} err="failed to get container status \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": rpc error: code = NotFound desc = could not find container \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": container with ID starting with 423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da not found: ID does not exist" Jun 14 16:13:10.339365 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.339335 2575 scope.go:117] "RemoveContainer" containerID="57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e" Jun 14 16:13:10.339545 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:10.339528 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": container with ID starting with 57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e not found: ID does not exist" containerID="57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e" Jun 14 16:13:10.339586 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.339550 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e"} err="failed to get container status \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": rpc error: code = NotFound desc = could not find container \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": container with ID starting with 57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e not found: ID does not exist" Jun 14 16:13:10.339586 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.339563 2575 scope.go:117] "RemoveContainer" containerID="8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6" Jun 14 16:13:10.339754 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:10.339740 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": container with ID starting with 8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6 not found: ID does not exist" containerID="8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6" Jun 14 16:13:10.339793 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.339758 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6"} err="failed to get container status \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": rpc error: code = NotFound desc = could not find container \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": container with ID starting with 8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6 not found: ID does not exist" Jun 14 16:13:10.339793 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.339771 2575 scope.go:117] "RemoveContainer" containerID="03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7" Jun 14 16:13:10.339957 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:10.339941 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": container with ID starting with 03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7 not found: ID does not exist" containerID="03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7" Jun 14 16:13:10.339999 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.339959 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7"} err="failed to get container status \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": rpc error: code = NotFound desc = could not find container \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": container with ID starting with 03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7 not found: ID does not exist" Jun 14 16:13:10.339999 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.339972 2575 scope.go:117] "RemoveContainer" containerID="f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13" Jun 14 16:13:10.340176 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:10.340155 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": container with ID starting with f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13 not found: ID does not exist" containerID="f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13" Jun 14 16:13:10.340248 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.340186 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13"} err="failed to get container status \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": rpc error: code = NotFound desc = could not find container \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": container with ID starting with f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13 not found: ID does not exist" Jun 14 16:13:10.340248 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.340209 2575 scope.go:117] "RemoveContainer" containerID="310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c" Jun 14 16:13:10.340431 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:10.340412 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": container with ID starting with 310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c not found: ID does not exist" containerID="310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c" Jun 14 16:13:10.340474 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.340436 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c"} err="failed to get container status \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": rpc error: code = NotFound desc = could not find container \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": container with ID starting with 310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c not found: ID does not exist" Jun 14 16:13:10.340474 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.340451 2575 scope.go:117] "RemoveContainer" containerID="563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa" Jun 14 16:13:10.340696 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:10.340681 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": container with ID starting with 563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa not found: ID does not exist" containerID="563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa" Jun 14 16:13:10.340755 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.340704 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa"} err="failed to get container status \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": rpc error: code = NotFound desc = could not find container \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": container with ID starting with 563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa not found: ID does not exist" Jun 14 16:13:10.340755 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.340726 2575 scope.go:117] "RemoveContainer" containerID="423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da" Jun 14 16:13:10.340965 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.340948 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da"} err="failed to get container status \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": rpc error: code = NotFound desc = could not find container \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": container with ID starting with 423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da not found: ID does not exist" Jun 14 16:13:10.341010 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.340965 2575 scope.go:117] "RemoveContainer" containerID="57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e" Jun 14 16:13:10.341188 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.341170 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e"} err="failed to get container status \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": rpc error: code = NotFound desc = could not find container \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": container with ID starting with 57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e not found: ID does not exist" Jun 14 16:13:10.341292 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.341189 2575 scope.go:117] "RemoveContainer" containerID="8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6" Jun 14 16:13:10.341358 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.341343 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6"} err="failed to get container status \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": rpc error: code = NotFound desc = could not find container \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": container with ID starting with 8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6 not found: ID does not exist" Jun 14 16:13:10.341358 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.341357 2575 scope.go:117] "RemoveContainer" containerID="03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7" Jun 14 16:13:10.341571 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.341551 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7"} err="failed to get container status \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": rpc error: code = NotFound desc = could not find container \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": container with ID starting with 03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7 not found: ID does not exist" Jun 14 16:13:10.341622 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.341571 2575 scope.go:117] "RemoveContainer" containerID="f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13" Jun 14 16:13:10.341770 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.341755 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13"} err="failed to get container status \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": rpc error: code = NotFound desc = could not find container \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": container with ID starting with f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13 not found: ID does not exist" Jun 14 16:13:10.341770 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.341769 2575 scope.go:117] "RemoveContainer" containerID="310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c" Jun 14 16:13:10.341960 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.341945 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c"} err="failed to get container status \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": rpc error: code = NotFound desc = could not find container \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": container with ID starting with 310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c not found: ID does not exist" Jun 14 16:13:10.341998 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.341960 2575 scope.go:117] "RemoveContainer" containerID="563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa" Jun 14 16:13:10.342177 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.342159 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa"} err="failed to get container status \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": rpc error: code = NotFound desc = could not find container \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": container with ID starting with 563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa not found: ID does not exist" Jun 14 16:13:10.342236 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.342178 2575 scope.go:117] "RemoveContainer" containerID="423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da" Jun 14 16:13:10.342387 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.342369 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da"} err="failed to get container status \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": rpc error: code = NotFound desc = could not find container \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": container with ID starting with 423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da not found: ID does not exist" Jun 14 16:13:10.342429 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.342387 2575 scope.go:117] "RemoveContainer" containerID="57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e" Jun 14 16:13:10.342592 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.342575 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e"} err="failed to get container status \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": rpc error: code = NotFound desc = could not find container \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": container with ID starting with 57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e not found: ID does not exist" Jun 14 16:13:10.342592 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.342592 2575 scope.go:117] "RemoveContainer" containerID="8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6" Jun 14 16:13:10.342815 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.342797 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6"} err="failed to get container status \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": rpc error: code = NotFound desc = could not find container \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": container with ID starting with 8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6 not found: ID does not exist" Jun 14 16:13:10.342887 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.342817 2575 scope.go:117] "RemoveContainer" containerID="03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7" Jun 14 16:13:10.343063 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.343044 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7"} err="failed to get container status \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": rpc error: code = NotFound desc = could not find container \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": container with ID starting with 03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7 not found: ID does not exist" Jun 14 16:13:10.343113 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.343063 2575 scope.go:117] "RemoveContainer" containerID="f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13" Jun 14 16:13:10.343280 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.343264 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13"} err="failed to get container status \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": rpc error: code = NotFound desc = could not find container \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": container with ID starting with f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13 not found: ID does not exist" Jun 14 16:13:10.343331 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.343280 2575 scope.go:117] "RemoveContainer" containerID="310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c" Jun 14 16:13:10.343505 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.343488 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c"} err="failed to get container status \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": rpc error: code = NotFound desc = could not find container \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": container with ID starting with 310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c not found: ID does not exist" Jun 14 16:13:10.343558 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.343506 2575 scope.go:117] "RemoveContainer" containerID="563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa" Jun 14 16:13:10.343714 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.343695 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa"} err="failed to get container status \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": rpc error: code = NotFound desc = could not find container \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": container with ID starting with 563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa not found: ID does not exist" Jun 14 16:13:10.343756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.343714 2575 scope.go:117] "RemoveContainer" containerID="423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da" Jun 14 16:13:10.343920 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.343904 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da"} err="failed to get container status \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": rpc error: code = NotFound desc = could not find container \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": container with ID starting with 423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da not found: ID does not exist" Jun 14 16:13:10.343959 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.343920 2575 scope.go:117] "RemoveContainer" containerID="57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e" Jun 14 16:13:10.344101 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.344085 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e"} err="failed to get container status \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": rpc error: code = NotFound desc = could not find container \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": container with ID starting with 57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e not found: ID does not exist" Jun 14 16:13:10.344171 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.344101 2575 scope.go:117] "RemoveContainer" containerID="8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6" Jun 14 16:13:10.344346 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.344330 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6"} err="failed to get container status \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": rpc error: code = NotFound desc = could not find container \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": container with ID starting with 8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6 not found: ID does not exist" Jun 14 16:13:10.344383 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.344346 2575 scope.go:117] "RemoveContainer" containerID="03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7" Jun 14 16:13:10.344557 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.344539 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7"} err="failed to get container status \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": rpc error: code = NotFound desc = could not find container \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": container with ID starting with 03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7 not found: ID does not exist" Jun 14 16:13:10.344617 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.344558 2575 scope.go:117] "RemoveContainer" containerID="f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13" Jun 14 16:13:10.344773 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.344755 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13"} err="failed to get container status \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": rpc error: code = NotFound desc = could not find container \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": container with ID starting with f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13 not found: ID does not exist" Jun 14 16:13:10.344817 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.344781 2575 scope.go:117] "RemoveContainer" containerID="310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c" Jun 14 16:13:10.344989 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.344972 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c"} err="failed to get container status \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": rpc error: code = NotFound desc = could not find container \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": container with ID starting with 310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c not found: ID does not exist" Jun 14 16:13:10.345032 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.344990 2575 scope.go:117] "RemoveContainer" containerID="563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa" Jun 14 16:13:10.345202 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.345186 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa"} err="failed to get container status \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": rpc error: code = NotFound desc = could not find container \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": container with ID starting with 563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa not found: ID does not exist" Jun 14 16:13:10.345202 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.345201 2575 scope.go:117] "RemoveContainer" containerID="423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da" Jun 14 16:13:10.345391 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.345373 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da"} err="failed to get container status \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": rpc error: code = NotFound desc = could not find container \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": container with ID starting with 423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da not found: ID does not exist" Jun 14 16:13:10.345431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.345391 2575 scope.go:117] "RemoveContainer" containerID="57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e" Jun 14 16:13:10.345599 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.345582 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e"} err="failed to get container status \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": rpc error: code = NotFound desc = could not find container \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": container with ID starting with 57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e not found: ID does not exist" Jun 14 16:13:10.345640 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.345599 2575 scope.go:117] "RemoveContainer" containerID="8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6" Jun 14 16:13:10.345801 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.345786 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6"} err="failed to get container status \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": rpc error: code = NotFound desc = could not find container \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": container with ID starting with 8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6 not found: ID does not exist" Jun 14 16:13:10.345838 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.345801 2575 scope.go:117] "RemoveContainer" containerID="03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7" Jun 14 16:13:10.345989 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.345972 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7"} err="failed to get container status \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": rpc error: code = NotFound desc = could not find container \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": container with ID starting with 03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7 not found: ID does not exist" Jun 14 16:13:10.345989 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.345988 2575 scope.go:117] "RemoveContainer" containerID="f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13" Jun 14 16:13:10.346216 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.346202 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13"} err="failed to get container status \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": rpc error: code = NotFound desc = could not find container \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": container with ID starting with f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13 not found: ID does not exist" Jun 14 16:13:10.346263 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.346217 2575 scope.go:117] "RemoveContainer" containerID="310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c" Jun 14 16:13:10.346413 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.346396 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c"} err="failed to get container status \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": rpc error: code = NotFound desc = could not find container \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": container with ID starting with 310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c not found: ID does not exist" Jun 14 16:13:10.346449 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.346413 2575 scope.go:117] "RemoveContainer" containerID="563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa" Jun 14 16:13:10.346597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.346582 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa"} err="failed to get container status \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": rpc error: code = NotFound desc = could not find container \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": container with ID starting with 563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa not found: ID does not exist" Jun 14 16:13:10.346643 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.346598 2575 scope.go:117] "RemoveContainer" containerID="423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da" Jun 14 16:13:10.346785 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.346769 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da"} err="failed to get container status \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": rpc error: code = NotFound desc = could not find container \"423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da\": container with ID starting with 423b362024d4e098c6cc56977ab549f860ae49d7e69064bff2c3f371666714da not found: ID does not exist" Jun 14 16:13:10.346785 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.346784 2575 scope.go:117] "RemoveContainer" containerID="57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e" Jun 14 16:13:10.346982 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.346964 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e"} err="failed to get container status \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": rpc error: code = NotFound desc = could not find container \"57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e\": container with ID starting with 57d33f48da788a95880f9d1f7c8dced5f34cdceb1513a35ad5c82510ad3c296e not found: ID does not exist" Jun 14 16:13:10.347032 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.346984 2575 scope.go:117] "RemoveContainer" containerID="8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6" Jun 14 16:13:10.347208 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.347192 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6"} err="failed to get container status \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": rpc error: code = NotFound desc = could not find container \"8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6\": container with ID starting with 8149222cdb59d31c3b2537180d2b7a19c31d79c2a3b61712f806361e082e69b6 not found: ID does not exist" Jun 14 16:13:10.347247 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.347208 2575 scope.go:117] "RemoveContainer" containerID="03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7" Jun 14 16:13:10.347409 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.347393 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7"} err="failed to get container status \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": rpc error: code = NotFound desc = could not find container \"03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7\": container with ID starting with 03418a79ec1ad1156d750387b8828cf167379d5816cffa6b663ec4ab6b6233b7 not found: ID does not exist" Jun 14 16:13:10.347465 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.347409 2575 scope.go:117] "RemoveContainer" containerID="f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13" Jun 14 16:13:10.347579 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.347565 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13"} err="failed to get container status \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": rpc error: code = NotFound desc = could not find container \"f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13\": container with ID starting with f5cf65656569a483a0594bc438e083c8da53418a64b0e5997c1a9b9e5a17ab13 not found: ID does not exist" Jun 14 16:13:10.347622 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.347579 2575 scope.go:117] "RemoveContainer" containerID="310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c" Jun 14 16:13:10.347782 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.347764 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c"} err="failed to get container status \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": rpc error: code = NotFound desc = could not find container \"310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c\": container with ID starting with 310acb16bd1b3b76ca679c026ea58e31557fc5abc9fe878288c9ed21500e0e4c not found: ID does not exist" Jun 14 16:13:10.347833 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.347781 2575 scope.go:117] "RemoveContainer" containerID="563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa" Jun 14 16:13:10.347940 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.347925 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa"} err="failed to get container status \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": rpc error: code = NotFound desc = could not find container \"563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa\": container with ID starting with 563b26f1eca631be9d45e3404012bfde74f4e92433bb0b37f7e4c004dca0ebaa not found: ID does not exist" Jun 14 16:13:10.382170 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382120 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-serving-certs-ca-bundle\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382245 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382176 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-0\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382245 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382200 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config-out\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382309 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382261 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-1\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382342 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382311 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382375 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382340 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-metrics-client-ca\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382375 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382362 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-web-config\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382449 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382387 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-db\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382449 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382412 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382449 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382439 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-kubelet-serving-ca-bundle\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382633 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382469 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-trusted-ca-bundle\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382633 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382512 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-grpc-tls\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382633 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382539 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382633 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382563 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-kube-rbac-proxy\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382633 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382593 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-tls-assets\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382633 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382615 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-2\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382918 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382641 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-metrics-client-certs\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382918 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382684 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnfmv\" (UniqueName: \"kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-kube-api-access-rnfmv\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382918 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382702 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-thanos-prometheus-http-client-file\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382918 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382738 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-tls\") pod \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\" (UID: \"9f9401c4-c5fb-45e0-b7ae-1d9365724fca\") " Jun 14 16:13:10.382918 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.382867 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:10.383197 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.383074 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.383684 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.383539 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:10.383684 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.383568 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:10.383684 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.383573 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 16:13:10.383920 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.383892 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:10.384231 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.384201 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:10.386445 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.384451 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:10.386445 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.386038 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:10.386445 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.386289 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:13:10.386636 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.386509 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:10.386902 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.386735 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:10.387658 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.387627 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config-out" (OuterVolumeSpecName: "config-out") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 16:13:10.387756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.387702 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-kube-api-access-rnfmv" (OuterVolumeSpecName: "kube-api-access-rnfmv") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "kube-api-access-rnfmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:13:10.390289 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.388345 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config" (OuterVolumeSpecName: "config") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:10.390535 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.390510 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:10.390648 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.390538 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:10.390722 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.390608 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:10.392614 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.392589 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:10.392693 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.392650 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:10.400397 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.400375 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-web-config" (OuterVolumeSpecName: "web-config") pod "9f9401c4-c5fb-45e0-b7ae-1d9365724fca" (UID: "9f9401c4-c5fb-45e0-b7ae-1d9365724fca"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:10.483660 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483635 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483660 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483657 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483668 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config-out\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483677 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483687 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-metrics-client-ca\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483713 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-web-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483722 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-db\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483731 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483739 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483747 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483755 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-grpc-tls\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483763 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483772 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-kube-rbac-proxy\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.483780 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483779 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-tls-assets\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.484182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483788 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.484182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483795 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-metrics-client-certs\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.484182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483805 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnfmv\" (UniqueName: \"kubernetes.io/projected/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-kube-api-access-rnfmv\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.484182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483814 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.484182 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.483822 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9f9401c4-c5fb-45e0-b7ae-1d9365724fca-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:10.614329 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.614301 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 16:13:10.618052 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.618029 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 16:13:10.643981 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.643956 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 16:13:10.644283 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644271 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="alertmanager" Jun 14 16:13:10.644324 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644285 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="alertmanager" Jun 14 16:13:10.644324 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644294 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="init-config-reloader" Jun 14 16:13:10.644324 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644300 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="init-config-reloader" Jun 14 16:13:10.644324 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644311 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="prom-label-proxy" Jun 14 16:13:10.644324 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644317 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="prom-label-proxy" Jun 14 16:13:10.644324 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644325 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="thanos-sidecar" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644330 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="thanos-sidecar" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644337 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy-metric" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644343 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy-metric" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644352 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy-thanos" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644358 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy-thanos" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644365 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="init-config-reloader" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644370 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="init-config-reloader" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644377 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy-web" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644382 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy-web" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644391 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="config-reloader" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644396 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="config-reloader" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644402 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy-web" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644407 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy-web" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644415 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="prometheus" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644420 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="prometheus" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644425 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644430 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644436 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644441 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644451 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="config-reloader" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644455 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="config-reloader" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644503 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="config-reloader" Jun 14 16:13:10.644503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644512 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="prometheus" Jun 14 16:13:10.645108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644518 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="prom-label-proxy" Jun 14 16:13:10.645108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644525 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="alertmanager" Jun 14 16:13:10.645108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644531 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy" Jun 14 16:13:10.645108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644536 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy-web" Jun 14 16:13:10.645108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644541 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy-metric" Jun 14 16:13:10.645108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644548 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="thanos-sidecar" Jun 14 16:13:10.645108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644553 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a26938e-428b-4f3d-af30-2df1cdb9f86a" containerName="kube-rbac-proxy" Jun 14 16:13:10.645108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644558 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy-web" Jun 14 16:13:10.645108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644563 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="kube-rbac-proxy-thanos" Jun 14 16:13:10.645108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.644568 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" containerName="config-reloader" Jun 14 16:13:10.649755 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.649732 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.652017 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.651998 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 16:13:10.652017 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.652007 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 16:13:10.652215 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.652178 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 16:13:10.652411 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.652381 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 16:13:10.652520 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.652412 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 16:13:10.652624 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.652607 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4f4xg\"" Jun 14 16:13:10.652624 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.652618 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 16:13:10.652726 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.652672 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-drmo5q0rou8b3\"" Jun 14 16:13:10.652726 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.652688 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 16:13:10.652927 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.652913 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 16:13:10.653008 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.652980 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 16:13:10.653062 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.653044 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 16:13:10.653062 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.653045 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 16:13:10.653197 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.653057 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 16:13:10.655973 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.655951 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f9401c4-c5fb-45e0-b7ae-1d9365724fca" path="/var/lib/kubelet/pods/9f9401c4-c5fb-45e0-b7ae-1d9365724fca/volumes" Jun 14 16:13:10.656123 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.656105 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 16:13:10.658738 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.658721 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 16:13:10.662159 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.662124 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 16:13:10.786331 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786297 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786459 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786333 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786459 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786459 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786586 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786586 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6lml\" (UniqueName: \"kubernetes.io/projected/94c1d981-f271-43b1-9cbb-94625f2289cb-kube-api-access-r6lml\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786586 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786519 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786586 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94c1d981-f271-43b1-9cbb-94625f2289cb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786586 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-web-config\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786750 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786610 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786750 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786750 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94c1d981-f271-43b1-9cbb-94625f2289cb-config-out\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786750 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786750 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786727 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786914 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786754 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786914 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786914 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786914 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-config\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786914 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.786914 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.786906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.887594 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-config\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.887718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.887718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.887718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.887718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.887885 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.887885 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887775 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.887885 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887807 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.887885 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6lml\" (UniqueName: \"kubernetes.io/projected/94c1d981-f271-43b1-9cbb-94625f2289cb-kube-api-access-r6lml\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.887885 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888103 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887901 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94c1d981-f271-43b1-9cbb-94625f2289cb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888103 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-web-config\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888103 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887960 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888103 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.887997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888103 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.888025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94c1d981-f271-43b1-9cbb-94625f2289cb-config-out\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888103 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.888083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.888110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.888159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.888186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.888211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888623 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.888590 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.888923 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.888867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.891443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.889872 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.891443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.890183 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.891443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.890237 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.891443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.890648 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-config\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.891443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.890785 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.891443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.891059 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.891443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.891203 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.891859 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.891721 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.892425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.892018 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94c1d981-f271-43b1-9cbb-94625f2289cb-config-out\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.892425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.892382 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.892425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.892386 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.892635 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.892458 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.892635 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.892555 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.892827 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.892808 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.892933 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.892912 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94c1d981-f271-43b1-9cbb-94625f2289cb-web-config\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.893615 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.893597 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94c1d981-f271-43b1-9cbb-94625f2289cb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.893715 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.893698 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94c1d981-f271-43b1-9cbb-94625f2289cb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.895765 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.895749 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6lml\" (UniqueName: \"kubernetes.io/projected/94c1d981-f271-43b1-9cbb-94625f2289cb-kube-api-access-r6lml\") pod \"prometheus-k8s-0\" (UID: \"94c1d981-f271-43b1-9cbb-94625f2289cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:10.961208 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:10.961183 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:11.094882 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:11.094847 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 16:13:11.097027 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:13:11.096998 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c1d981_f271_43b1_9cbb_94625f2289cb.slice/crio-6062ca07c9307e8a0a19f1f3372209df23de1ea4dd711c32094b6b718b37a587 WatchSource:0}: Error finding container 6062ca07c9307e8a0a19f1f3372209df23de1ea4dd711c32094b6b718b37a587: Status 404 returned error can't find the container with id 6062ca07c9307e8a0a19f1f3372209df23de1ea4dd711c32094b6b718b37a587 Jun 14 16:13:11.298803 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:11.298764 2575 generic.go:356] "Generic (PLEG): container finished" podID="94c1d981-f271-43b1-9cbb-94625f2289cb" containerID="e2e309be3823c39b8cb378fb08ff35c137c391ef3473b91ca04a0c8d1141a9c6" exitCode=0 Jun 14 16:13:11.298968 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:11.298850 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94c1d981-f271-43b1-9cbb-94625f2289cb","Type":"ContainerDied","Data":"e2e309be3823c39b8cb378fb08ff35c137c391ef3473b91ca04a0c8d1141a9c6"} Jun 14 16:13:11.298968 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:11.298921 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94c1d981-f271-43b1-9cbb-94625f2289cb","Type":"ContainerStarted","Data":"6062ca07c9307e8a0a19f1f3372209df23de1ea4dd711c32094b6b718b37a587"} Jun 14 16:13:12.306603 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:12.306517 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94c1d981-f271-43b1-9cbb-94625f2289cb","Type":"ContainerStarted","Data":"6bc9b77c3e6f154f4fac1f651f3ef2cb71a61f414a7635f633c675336f96cc9e"} Jun 14 16:13:12.306961 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:12.306614 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94c1d981-f271-43b1-9cbb-94625f2289cb","Type":"ContainerStarted","Data":"c8328077acb2bccd393ad84e076aac1a6825fa986cfdd81ab497b2f479bab759"} Jun 14 16:13:12.306961 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:12.306643 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94c1d981-f271-43b1-9cbb-94625f2289cb","Type":"ContainerStarted","Data":"e5a86e2f5fa511c4a72f0ff5eb676ce2e27fde44b4c5ff93951ad8f451838d22"} Jun 14 16:13:12.306961 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:12.306667 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94c1d981-f271-43b1-9cbb-94625f2289cb","Type":"ContainerStarted","Data":"581adb55e7782d32b6bb48aecfbd93caa25d91e72248824c5d496634bbb96ab8"} Jun 14 16:13:12.306961 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:12.306690 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94c1d981-f271-43b1-9cbb-94625f2289cb","Type":"ContainerStarted","Data":"c0a653b0ab54f17705b419f466dd8223564d3d63b9c5c96bc0c1d57aaa6da361"} Jun 14 16:13:12.306961 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:12.306718 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94c1d981-f271-43b1-9cbb-94625f2289cb","Type":"ContainerStarted","Data":"317491db93bf237f9cf171be5bc00ead917a571ab7fb2d4086b5ec4c73a41d41"} Jun 14 16:13:12.337680 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:12.337619 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.318280046 podStartE2EDuration="2.337599411s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.319365ms" isStatefulPod=false podCreationTimestamp="2026-06-14 16:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:13:12.334978996 +0000 UTC m=+114.098758108" watchObservedRunningTime="2026-06-14 16:13:12.337599411 +0000 UTC m=+114.101378511" Jun 14 16:13:12.383327 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:12.383298 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:12.383577 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:12.383558 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:12.388397 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:12.388374 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:13.315015 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:13.314972 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:13:13.361945 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:13.361906 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b6f9b895f-lg5q7"] Jun 14 16:13:15.962186 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:15.962128 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:13:38.382297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.382234 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b6f9b895f-lg5q7" podUID="824db01c-7a60-430e-80ab-7c64256d63f9" containerName="console" containerID="cri-o://73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b" gracePeriod=15 Jun 14 16:13:38.636076 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.636020 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:13:38.729554 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.729529 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-console-config\") pod \"824db01c-7a60-430e-80ab-7c64256d63f9\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " Jun 14 16:13:38.729718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.729595 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtc29\" (UniqueName: \"kubernetes.io/projected/824db01c-7a60-430e-80ab-7c64256d63f9-kube-api-access-jtc29\") pod \"824db01c-7a60-430e-80ab-7c64256d63f9\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " Jun 14 16:13:38.729718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.729619 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-oauth-serving-cert\") pod \"824db01c-7a60-430e-80ab-7c64256d63f9\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " Jun 14 16:13:38.729718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.729634 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-trusted-ca-bundle\") pod \"824db01c-7a60-430e-80ab-7c64256d63f9\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " Jun 14 16:13:38.729718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.729649 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-service-ca\") pod \"824db01c-7a60-430e-80ab-7c64256d63f9\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " Jun 14 16:13:38.729718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.729666 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-serving-cert\") pod \"824db01c-7a60-430e-80ab-7c64256d63f9\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " Jun 14 16:13:38.729960 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.729728 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-oauth-config\") pod \"824db01c-7a60-430e-80ab-7c64256d63f9\" (UID: \"824db01c-7a60-430e-80ab-7c64256d63f9\") " Jun 14 16:13:38.730019 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.729954 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-console-config" (OuterVolumeSpecName: "console-config") pod "824db01c-7a60-430e-80ab-7c64256d63f9" (UID: "824db01c-7a60-430e-80ab-7c64256d63f9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:38.730102 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.730080 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "824db01c-7a60-430e-80ab-7c64256d63f9" (UID: "824db01c-7a60-430e-80ab-7c64256d63f9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:38.730184 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.730152 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "824db01c-7a60-430e-80ab-7c64256d63f9" (UID: "824db01c-7a60-430e-80ab-7c64256d63f9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:38.730235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.730187 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "824db01c-7a60-430e-80ab-7c64256d63f9" (UID: "824db01c-7a60-430e-80ab-7c64256d63f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:13:38.731884 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.731861 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824db01c-7a60-430e-80ab-7c64256d63f9-kube-api-access-jtc29" (OuterVolumeSpecName: "kube-api-access-jtc29") pod "824db01c-7a60-430e-80ab-7c64256d63f9" (UID: "824db01c-7a60-430e-80ab-7c64256d63f9"). InnerVolumeSpecName "kube-api-access-jtc29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:13:38.731987 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.731932 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "824db01c-7a60-430e-80ab-7c64256d63f9" (UID: "824db01c-7a60-430e-80ab-7c64256d63f9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:38.731987 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.731975 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "824db01c-7a60-430e-80ab-7c64256d63f9" (UID: "824db01c-7a60-430e-80ab-7c64256d63f9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:13:38.831026 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.831002 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtc29\" (UniqueName: \"kubernetes.io/projected/824db01c-7a60-430e-80ab-7c64256d63f9-kube-api-access-jtc29\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:38.831026 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.831024 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-oauth-serving-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:38.831198 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.831033 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-trusted-ca-bundle\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:38.831198 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.831051 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-service-ca\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:38.831198 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.831061 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-serving-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:38.831198 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.831069 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824db01c-7a60-430e-80ab-7c64256d63f9-console-oauth-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:38.831198 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:38.831078 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824db01c-7a60-430e-80ab-7c64256d63f9-console-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:13:39.416795 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:39.416728 2575 generic.go:356] "Generic (PLEG): container finished" podID="824db01c-7a60-430e-80ab-7c64256d63f9" containerID="73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b" exitCode=0 Jun 14 16:13:39.417177 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:39.416827 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6f9b895f-lg5q7" Jun 14 16:13:39.417177 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:39.416817 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6f9b895f-lg5q7" event={"ID":"824db01c-7a60-430e-80ab-7c64256d63f9","Type":"ContainerDied","Data":"73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b"} Jun 14 16:13:39.417177 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:39.416997 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6f9b895f-lg5q7" event={"ID":"824db01c-7a60-430e-80ab-7c64256d63f9","Type":"ContainerDied","Data":"bf3f2f15948ec47db0f77a80d4e3ab642dc6be09c548d4356d9efcb5c577ccbb"} Jun 14 16:13:39.417177 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:39.417033 2575 scope.go:117] "RemoveContainer" containerID="73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b" Jun 14 16:13:39.427466 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:39.427207 2575 scope.go:117] "RemoveContainer" containerID="73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b" Jun 14 16:13:39.427579 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:13:39.427552 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b\": container with ID starting with 73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b not found: ID does not exist" containerID="73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b" Jun 14 16:13:39.427658 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:39.427590 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b"} err="failed to get container status \"73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b\": rpc error: code = NotFound desc = could not find container \"73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b\": container with ID starting with 73e11aac6c7973925e48db600629434d179a8e251c5242978e66a84910d2ed8b not found: ID does not exist" Jun 14 16:13:39.440164 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:39.440119 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b6f9b895f-lg5q7"] Jun 14 16:13:39.446427 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:39.446409 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b6f9b895f-lg5q7"] Jun 14 16:13:40.648717 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:13:40.648683 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="824db01c-7a60-430e-80ab-7c64256d63f9" path="/var/lib/kubelet/pods/824db01c-7a60-430e-80ab-7c64256d63f9/volumes" Jun 14 16:14:10.962010 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:10.961929 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:14:10.977034 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:10.977011 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:14:11.551996 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:11.551972 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:14:56.804163 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.804116 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79"] Jun 14 16:14:56.804768 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.804445 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824db01c-7a60-430e-80ab-7c64256d63f9" containerName="console" Jun 14 16:14:56.804768 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.804455 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="824db01c-7a60-430e-80ab-7c64256d63f9" containerName="console" Jun 14 16:14:56.804768 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.804522 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="824db01c-7a60-430e-80ab-7c64256d63f9" containerName="console" Jun 14 16:14:56.807551 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.807534 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.811608 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.811579 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 16:14:56.811740 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.811609 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 16:14:56.812144 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.812117 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 16:14:56.812269 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.812185 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7r5m2\"" Jun 14 16:14:56.812269 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.812249 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 16:14:56.827095 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.827070 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79"] Jun 14 16:14:56.869928 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.869901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/815f4603-1439-458e-ad45-c28e0bfe2d54-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.870120 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.869940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krmcd\" (UniqueName: \"kubernetes.io/projected/815f4603-1439-458e-ad45-c28e0bfe2d54-kube-api-access-krmcd\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.870120 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.869984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/815f4603-1439-458e-ad45-c28e0bfe2d54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.870120 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.870059 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/815f4603-1439-458e-ad45-c28e0bfe2d54-manifests\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.870314 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.870165 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/815f4603-1439-458e-ad45-c28e0bfe2d54-tmp\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.971033 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.970994 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/815f4603-1439-458e-ad45-c28e0bfe2d54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.971033 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.971032 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/815f4603-1439-458e-ad45-c28e0bfe2d54-manifests\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.971254 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.971079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/815f4603-1439-458e-ad45-c28e0bfe2d54-tmp\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.971254 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.971110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/815f4603-1439-458e-ad45-c28e0bfe2d54-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.971254 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.971195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krmcd\" (UniqueName: \"kubernetes.io/projected/815f4603-1439-458e-ad45-c28e0bfe2d54-kube-api-access-krmcd\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.971605 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.971567 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/815f4603-1439-458e-ad45-c28e0bfe2d54-manifests\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.973557 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.973533 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/815f4603-1439-458e-ad45-c28e0bfe2d54-tmp\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.973753 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.973737 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/815f4603-1439-458e-ad45-c28e0bfe2d54-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.973796 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.973757 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/815f4603-1439-458e-ad45-c28e0bfe2d54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:56.982621 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:56.982596 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krmcd\" (UniqueName: \"kubernetes.io/projected/815f4603-1439-458e-ad45-c28e0bfe2d54-kube-api-access-krmcd\") pod \"opendatahub-operator-controller-manager-7b9bbd87fc-vsv79\" (UID: \"815f4603-1439-458e-ad45-c28e0bfe2d54\") " pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:57.119154 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:57.119052 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:14:57.268972 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:57.268948 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79"] Jun 14 16:14:57.270931 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:14:57.270903 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815f4603_1439_458e_ad45_c28e0bfe2d54.slice/crio-a28852c72b1f2110ca8f955f27be3e0223b0f77071bc7e7dcab987f20083496d WatchSource:0}: Error finding container a28852c72b1f2110ca8f955f27be3e0223b0f77071bc7e7dcab987f20083496d: Status 404 returned error can't find the container with id a28852c72b1f2110ca8f955f27be3e0223b0f77071bc7e7dcab987f20083496d Jun 14 16:14:57.724242 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:14:57.724202 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" event={"ID":"815f4603-1439-458e-ad45-c28e0bfe2d54","Type":"ContainerStarted","Data":"a28852c72b1f2110ca8f955f27be3e0223b0f77071bc7e7dcab987f20083496d"} Jun 14 16:15:00.740410 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:00.740373 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" event={"ID":"815f4603-1439-458e-ad45-c28e0bfe2d54","Type":"ContainerStarted","Data":"93e51864ce081f8a906b93e9c1b4f636b5a9862008870b91c1b6250cd30bd86c"} Jun 14 16:15:01.745971 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:01.745934 2575 generic.go:356] "Generic (PLEG): container finished" podID="815f4603-1439-458e-ad45-c28e0bfe2d54" containerID="93e51864ce081f8a906b93e9c1b4f636b5a9862008870b91c1b6250cd30bd86c" exitCode=0 Jun 14 16:15:01.746376 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:01.745988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" event={"ID":"815f4603-1439-458e-ad45-c28e0bfe2d54","Type":"ContainerDied","Data":"93e51864ce081f8a906b93e9c1b4f636b5a9862008870b91c1b6250cd30bd86c"} Jun 14 16:15:02.752249 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:02.752207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" event={"ID":"815f4603-1439-458e-ad45-c28e0bfe2d54","Type":"ContainerStarted","Data":"eb61263392730e76141d0d5e3971a416f1e2ecdc1bec27aafccd3a3e9f1e72e2"} Jun 14 16:15:02.752606 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:02.752349 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:15:02.772720 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:02.772664 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" podStartSLOduration=2.669565999 podStartE2EDuration="6.772651952s" totalImagesPullingTime="3.142346538s" totalInitContainerRuntime="960.739415ms" isStatefulPod=false podCreationTimestamp="2026-06-14 16:14:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:15:02.770783719 +0000 UTC m=+224.534562810" watchObservedRunningTime="2026-06-14 16:15:02.772651952 +0000 UTC m=+224.536431051" Jun 14 16:15:13.758640 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:13.758609 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b9bbd87fc-vsv79" Jun 14 16:15:16.147259 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.147224 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86847bf95-7wb8f"] Jun 14 16:15:16.153252 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.153230 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.155242 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.155220 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 16:15:16.155356 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.155226 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 16:15:16.155860 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.155836 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wkhtd\"" Jun 14 16:15:16.155860 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.155852 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 16:15:16.155961 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.155877 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 16:15:16.164771 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.164749 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86847bf95-7wb8f"] Jun 14 16:15:16.239773 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.239742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75e81a29-4ebd-486e-b89e-92809d7cec5d-tmp\") pod \"kube-auth-proxy-86847bf95-7wb8f\" (UID: \"75e81a29-4ebd-486e-b89e-92809d7cec5d\") " pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.239936 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.239855 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75e81a29-4ebd-486e-b89e-92809d7cec5d-tls-certs\") pod \"kube-auth-proxy-86847bf95-7wb8f\" (UID: \"75e81a29-4ebd-486e-b89e-92809d7cec5d\") " pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.239936 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.239908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl28b\" (UniqueName: \"kubernetes.io/projected/75e81a29-4ebd-486e-b89e-92809d7cec5d-kube-api-access-vl28b\") pod \"kube-auth-proxy-86847bf95-7wb8f\" (UID: \"75e81a29-4ebd-486e-b89e-92809d7cec5d\") " pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.341037 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.341009 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl28b\" (UniqueName: \"kubernetes.io/projected/75e81a29-4ebd-486e-b89e-92809d7cec5d-kube-api-access-vl28b\") pod \"kube-auth-proxy-86847bf95-7wb8f\" (UID: \"75e81a29-4ebd-486e-b89e-92809d7cec5d\") " pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.341224 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.341066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75e81a29-4ebd-486e-b89e-92809d7cec5d-tmp\") pod \"kube-auth-proxy-86847bf95-7wb8f\" (UID: \"75e81a29-4ebd-486e-b89e-92809d7cec5d\") " pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.341224 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.341109 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75e81a29-4ebd-486e-b89e-92809d7cec5d-tls-certs\") pod \"kube-auth-proxy-86847bf95-7wb8f\" (UID: \"75e81a29-4ebd-486e-b89e-92809d7cec5d\") " pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.343399 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.343366 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75e81a29-4ebd-486e-b89e-92809d7cec5d-tmp\") pod \"kube-auth-proxy-86847bf95-7wb8f\" (UID: \"75e81a29-4ebd-486e-b89e-92809d7cec5d\") " pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.343507 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.343471 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75e81a29-4ebd-486e-b89e-92809d7cec5d-tls-certs\") pod \"kube-auth-proxy-86847bf95-7wb8f\" (UID: \"75e81a29-4ebd-486e-b89e-92809d7cec5d\") " pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.356029 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.356005 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl28b\" (UniqueName: \"kubernetes.io/projected/75e81a29-4ebd-486e-b89e-92809d7cec5d-kube-api-access-vl28b\") pod \"kube-auth-proxy-86847bf95-7wb8f\" (UID: \"75e81a29-4ebd-486e-b89e-92809d7cec5d\") " pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.463602 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.463532 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" Jun 14 16:15:16.592974 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.592946 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86847bf95-7wb8f"] Jun 14 16:15:16.595501 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:15:16.595475 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e81a29_4ebd_486e_b89e_92809d7cec5d.slice/crio-a2afba204f546a4a813c5cd71f06cb7d215d65489263a231e8cd6619973e364c WatchSource:0}: Error finding container a2afba204f546a4a813c5cd71f06cb7d215d65489263a231e8cd6619973e364c: Status 404 returned error can't find the container with id a2afba204f546a4a813c5cd71f06cb7d215d65489263a231e8cd6619973e364c Jun 14 16:15:16.812197 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.812105 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" event={"ID":"75e81a29-4ebd-486e-b89e-92809d7cec5d","Type":"ContainerStarted","Data":"a2afba204f546a4a813c5cd71f06cb7d215d65489263a231e8cd6619973e364c"} Jun 14 16:15:16.827677 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.827652 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln"] Jun 14 16:15:16.830308 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.830293 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:16.832671 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.832637 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 16:15:16.832843 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.832830 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 16:15:16.833251 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.833235 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 16:15:16.833365 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.833284 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 16:15:16.833365 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.833339 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 16:15:16.833479 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.833372 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kftjh\"" Jun 14 16:15:16.843056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.843036 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln"] Jun 14 16:15:16.946521 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.946494 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-metrics-cert\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:16.946666 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.946527 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt979\" (UniqueName: \"kubernetes.io/projected/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-kube-api-access-nt979\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:16.946666 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.946568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-cert\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:16.946666 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:16.946616 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-manager-config\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:17.047892 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.047859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-metrics-cert\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:17.047892 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.047893 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt979\" (UniqueName: \"kubernetes.io/projected/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-kube-api-access-nt979\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:17.048070 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.047938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-cert\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:17.048070 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.047960 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-manager-config\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:17.048694 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.048671 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-manager-config\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:17.050311 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.050285 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-cert\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:17.050381 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.050328 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-metrics-cert\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:17.058033 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.058015 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt979\" (UniqueName: \"kubernetes.io/projected/7c41bfc6-466b-4abf-8ad1-302f2bdc10ed-kube-api-access-nt979\") pod \"lws-controller-manager-74f4f55f59-f9cln\" (UID: \"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed\") " pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:17.139595 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.139568 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:17.279857 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.279815 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln"] Jun 14 16:15:17.286947 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:15:17.286916 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c41bfc6_466b_4abf_8ad1_302f2bdc10ed.slice/crio-9bf2b50f7057c6e96cd58bc6cc5a786ea3dca3bb3d18f952e8ec3bae67d4821f WatchSource:0}: Error finding container 9bf2b50f7057c6e96cd58bc6cc5a786ea3dca3bb3d18f952e8ec3bae67d4821f: Status 404 returned error can't find the container with id 9bf2b50f7057c6e96cd58bc6cc5a786ea3dca3bb3d18f952e8ec3bae67d4821f Jun 14 16:15:17.818730 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:17.818693 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" event={"ID":"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed","Type":"ContainerStarted","Data":"9bf2b50f7057c6e96cd58bc6cc5a786ea3dca3bb3d18f952e8ec3bae67d4821f"} Jun 14 16:15:20.673936 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:20.673914 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 16:15:20.835179 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:20.835122 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" event={"ID":"7c41bfc6-466b-4abf-8ad1-302f2bdc10ed","Type":"ContainerStarted","Data":"276292f59c4294b2cfd68145b1308ccf5065a3dc4c6d9da75d3ace49681efb62"} Jun 14 16:15:20.835334 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:20.835218 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:15:20.836665 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:20.836640 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" event={"ID":"75e81a29-4ebd-486e-b89e-92809d7cec5d","Type":"ContainerStarted","Data":"6aa4ef605a191abaef480c489275caf4aabc27be12b394298543b77a3cafb147"} Jun 14 16:15:20.854393 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:20.854342 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" podStartSLOduration=1.424080166 podStartE2EDuration="4.854328516s" totalImagesPullingTime="3.43024835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:15:20.852705872 +0000 UTC m=+242.616484971" watchObservedRunningTime="2026-06-14 16:15:20.854328516 +0000 UTC m=+242.618107615" Jun 14 16:15:20.867571 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:20.867527 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86847bf95-7wb8f" podStartSLOduration=0.793037103 podStartE2EDuration="4.867513322s" totalImagesPullingTime="4.074476219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:15:20.866754002 +0000 UTC m=+242.630533130" watchObservedRunningTime="2026-06-14 16:15:20.867513322 +0000 UTC m=+242.631292423" Jun 14 16:15:31.843994 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:15:31.843960 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74f4f55f59-f9cln" Jun 14 16:16:18.608350 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:16:18.608324 2575 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 16:17:09.231459 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.231386 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf"] Jun 14 16:17:09.233537 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.233518 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:09.236177 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.236158 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 16:17:09.236639 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.236622 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-459p9\"" Jun 14 16:17:09.236639 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.236638 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 16:17:09.236746 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.236625 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 14 16:17:09.237692 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.237676 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 14 16:17:09.246583 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.246562 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf"] Jun 14 16:17:09.366346 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.366315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/66a11076-f698-4937-99cf-79725685e76d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xhjvf\" (UID: \"66a11076-f698-4937-99cf-79725685e76d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:09.366511 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.366361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66a11076-f698-4937-99cf-79725685e76d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xhjvf\" (UID: \"66a11076-f698-4937-99cf-79725685e76d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:09.366511 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.366421 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdjsb\" (UniqueName: \"kubernetes.io/projected/66a11076-f698-4937-99cf-79725685e76d-kube-api-access-tdjsb\") pod \"kuadrant-console-plugin-66b5774985-xhjvf\" (UID: \"66a11076-f698-4937-99cf-79725685e76d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:09.467438 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.467410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/66a11076-f698-4937-99cf-79725685e76d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xhjvf\" (UID: \"66a11076-f698-4937-99cf-79725685e76d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:09.467595 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.467460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66a11076-f698-4937-99cf-79725685e76d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xhjvf\" (UID: \"66a11076-f698-4937-99cf-79725685e76d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:09.467595 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.467523 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdjsb\" (UniqueName: \"kubernetes.io/projected/66a11076-f698-4937-99cf-79725685e76d-kube-api-access-tdjsb\") pod \"kuadrant-console-plugin-66b5774985-xhjvf\" (UID: \"66a11076-f698-4937-99cf-79725685e76d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:09.467595 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:17:09.467562 2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 14 16:17:09.467757 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:17:09.467645 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a11076-f698-4937-99cf-79725685e76d-plugin-serving-cert podName:66a11076-f698-4937-99cf-79725685e76d nodeName:}" failed. No retries permitted until 2026-06-14 16:17:09.967625501 +0000 UTC m=+351.731404588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/66a11076-f698-4937-99cf-79725685e76d-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-xhjvf" (UID: "66a11076-f698-4937-99cf-79725685e76d") : secret "plugin-serving-cert" not found Jun 14 16:17:09.468186 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.468161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66a11076-f698-4937-99cf-79725685e76d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xhjvf\" (UID: \"66a11076-f698-4937-99cf-79725685e76d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:09.475592 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.475572 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdjsb\" (UniqueName: \"kubernetes.io/projected/66a11076-f698-4937-99cf-79725685e76d-kube-api-access-tdjsb\") pod \"kuadrant-console-plugin-66b5774985-xhjvf\" (UID: \"66a11076-f698-4937-99cf-79725685e76d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:09.972051 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.972015 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/66a11076-f698-4937-99cf-79725685e76d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xhjvf\" (UID: \"66a11076-f698-4937-99cf-79725685e76d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:09.974458 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:09.974431 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/66a11076-f698-4937-99cf-79725685e76d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xhjvf\" (UID: \"66a11076-f698-4937-99cf-79725685e76d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:10.150577 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:10.150545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" Jun 14 16:17:10.274826 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:10.274791 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf"] Jun 14 16:17:10.277357 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:17:10.277333 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66a11076_f698_4937_99cf_79725685e76d.slice/crio-e6e5ec2ed10ee4a958502a2aeea7b40c673311d9ac66c651d0ea6851a809ebdc WatchSource:0}: Error finding container e6e5ec2ed10ee4a958502a2aeea7b40c673311d9ac66c651d0ea6851a809ebdc: Status 404 returned error can't find the container with id e6e5ec2ed10ee4a958502a2aeea7b40c673311d9ac66c651d0ea6851a809ebdc Jun 14 16:17:10.278690 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:10.278663 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 16:17:10.295848 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:10.295822 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" event={"ID":"66a11076-f698-4937-99cf-79725685e76d","Type":"ContainerStarted","Data":"e6e5ec2ed10ee4a958502a2aeea7b40c673311d9ac66c651d0ea6851a809ebdc"} Jun 14 16:17:18.239989 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.239938 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2"] Jun 14 16:17:18.246631 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.246608 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:18.249619 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.249594 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pjm9n\"" Jun 14 16:17:18.261107 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.261086 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2"] Jun 14 16:17:18.354130 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.354096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/674ed29d-3d6c-4a92-869d-68628d0c3252-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6x7h2\" (UID: \"674ed29d-3d6c-4a92-869d-68628d0c3252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:18.354322 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.354282 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqtkp\" (UniqueName: \"kubernetes.io/projected/674ed29d-3d6c-4a92-869d-68628d0c3252-kube-api-access-fqtkp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6x7h2\" (UID: \"674ed29d-3d6c-4a92-869d-68628d0c3252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:18.455562 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.455520 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqtkp\" (UniqueName: \"kubernetes.io/projected/674ed29d-3d6c-4a92-869d-68628d0c3252-kube-api-access-fqtkp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6x7h2\" (UID: \"674ed29d-3d6c-4a92-869d-68628d0c3252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:18.455744 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.455609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/674ed29d-3d6c-4a92-869d-68628d0c3252-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6x7h2\" (UID: \"674ed29d-3d6c-4a92-869d-68628d0c3252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:18.456065 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.456037 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/674ed29d-3d6c-4a92-869d-68628d0c3252-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6x7h2\" (UID: \"674ed29d-3d6c-4a92-869d-68628d0c3252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:18.463611 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.463587 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqtkp\" (UniqueName: \"kubernetes.io/projected/674ed29d-3d6c-4a92-869d-68628d0c3252-kube-api-access-fqtkp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6x7h2\" (UID: \"674ed29d-3d6c-4a92-869d-68628d0c3252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:18.559729 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.559649 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:18.901210 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.901176 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2"] Jun 14 16:17:18.908744 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.908717 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2"] Jun 14 16:17:18.926665 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.926634 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4"] Jun 14 16:17:18.933087 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.933064 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:17:18.952890 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:18.952703 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4"] Jun 14 16:17:19.061694 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:19.061660 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26sx4\" (UID: \"d285b3b2-e6a7-45c1-84f6-eeb6af15a298\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:17:19.061859 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:19.061708 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vmf9\" (UniqueName: \"kubernetes.io/projected/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-kube-api-access-7vmf9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26sx4\" (UID: \"d285b3b2-e6a7-45c1-84f6-eeb6af15a298\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:17:19.162716 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:19.162631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26sx4\" (UID: \"d285b3b2-e6a7-45c1-84f6-eeb6af15a298\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:17:19.162716 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:19.162693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vmf9\" (UniqueName: \"kubernetes.io/projected/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-kube-api-access-7vmf9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26sx4\" (UID: \"d285b3b2-e6a7-45c1-84f6-eeb6af15a298\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:17:19.163084 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:19.163052 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26sx4\" (UID: \"d285b3b2-e6a7-45c1-84f6-eeb6af15a298\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:17:19.174527 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:19.174503 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vmf9\" (UniqueName: \"kubernetes.io/projected/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-kube-api-access-7vmf9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26sx4\" (UID: \"d285b3b2-e6a7-45c1-84f6-eeb6af15a298\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:17:19.246482 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:19.246446 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:17:27.853591 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:27.853528 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-784dd4c7bb-bsq7r"] Jun 14 16:17:27.952809 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:27.952770 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784dd4c7bb-bsq7r"] Jun 14 16:17:27.952983 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:27.952894 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.050529 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.050491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/812444c5-3fb0-4ad2-9271-33dcf1d95e19-console-serving-cert\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.050722 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.050538 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-trusted-ca-bundle\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.050722 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.050559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-oauth-serving-cert\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.050722 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.050637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-console-config\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.050722 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.050693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-service-ca\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.050722 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.050721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b9qs\" (UniqueName: \"kubernetes.io/projected/812444c5-3fb0-4ad2-9271-33dcf1d95e19-kube-api-access-9b9qs\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.051028 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.050753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/812444c5-3fb0-4ad2-9271-33dcf1d95e19-console-oauth-config\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.151978 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.151932 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/812444c5-3fb0-4ad2-9271-33dcf1d95e19-console-serving-cert\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.151978 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.151982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-trusted-ca-bundle\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.152216 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.152167 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-oauth-serving-cert\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.152280 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.152263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-console-config\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.152334 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.152320 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-service-ca\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.152388 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.152361 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9qs\" (UniqueName: \"kubernetes.io/projected/812444c5-3fb0-4ad2-9271-33dcf1d95e19-kube-api-access-9b9qs\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.153011 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.152782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/812444c5-3fb0-4ad2-9271-33dcf1d95e19-console-oauth-config\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.153011 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.152932 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-oauth-serving-cert\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.153011 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.152975 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-console-config\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.153011 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.152999 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-trusted-ca-bundle\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.153401 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.153377 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/812444c5-3fb0-4ad2-9271-33dcf1d95e19-service-ca\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.154849 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.154820 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/812444c5-3fb0-4ad2-9271-33dcf1d95e19-console-serving-cert\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.155272 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.155253 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/812444c5-3fb0-4ad2-9271-33dcf1d95e19-console-oauth-config\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.165244 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.165224 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b9qs\" (UniqueName: \"kubernetes.io/projected/812444c5-3fb0-4ad2-9271-33dcf1d95e19-kube-api-access-9b9qs\") pod \"console-784dd4c7bb-bsq7r\" (UID: \"812444c5-3fb0-4ad2-9271-33dcf1d95e19\") " pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:28.270976 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:28.270936 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:32.155549 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:32.155526 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4"] Jun 14 16:17:32.158188 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:17:32.158166 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd285b3b2_e6a7_45c1_84f6_eeb6af15a298.slice/crio-81f09c3abf8365b0a6d06606c991ae2b924f50c06add7f18390e3fce1e4dbd40 WatchSource:0}: Error finding container 81f09c3abf8365b0a6d06606c991ae2b924f50c06add7f18390e3fce1e4dbd40: Status 404 returned error can't find the container with id 81f09c3abf8365b0a6d06606c991ae2b924f50c06add7f18390e3fce1e4dbd40 Jun 14 16:17:32.176919 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:32.176895 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784dd4c7bb-bsq7r"] Jun 14 16:17:32.178505 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:17:32.178482 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812444c5_3fb0_4ad2_9271_33dcf1d95e19.slice/crio-52e0ccd54785008020b516fa655699e81451638fc2c5ed4ed374e14d9ff43bd7 WatchSource:0}: Error finding container 52e0ccd54785008020b516fa655699e81451638fc2c5ed4ed374e14d9ff43bd7: Status 404 returned error can't find the container with id 52e0ccd54785008020b516fa655699e81451638fc2c5ed4ed374e14d9ff43bd7 Jun 14 16:17:32.408961 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:32.408926 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" event={"ID":"66a11076-f698-4937-99cf-79725685e76d","Type":"ContainerStarted","Data":"8ee6c49ba3a55054ea5a42faf175b637cd730c0989ab91261b5bfe9cbb39b295"} Jun 14 16:17:32.410184 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:32.410163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" event={"ID":"d285b3b2-e6a7-45c1-84f6-eeb6af15a298","Type":"ContainerStarted","Data":"81f09c3abf8365b0a6d06606c991ae2b924f50c06add7f18390e3fce1e4dbd40"} Jun 14 16:17:32.411569 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:32.411550 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784dd4c7bb-bsq7r" event={"ID":"812444c5-3fb0-4ad2-9271-33dcf1d95e19","Type":"ContainerStarted","Data":"edb658ece9da2b79d670fa17cf5487fff4781bfdd75a0967e18640785aa47689"} Jun 14 16:17:32.411636 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:32.411585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784dd4c7bb-bsq7r" event={"ID":"812444c5-3fb0-4ad2-9271-33dcf1d95e19","Type":"ContainerStarted","Data":"52e0ccd54785008020b516fa655699e81451638fc2c5ed4ed374e14d9ff43bd7"} Jun 14 16:17:32.428467 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:32.428423 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhjvf" podStartSLOduration=1.625153499 podStartE2EDuration="23.428409653s" totalImagesPullingTime="21.803256154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:17:32.426872344 +0000 UTC m=+374.190651422" watchObservedRunningTime="2026-06-14 16:17:32.428409653 +0000 UTC m=+374.192188784" Jun 14 16:17:32.458127 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:32.458076 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-784dd4c7bb-bsq7r" podStartSLOduration=5.458057013 podStartE2EDuration="5.458057013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:17:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:17:32.456637742 +0000 UTC m=+374.220416834" watchObservedRunningTime="2026-06-14 16:17:32.458057013 +0000 UTC m=+374.221836113" Jun 14 16:17:34.538444 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:17:34.538405 2575 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-6x7h2_kuadrant-system_674ed29d-3d6c-4a92-869d-68628d0c3252_0(9824e8c5b1a500d3b76b19bfa8343038ffb4a16369a7c591f93d2218694a7105): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-6x7h2 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 14 16:17:34.538742 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:17:34.538477 2575 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-6x7h2_kuadrant-system_674ed29d-3d6c-4a92-869d-68628d0c3252_0(9824e8c5b1a500d3b76b19bfa8343038ffb4a16369a7c591f93d2218694a7105): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-6x7h2 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:35.426204 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:35.426174 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:35.429096 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:17:35.429066 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6x7h2\" is forbidden: User \"system:node:ip-10-0-138-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-105.ec2.internal' and this object" podUID="674ed29d-3d6c-4a92-869d-68628d0c3252" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:35.434001 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:35.433978 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:35.437388 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:17:35.437364 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6x7h2\" is forbidden: User \"system:node:ip-10-0-138-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-105.ec2.internal' and this object" podUID="674ed29d-3d6c-4a92-869d-68628d0c3252" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:35.516303 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:35.516272 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/674ed29d-3d6c-4a92-869d-68628d0c3252-extensions-socket-volume\") pod \"674ed29d-3d6c-4a92-869d-68628d0c3252\" (UID: \"674ed29d-3d6c-4a92-869d-68628d0c3252\") " Jun 14 16:17:35.516448 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:35.516392 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqtkp\" (UniqueName: \"kubernetes.io/projected/674ed29d-3d6c-4a92-869d-68628d0c3252-kube-api-access-fqtkp\") pod \"674ed29d-3d6c-4a92-869d-68628d0c3252\" (UID: \"674ed29d-3d6c-4a92-869d-68628d0c3252\") " Jun 14 16:17:35.516577 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:35.516550 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674ed29d-3d6c-4a92-869d-68628d0c3252-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "674ed29d-3d6c-4a92-869d-68628d0c3252" (UID: "674ed29d-3d6c-4a92-869d-68628d0c3252"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 16:17:35.516680 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:35.516662 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/674ed29d-3d6c-4a92-869d-68628d0c3252-extensions-socket-volume\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:17:35.518357 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:35.518338 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674ed29d-3d6c-4a92-869d-68628d0c3252-kube-api-access-fqtkp" (OuterVolumeSpecName: "kube-api-access-fqtkp") pod "674ed29d-3d6c-4a92-869d-68628d0c3252" (UID: "674ed29d-3d6c-4a92-869d-68628d0c3252"). InnerVolumeSpecName "kube-api-access-fqtkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:17:35.617735 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:35.617704 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqtkp\" (UniqueName: \"kubernetes.io/projected/674ed29d-3d6c-4a92-869d-68628d0c3252-kube-api-access-fqtkp\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:17:36.432081 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:36.432050 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:36.434614 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:17:36.434580 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6x7h2\" is forbidden: User \"system:node:ip-10-0-138-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-105.ec2.internal' and this object" podUID="674ed29d-3d6c-4a92-869d-68628d0c3252" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:36.441271 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:17:36.441239 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6x7h2\" is forbidden: User \"system:node:ip-10-0-138-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-105.ec2.internal' and this object" podUID="674ed29d-3d6c-4a92-869d-68628d0c3252" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6x7h2" Jun 14 16:17:36.651147 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:36.651111 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674ed29d-3d6c-4a92-869d-68628d0c3252" path="/var/lib/kubelet/pods/674ed29d-3d6c-4a92-869d-68628d0c3252/volumes" Jun 14 16:17:38.272118 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:38.272082 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:38.272531 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:38.272161 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:38.276609 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:38.276585 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:38.441783 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:38.441739 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" event={"ID":"d285b3b2-e6a7-45c1-84f6-eeb6af15a298","Type":"ContainerStarted","Data":"d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922"} Jun 14 16:17:38.442019 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:38.441989 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:17:38.445748 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:38.445718 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-784dd4c7bb-bsq7r" Jun 14 16:17:38.468561 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:38.468517 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" podStartSLOduration=15.12985748 podStartE2EDuration="20.468503611s" totalImagesPullingTime="5.338646131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:17:38.468286895 +0000 UTC m=+380.232065997" watchObservedRunningTime="2026-06-14 16:17:38.468503611 +0000 UTC m=+380.232282710" Jun 14 16:17:38.528657 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:38.528583 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5994d5bb97-52gqr"] Jun 14 16:17:49.448415 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:17:49.448376 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:18:01.542335 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:01.542304 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4"] Jun 14 16:18:01.542862 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:01.542549 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" podUID="d285b3b2-e6a7-45c1-84f6-eeb6af15a298" containerName="manager" containerID="cri-o://d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922" gracePeriod=10 Jun 14 16:18:01.817103 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:01.817073 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:18:01.967585 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:01.967550 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-extensions-socket-volume\") pod \"d285b3b2-e6a7-45c1-84f6-eeb6af15a298\" (UID: \"d285b3b2-e6a7-45c1-84f6-eeb6af15a298\") " Jun 14 16:18:01.967585 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:01.967595 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vmf9\" (UniqueName: \"kubernetes.io/projected/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-kube-api-access-7vmf9\") pod \"d285b3b2-e6a7-45c1-84f6-eeb6af15a298\" (UID: \"d285b3b2-e6a7-45c1-84f6-eeb6af15a298\") " Jun 14 16:18:01.968028 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:01.968002 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d285b3b2-e6a7-45c1-84f6-eeb6af15a298" (UID: "d285b3b2-e6a7-45c1-84f6-eeb6af15a298"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 16:18:01.969808 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:01.969786 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-kube-api-access-7vmf9" (OuterVolumeSpecName: "kube-api-access-7vmf9") pod "d285b3b2-e6a7-45c1-84f6-eeb6af15a298" (UID: "d285b3b2-e6a7-45c1-84f6-eeb6af15a298"). InnerVolumeSpecName "kube-api-access-7vmf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:18:02.068845 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.068781 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vmf9\" (UniqueName: \"kubernetes.io/projected/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-kube-api-access-7vmf9\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:02.068845 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.068807 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d285b3b2-e6a7-45c1-84f6-eeb6af15a298-extensions-socket-volume\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:02.544105 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.544070 2575 generic.go:356] "Generic (PLEG): container finished" podID="d285b3b2-e6a7-45c1-84f6-eeb6af15a298" containerID="d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922" exitCode=0 Jun 14 16:18:02.544553 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.544119 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" Jun 14 16:18:02.544553 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.544116 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" event={"ID":"d285b3b2-e6a7-45c1-84f6-eeb6af15a298","Type":"ContainerDied","Data":"d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922"} Jun 14 16:18:02.544553 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.544254 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4" event={"ID":"d285b3b2-e6a7-45c1-84f6-eeb6af15a298","Type":"ContainerDied","Data":"81f09c3abf8365b0a6d06606c991ae2b924f50c06add7f18390e3fce1e4dbd40"} Jun 14 16:18:02.544553 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.544277 2575 scope.go:117] "RemoveContainer" containerID="d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922" Jun 14 16:18:02.552762 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.552741 2575 scope.go:117] "RemoveContainer" containerID="d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922" Jun 14 16:18:02.553027 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:18:02.553010 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922\": container with ID starting with d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922 not found: ID does not exist" containerID="d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922" Jun 14 16:18:02.553101 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.553037 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922"} err="failed to get container status \"d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922\": rpc error: code = NotFound desc = could not find container \"d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922\": container with ID starting with d482869fc82d0b22beba8f075b7101ac24b05a2a5e679e46c717bdc75d30c922 not found: ID does not exist" Jun 14 16:18:02.565217 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.565196 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4"] Jun 14 16:18:02.570099 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.570075 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26sx4"] Jun 14 16:18:02.649324 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:02.649300 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d285b3b2-e6a7-45c1-84f6-eeb6af15a298" path="/var/lib/kubelet/pods/d285b3b2-e6a7-45c1-84f6-eeb6af15a298/volumes" Jun 14 16:18:03.548701 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:03.548666 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5994d5bb97-52gqr" podUID="47f1ce53-36a8-4966-931a-aebf920b3cf4" containerName="console" containerID="cri-o://ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e" gracePeriod=15 Jun 14 16:18:04.298489 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.298465 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:18:04.388953 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.388928 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-service-ca\") pod \"47f1ce53-36a8-4966-931a-aebf920b3cf4\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " Jun 14 16:18:04.389099 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.388969 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-oauth-serving-cert\") pod \"47f1ce53-36a8-4966-931a-aebf920b3cf4\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " Jun 14 16:18:04.389099 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.389001 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-oauth-config\") pod \"47f1ce53-36a8-4966-931a-aebf920b3cf4\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " Jun 14 16:18:04.389099 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.389060 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-trusted-ca-bundle\") pod \"47f1ce53-36a8-4966-931a-aebf920b3cf4\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " Jun 14 16:18:04.389272 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.389114 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwbzs\" (UniqueName: \"kubernetes.io/projected/47f1ce53-36a8-4966-931a-aebf920b3cf4-kube-api-access-nwbzs\") pod \"47f1ce53-36a8-4966-931a-aebf920b3cf4\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " Jun 14 16:18:04.389272 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.389173 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-config\") pod \"47f1ce53-36a8-4966-931a-aebf920b3cf4\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " Jun 14 16:18:04.389272 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.389204 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-serving-cert\") pod \"47f1ce53-36a8-4966-931a-aebf920b3cf4\" (UID: \"47f1ce53-36a8-4966-931a-aebf920b3cf4\") " Jun 14 16:18:04.389555 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.389428 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "47f1ce53-36a8-4966-931a-aebf920b3cf4" (UID: "47f1ce53-36a8-4966-931a-aebf920b3cf4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:18:04.389674 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.389435 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-service-ca" (OuterVolumeSpecName: "service-ca") pod "47f1ce53-36a8-4966-931a-aebf920b3cf4" (UID: "47f1ce53-36a8-4966-931a-aebf920b3cf4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:18:04.389674 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.389525 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "47f1ce53-36a8-4966-931a-aebf920b3cf4" (UID: "47f1ce53-36a8-4966-931a-aebf920b3cf4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:18:04.389674 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.389615 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-config" (OuterVolumeSpecName: "console-config") pod "47f1ce53-36a8-4966-931a-aebf920b3cf4" (UID: "47f1ce53-36a8-4966-931a-aebf920b3cf4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:18:04.391222 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.391191 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f1ce53-36a8-4966-931a-aebf920b3cf4-kube-api-access-nwbzs" (OuterVolumeSpecName: "kube-api-access-nwbzs") pod "47f1ce53-36a8-4966-931a-aebf920b3cf4" (UID: "47f1ce53-36a8-4966-931a-aebf920b3cf4"). InnerVolumeSpecName "kube-api-access-nwbzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:18:04.391327 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.391303 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "47f1ce53-36a8-4966-931a-aebf920b3cf4" (UID: "47f1ce53-36a8-4966-931a-aebf920b3cf4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:18:04.391399 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.391345 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "47f1ce53-36a8-4966-931a-aebf920b3cf4" (UID: "47f1ce53-36a8-4966-931a-aebf920b3cf4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:18:04.490316 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.490261 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-oauth-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:04.490316 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.490281 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-trusted-ca-bundle\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:04.490316 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.490291 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwbzs\" (UniqueName: \"kubernetes.io/projected/47f1ce53-36a8-4966-931a-aebf920b3cf4-kube-api-access-nwbzs\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:04.490469 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.490319 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-config\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:04.490469 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.490329 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f1ce53-36a8-4966-931a-aebf920b3cf4-console-serving-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:04.490469 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.490337 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-service-ca\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:04.490469 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.490346 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47f1ce53-36a8-4966-931a-aebf920b3cf4-oauth-serving-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:04.555004 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.554975 2575 generic.go:356] "Generic (PLEG): container finished" podID="47f1ce53-36a8-4966-931a-aebf920b3cf4" containerID="ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e" exitCode=0 Jun 14 16:18:04.555383 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.555020 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994d5bb97-52gqr" Jun 14 16:18:04.555383 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.555050 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994d5bb97-52gqr" event={"ID":"47f1ce53-36a8-4966-931a-aebf920b3cf4","Type":"ContainerDied","Data":"ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e"} Jun 14 16:18:04.555383 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.555100 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994d5bb97-52gqr" event={"ID":"47f1ce53-36a8-4966-931a-aebf920b3cf4","Type":"ContainerDied","Data":"8d864b68074a1adea0b2ecb0d2e23660da79550acde29496bf3eeee00dc3c527"} Jun 14 16:18:04.555383 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.555120 2575 scope.go:117] "RemoveContainer" containerID="ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e" Jun 14 16:18:04.563237 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.563221 2575 scope.go:117] "RemoveContainer" containerID="ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e" Jun 14 16:18:04.563518 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:18:04.563503 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e\": container with ID starting with ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e not found: ID does not exist" containerID="ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e" Jun 14 16:18:04.563553 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.563525 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e"} err="failed to get container status \"ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e\": rpc error: code = NotFound desc = could not find container \"ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e\": container with ID starting with ba161cacf07fba4cbc3486eb3b9fffe49e33ebab83794bf8ece096dbba594c4e not found: ID does not exist" Jun 14 16:18:04.576384 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.576363 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5994d5bb97-52gqr"] Jun 14 16:18:04.580530 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.580511 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5994d5bb97-52gqr"] Jun 14 16:18:04.650181 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:04.650155 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47f1ce53-36a8-4966-931a-aebf920b3cf4" path="/var/lib/kubelet/pods/47f1ce53-36a8-4966-931a-aebf920b3cf4/volumes" Jun 14 16:18:09.667558 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.667512 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jp997"] Jun 14 16:18:09.668038 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.667859 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d285b3b2-e6a7-45c1-84f6-eeb6af15a298" containerName="manager" Jun 14 16:18:09.668038 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.667870 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d285b3b2-e6a7-45c1-84f6-eeb6af15a298" containerName="manager" Jun 14 16:18:09.668038 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.667883 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f1ce53-36a8-4966-931a-aebf920b3cf4" containerName="console" Jun 14 16:18:09.668038 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.667889 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f1ce53-36a8-4966-931a-aebf920b3cf4" containerName="console" Jun 14 16:18:09.668038 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.667971 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d285b3b2-e6a7-45c1-84f6-eeb6af15a298" containerName="manager" Jun 14 16:18:09.668038 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.667980 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="47f1ce53-36a8-4966-931a-aebf920b3cf4" containerName="console" Jun 14 16:18:09.671743 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.671724 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:09.673704 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.673678 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 16:18:09.682011 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.681990 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jp997"] Jun 14 16:18:09.733891 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.733862 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-config-file\") pod \"limitador-limitador-64c94fd64f-jp997\" (UID: \"4ffb76e7-362b-48e6-a11e-3fb98b00e09c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:09.734031 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.733968 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7jvj\" (UniqueName: \"kubernetes.io/projected/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-kube-api-access-t7jvj\") pod \"limitador-limitador-64c94fd64f-jp997\" (UID: \"4ffb76e7-362b-48e6-a11e-3fb98b00e09c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:09.773835 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.773804 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jp997"] Jun 14 16:18:09.834521 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.834486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7jvj\" (UniqueName: \"kubernetes.io/projected/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-kube-api-access-t7jvj\") pod \"limitador-limitador-64c94fd64f-jp997\" (UID: \"4ffb76e7-362b-48e6-a11e-3fb98b00e09c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:09.834671 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.834566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-config-file\") pod \"limitador-limitador-64c94fd64f-jp997\" (UID: \"4ffb76e7-362b-48e6-a11e-3fb98b00e09c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:09.835114 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.835097 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-config-file\") pod \"limitador-limitador-64c94fd64f-jp997\" (UID: \"4ffb76e7-362b-48e6-a11e-3fb98b00e09c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:09.842933 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.842902 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7jvj\" (UniqueName: \"kubernetes.io/projected/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-kube-api-access-t7jvj\") pod \"limitador-limitador-64c94fd64f-jp997\" (UID: \"4ffb76e7-362b-48e6-a11e-3fb98b00e09c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:09.982549 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:09.982469 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:10.128108 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.128078 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jp997"] Jun 14 16:18:10.131371 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:18:10.131340 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ffb76e7_362b_48e6_a11e_3fb98b00e09c.slice/crio-f14da3b7a6d7f1d9fd7b8cc245f24347f794bc4513dba6fbe420a895f239c6fc WatchSource:0}: Error finding container f14da3b7a6d7f1d9fd7b8cc245f24347f794bc4513dba6fbe420a895f239c6fc: Status 404 returned error can't find the container with id f14da3b7a6d7f1d9fd7b8cc245f24347f794bc4513dba6fbe420a895f239c6fc Jun 14 16:18:10.506864 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.506824 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zdhkc"] Jun 14 16:18:10.538168 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.538126 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zdhkc"] Jun 14 16:18:10.538312 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.538229 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zdhkc" Jun 14 16:18:10.539400 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.539375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s58t7\" (UniqueName: \"kubernetes.io/projected/c942351b-f8ca-40a3-a86c-265ce148133a-kube-api-access-s58t7\") pod \"authorino-58cd955675-zdhkc\" (UID: \"c942351b-f8ca-40a3-a86c-265ce148133a\") " pod="kuadrant-system/authorino-58cd955675-zdhkc" Jun 14 16:18:10.540195 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.540175 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9gf8w\"" Jun 14 16:18:10.585107 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.585082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" event={"ID":"4ffb76e7-362b-48e6-a11e-3fb98b00e09c","Type":"ContainerStarted","Data":"f14da3b7a6d7f1d9fd7b8cc245f24347f794bc4513dba6fbe420a895f239c6fc"} Jun 14 16:18:10.640541 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.640506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s58t7\" (UniqueName: \"kubernetes.io/projected/c942351b-f8ca-40a3-a86c-265ce148133a-kube-api-access-s58t7\") pod \"authorino-58cd955675-zdhkc\" (UID: \"c942351b-f8ca-40a3-a86c-265ce148133a\") " pod="kuadrant-system/authorino-58cd955675-zdhkc" Jun 14 16:18:10.643544 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.643521 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5hjs"] Jun 14 16:18:10.649222 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.649201 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s58t7\" (UniqueName: \"kubernetes.io/projected/c942351b-f8ca-40a3-a86c-265ce148133a-kube-api-access-s58t7\") pod \"authorino-58cd955675-zdhkc\" (UID: \"c942351b-f8ca-40a3-a86c-265ce148133a\") " pod="kuadrant-system/authorino-58cd955675-zdhkc" Jun 14 16:18:10.663378 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.663358 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k5hjs" Jun 14 16:18:10.663378 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.663361 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5hjs"] Jun 14 16:18:10.741478 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.741449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4w4v\" (UniqueName: \"kubernetes.io/projected/d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f-kube-api-access-l4w4v\") pod \"authorino-75d556bd77-k5hjs\" (UID: \"d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f\") " pod="kuadrant-system/authorino-75d556bd77-k5hjs" Jun 14 16:18:10.842359 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.842278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4w4v\" (UniqueName: \"kubernetes.io/projected/d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f-kube-api-access-l4w4v\") pod \"authorino-75d556bd77-k5hjs\" (UID: \"d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f\") " pod="kuadrant-system/authorino-75d556bd77-k5hjs" Jun 14 16:18:10.847977 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.847952 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zdhkc" Jun 14 16:18:10.850975 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.850955 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4w4v\" (UniqueName: \"kubernetes.io/projected/d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f-kube-api-access-l4w4v\") pod \"authorino-75d556bd77-k5hjs\" (UID: \"d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f\") " pod="kuadrant-system/authorino-75d556bd77-k5hjs" Jun 14 16:18:10.973020 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:10.972959 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k5hjs" Jun 14 16:18:11.015028 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:11.014904 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zdhkc"] Jun 14 16:18:11.019018 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:18:11.018985 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc942351b_f8ca_40a3_a86c_265ce148133a.slice/crio-296ca2da9315fc5e40ad5b4829c0daeffcaba005bb44e7a854a9b900c1179ff3 WatchSource:0}: Error finding container 296ca2da9315fc5e40ad5b4829c0daeffcaba005bb44e7a854a9b900c1179ff3: Status 404 returned error can't find the container with id 296ca2da9315fc5e40ad5b4829c0daeffcaba005bb44e7a854a9b900c1179ff3 Jun 14 16:18:11.145276 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:11.145240 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5hjs"] Jun 14 16:18:11.153110 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:18:11.153076 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd82d1cc1_0924_4739_92a1_ae2a4b7c5a2f.slice/crio-4dfa94010064601a6b80d50bd67a709ee6ce0ea28d28e0de1d77b764258fd2a6 WatchSource:0}: Error finding container 4dfa94010064601a6b80d50bd67a709ee6ce0ea28d28e0de1d77b764258fd2a6: Status 404 returned error can't find the container with id 4dfa94010064601a6b80d50bd67a709ee6ce0ea28d28e0de1d77b764258fd2a6 Jun 14 16:18:11.599262 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:11.599167 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zdhkc" event={"ID":"c942351b-f8ca-40a3-a86c-265ce148133a","Type":"ContainerStarted","Data":"296ca2da9315fc5e40ad5b4829c0daeffcaba005bb44e7a854a9b900c1179ff3"} Jun 14 16:18:11.600807 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:11.600774 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k5hjs" event={"ID":"d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f","Type":"ContainerStarted","Data":"4dfa94010064601a6b80d50bd67a709ee6ce0ea28d28e0de1d77b764258fd2a6"} Jun 14 16:18:15.625748 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:15.625655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zdhkc" event={"ID":"c942351b-f8ca-40a3-a86c-265ce148133a","Type":"ContainerStarted","Data":"72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581"} Jun 14 16:18:15.627235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:15.627209 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k5hjs" event={"ID":"d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f","Type":"ContainerStarted","Data":"5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8"} Jun 14 16:18:15.628538 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:15.628514 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" event={"ID":"4ffb76e7-362b-48e6-a11e-3fb98b00e09c","Type":"ContainerStarted","Data":"b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038"} Jun 14 16:18:15.628691 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:15.628640 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:15.640393 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:15.640349 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zdhkc" podStartSLOduration=1.281552931 podStartE2EDuration="5.640333402s" totalImagesPullingTime="4.358780471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:18:15.639574099 +0000 UTC m=+417.403353199" watchObservedRunningTime="2026-06-14 16:18:15.640333402 +0000 UTC m=+417.404112504" Jun 14 16:18:15.656883 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:15.656827 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-k5hjs" podStartSLOduration=1.432297767 podStartE2EDuration="5.656812437s" totalImagesPullingTime="4.22451467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:18:15.656084703 +0000 UTC m=+417.419863807" watchObservedRunningTime="2026-06-14 16:18:15.656812437 +0000 UTC m=+417.420591537" Jun 14 16:18:15.674287 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:15.674243 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" podStartSLOduration=1.416897399 podStartE2EDuration="6.674228468s" totalImagesPullingTime="5.257331069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:18:15.672674108 +0000 UTC m=+417.436453212" watchObservedRunningTime="2026-06-14 16:18:15.674228468 +0000 UTC m=+417.438007568" Jun 14 16:18:15.691435 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:15.691399 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zdhkc"] Jun 14 16:18:17.637753 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:17.637701 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zdhkc" podUID="c942351b-f8ca-40a3-a86c-265ce148133a" containerName="authorino" containerID="cri-o://72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581" gracePeriod=30 Jun 14 16:18:17.875443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:17.875414 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zdhkc" Jun 14 16:18:17.911623 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:17.911550 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s58t7\" (UniqueName: \"kubernetes.io/projected/c942351b-f8ca-40a3-a86c-265ce148133a-kube-api-access-s58t7\") pod \"c942351b-f8ca-40a3-a86c-265ce148133a\" (UID: \"c942351b-f8ca-40a3-a86c-265ce148133a\") " Jun 14 16:18:17.913650 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:17.913613 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c942351b-f8ca-40a3-a86c-265ce148133a-kube-api-access-s58t7" (OuterVolumeSpecName: "kube-api-access-s58t7") pod "c942351b-f8ca-40a3-a86c-265ce148133a" (UID: "c942351b-f8ca-40a3-a86c-265ce148133a"). InnerVolumeSpecName "kube-api-access-s58t7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:18:18.012754 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:18.012717 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s58t7\" (UniqueName: \"kubernetes.io/projected/c942351b-f8ca-40a3-a86c-265ce148133a-kube-api-access-s58t7\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:18.643269 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:18.643232 2575 generic.go:356] "Generic (PLEG): container finished" podID="c942351b-f8ca-40a3-a86c-265ce148133a" containerID="72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581" exitCode=0 Jun 14 16:18:18.643733 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:18.643280 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zdhkc" event={"ID":"c942351b-f8ca-40a3-a86c-265ce148133a","Type":"ContainerDied","Data":"72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581"} Jun 14 16:18:18.643733 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:18.643298 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zdhkc" Jun 14 16:18:18.643733 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:18.643312 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zdhkc" event={"ID":"c942351b-f8ca-40a3-a86c-265ce148133a","Type":"ContainerDied","Data":"296ca2da9315fc5e40ad5b4829c0daeffcaba005bb44e7a854a9b900c1179ff3"} Jun 14 16:18:18.643733 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:18.643328 2575 scope.go:117] "RemoveContainer" containerID="72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581" Jun 14 16:18:18.653236 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:18.653216 2575 scope.go:117] "RemoveContainer" containerID="72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581" Jun 14 16:18:18.653551 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:18:18.653524 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581\": container with ID starting with 72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581 not found: ID does not exist" containerID="72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581" Jun 14 16:18:18.653641 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:18.653560 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581"} err="failed to get container status \"72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581\": rpc error: code = NotFound desc = could not find container \"72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581\": container with ID starting with 72e7834a2ed65b9f95bee894a0654e07e2af78945c223273042046705e10e581 not found: ID does not exist" Jun 14 16:18:18.666291 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:18.666270 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zdhkc"] Jun 14 16:18:18.669757 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:18.669736 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zdhkc"] Jun 14 16:18:20.649492 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:20.649461 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c942351b-f8ca-40a3-a86c-265ce148133a" path="/var/lib/kubelet/pods/c942351b-f8ca-40a3-a86c-265ce148133a/volumes" Jun 14 16:18:24.676177 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:24.676130 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jp997"] Jun 14 16:18:24.676567 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:24.676334 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" podUID="4ffb76e7-362b-48e6-a11e-3fb98b00e09c" containerName="limitador" containerID="cri-o://b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038" gracePeriod=30 Jun 14 16:18:24.678026 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:24.678005 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:25.228767 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.228742 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:25.274792 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.274721 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-config-file\") pod \"4ffb76e7-362b-48e6-a11e-3fb98b00e09c\" (UID: \"4ffb76e7-362b-48e6-a11e-3fb98b00e09c\") " Jun 14 16:18:25.274792 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.274767 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7jvj\" (UniqueName: \"kubernetes.io/projected/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-kube-api-access-t7jvj\") pod \"4ffb76e7-362b-48e6-a11e-3fb98b00e09c\" (UID: \"4ffb76e7-362b-48e6-a11e-3fb98b00e09c\") " Jun 14 16:18:25.275062 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.275039 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-config-file" (OuterVolumeSpecName: "config-file") pod "4ffb76e7-362b-48e6-a11e-3fb98b00e09c" (UID: "4ffb76e7-362b-48e6-a11e-3fb98b00e09c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:18:25.276718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.276691 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-kube-api-access-t7jvj" (OuterVolumeSpecName: "kube-api-access-t7jvj") pod "4ffb76e7-362b-48e6-a11e-3fb98b00e09c" (UID: "4ffb76e7-362b-48e6-a11e-3fb98b00e09c"). InnerVolumeSpecName "kube-api-access-t7jvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:18:25.375924 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.375897 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-config-file\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:25.375924 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.375921 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7jvj\" (UniqueName: \"kubernetes.io/projected/4ffb76e7-362b-48e6-a11e-3fb98b00e09c-kube-api-access-t7jvj\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:18:25.671837 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.671809 2575 generic.go:356] "Generic (PLEG): container finished" podID="4ffb76e7-362b-48e6-a11e-3fb98b00e09c" containerID="b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038" exitCode=0 Jun 14 16:18:25.672014 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.671843 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" Jun 14 16:18:25.672014 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.671856 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" event={"ID":"4ffb76e7-362b-48e6-a11e-3fb98b00e09c","Type":"ContainerDied","Data":"b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038"} Jun 14 16:18:25.672014 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.671896 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jp997" event={"ID":"4ffb76e7-362b-48e6-a11e-3fb98b00e09c","Type":"ContainerDied","Data":"f14da3b7a6d7f1d9fd7b8cc245f24347f794bc4513dba6fbe420a895f239c6fc"} Jun 14 16:18:25.672014 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.671917 2575 scope.go:117] "RemoveContainer" containerID="b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038" Jun 14 16:18:25.680896 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.680702 2575 scope.go:117] "RemoveContainer" containerID="b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038" Jun 14 16:18:25.681106 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:18:25.680960 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038\": container with ID starting with b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038 not found: ID does not exist" containerID="b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038" Jun 14 16:18:25.681106 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.680985 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038"} err="failed to get container status \"b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038\": rpc error: code = NotFound desc = could not find container \"b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038\": container with ID starting with b486fccda44575ceaa0ec4b4d11e078c251d1fd5e3200860d50e8a5e08303038 not found: ID does not exist" Jun 14 16:18:25.694081 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.694061 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jp997"] Jun 14 16:18:25.698971 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:25.698950 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jp997"] Jun 14 16:18:26.649846 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:26.649815 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ffb76e7-362b-48e6-a11e-3fb98b00e09c" path="/var/lib/kubelet/pods/4ffb76e7-362b-48e6-a11e-3fb98b00e09c/volumes" Jun 14 16:18:29.140732 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.140697 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-58pbd"] Jun 14 16:18:29.141238 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.141219 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ffb76e7-362b-48e6-a11e-3fb98b00e09c" containerName="limitador" Jun 14 16:18:29.141310 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.141242 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ffb76e7-362b-48e6-a11e-3fb98b00e09c" containerName="limitador" Jun 14 16:18:29.141310 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.141265 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c942351b-f8ca-40a3-a86c-265ce148133a" containerName="authorino" Jun 14 16:18:29.141310 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.141273 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c942351b-f8ca-40a3-a86c-265ce148133a" containerName="authorino" Jun 14 16:18:29.141462 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.141362 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ffb76e7-362b-48e6-a11e-3fb98b00e09c" containerName="limitador" Jun 14 16:18:29.141462 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.141374 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c942351b-f8ca-40a3-a86c-265ce148133a" containerName="authorino" Jun 14 16:18:29.145607 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.145587 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-58pbd" Jun 14 16:18:29.147747 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.147726 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kcqpr\"" Jun 14 16:18:29.147852 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.147726 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 14 16:18:29.152093 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.152074 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-58pbd"] Jun 14 16:18:29.209172 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.209128 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57dwn\" (UniqueName: \"kubernetes.io/projected/c1b8b62e-dc14-4cd4-aa7e-105e0c968e23-kube-api-access-57dwn\") pod \"postgres-69fb4594cf-58pbd\" (UID: \"c1b8b62e-dc14-4cd4-aa7e-105e0c968e23\") " pod="opendatahub/postgres-69fb4594cf-58pbd" Jun 14 16:18:29.209293 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.209212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c1b8b62e-dc14-4cd4-aa7e-105e0c968e23-data\") pod \"postgres-69fb4594cf-58pbd\" (UID: \"c1b8b62e-dc14-4cd4-aa7e-105e0c968e23\") " pod="opendatahub/postgres-69fb4594cf-58pbd" Jun 14 16:18:29.310212 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.310183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c1b8b62e-dc14-4cd4-aa7e-105e0c968e23-data\") pod \"postgres-69fb4594cf-58pbd\" (UID: \"c1b8b62e-dc14-4cd4-aa7e-105e0c968e23\") " pod="opendatahub/postgres-69fb4594cf-58pbd" Jun 14 16:18:29.310353 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.310286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57dwn\" (UniqueName: \"kubernetes.io/projected/c1b8b62e-dc14-4cd4-aa7e-105e0c968e23-kube-api-access-57dwn\") pod \"postgres-69fb4594cf-58pbd\" (UID: \"c1b8b62e-dc14-4cd4-aa7e-105e0c968e23\") " pod="opendatahub/postgres-69fb4594cf-58pbd" Jun 14 16:18:29.310534 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.310516 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c1b8b62e-dc14-4cd4-aa7e-105e0c968e23-data\") pod \"postgres-69fb4594cf-58pbd\" (UID: \"c1b8b62e-dc14-4cd4-aa7e-105e0c968e23\") " pod="opendatahub/postgres-69fb4594cf-58pbd" Jun 14 16:18:29.319098 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.319079 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57dwn\" (UniqueName: \"kubernetes.io/projected/c1b8b62e-dc14-4cd4-aa7e-105e0c968e23-kube-api-access-57dwn\") pod \"postgres-69fb4594cf-58pbd\" (UID: \"c1b8b62e-dc14-4cd4-aa7e-105e0c968e23\") " pod="opendatahub/postgres-69fb4594cf-58pbd" Jun 14 16:18:29.456982 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.456882 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-58pbd" Jun 14 16:18:29.583031 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.582993 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-58pbd"] Jun 14 16:18:29.585561 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:18:29.585531 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1b8b62e_dc14_4cd4_aa7e_105e0c968e23.slice/crio-2ccc5263cc79c5bf289715f46afda20902fb8016bac592cc3bc858e09f173fa3 WatchSource:0}: Error finding container 2ccc5263cc79c5bf289715f46afda20902fb8016bac592cc3bc858e09f173fa3: Status 404 returned error can't find the container with id 2ccc5263cc79c5bf289715f46afda20902fb8016bac592cc3bc858e09f173fa3 Jun 14 16:18:29.695265 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:29.695228 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-58pbd" event={"ID":"c1b8b62e-dc14-4cd4-aa7e-105e0c968e23","Type":"ContainerStarted","Data":"2ccc5263cc79c5bf289715f46afda20902fb8016bac592cc3bc858e09f173fa3"} Jun 14 16:18:32.710929 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:32.710891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-58pbd" event={"ID":"c1b8b62e-dc14-4cd4-aa7e-105e0c968e23","Type":"ContainerStarted","Data":"44cfcc0a11f99ba98b679ab434694208a5a3a98e70e089928d4499d5d7315cb1"} Jun 14 16:18:32.711300 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:32.710976 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-58pbd" Jun 14 16:18:32.727023 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:32.726972 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-58pbd" podStartSLOduration=1.387665663 podStartE2EDuration="3.726952207s" totalImagesPullingTime="2.339286544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:18:32.726280866 +0000 UTC m=+434.490059958" watchObservedRunningTime="2026-06-14 16:18:32.726952207 +0000 UTC m=+434.490731309" Jun 14 16:18:38.747857 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:38.747769 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-58pbd" Jun 14 16:18:48.732893 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:48.732859 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-whx89"] Jun 14 16:18:48.743073 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:48.743037 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-whx89" Jun 14 16:18:48.744915 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:48.744887 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-whx89"] Jun 14 16:18:48.745242 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:48.745218 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 16:18:48.745365 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:48.745245 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 16:18:48.745365 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:48.745300 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-skmd8\"" Jun 14 16:18:48.891519 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:48.891487 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlnj8\" (UniqueName: \"kubernetes.io/projected/76f8ca7f-97c1-4f6f-9601-e292443bcc4f-kube-api-access-rlnj8\") pod \"keycloak-operator-d67dbbb48-whx89\" (UID: \"76f8ca7f-97c1-4f6f-9601-e292443bcc4f\") " pod="keycloak-system/keycloak-operator-d67dbbb48-whx89" Jun 14 16:18:48.992423 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:48.992349 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlnj8\" (UniqueName: \"kubernetes.io/projected/76f8ca7f-97c1-4f6f-9601-e292443bcc4f-kube-api-access-rlnj8\") pod \"keycloak-operator-d67dbbb48-whx89\" (UID: \"76f8ca7f-97c1-4f6f-9601-e292443bcc4f\") " pod="keycloak-system/keycloak-operator-d67dbbb48-whx89" Jun 14 16:18:49.001486 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:49.001460 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlnj8\" (UniqueName: \"kubernetes.io/projected/76f8ca7f-97c1-4f6f-9601-e292443bcc4f-kube-api-access-rlnj8\") pod \"keycloak-operator-d67dbbb48-whx89\" (UID: \"76f8ca7f-97c1-4f6f-9601-e292443bcc4f\") " pod="keycloak-system/keycloak-operator-d67dbbb48-whx89" Jun 14 16:18:49.055398 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:49.055371 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-whx89" Jun 14 16:18:49.203914 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:49.203887 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-whx89"] Jun 14 16:18:49.206178 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:18:49.206152 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f8ca7f_97c1_4f6f_9601_e292443bcc4f.slice/crio-00cec7f871b9872063800d511fdfeaab13413f388423df72ebc2048b09aa341c WatchSource:0}: Error finding container 00cec7f871b9872063800d511fdfeaab13413f388423df72ebc2048b09aa341c: Status 404 returned error can't find the container with id 00cec7f871b9872063800d511fdfeaab13413f388423df72ebc2048b09aa341c Jun 14 16:18:49.784577 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:49.784543 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-whx89" event={"ID":"76f8ca7f-97c1-4f6f-9601-e292443bcc4f","Type":"ContainerStarted","Data":"00cec7f871b9872063800d511fdfeaab13413f388423df72ebc2048b09aa341c"} Jun 14 16:18:55.816275 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:55.816242 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-whx89" event={"ID":"76f8ca7f-97c1-4f6f-9601-e292443bcc4f","Type":"ContainerStarted","Data":"7f7778c94726300aff2d5e4046908a5af21c44a7d1a8e05a491eb9ec482866b1"} Jun 14 16:18:55.832961 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:18:55.832913 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-whx89" podStartSLOduration=1.769592656 podStartE2EDuration="7.832898628s" totalImagesPullingTime="6.063305972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:18:55.831630731 +0000 UTC m=+457.595409841" watchObservedRunningTime="2026-06-14 16:18:55.832898628 +0000 UTC m=+457.596677727" Jun 14 16:19:33.855908 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:33.855867 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lc2sx"] Jun 14 16:19:33.862597 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:33.862568 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lc2sx" Jun 14 16:19:33.870582 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:33.870558 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lc2sx"] Jun 14 16:19:33.889418 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:33.889393 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnkpq\" (UniqueName: \"kubernetes.io/projected/78697625-cb94-46cc-a787-f31a83e4fbcb-kube-api-access-xnkpq\") pod \"authorino-5d4b67c446-lc2sx\" (UID: \"78697625-cb94-46cc-a787-f31a83e4fbcb\") " pod="kuadrant-system/authorino-5d4b67c446-lc2sx" Jun 14 16:19:33.990765 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:33.990736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnkpq\" (UniqueName: \"kubernetes.io/projected/78697625-cb94-46cc-a787-f31a83e4fbcb-kube-api-access-xnkpq\") pod \"authorino-5d4b67c446-lc2sx\" (UID: \"78697625-cb94-46cc-a787-f31a83e4fbcb\") " pod="kuadrant-system/authorino-5d4b67c446-lc2sx" Jun 14 16:19:33.998732 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:33.998706 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnkpq\" (UniqueName: \"kubernetes.io/projected/78697625-cb94-46cc-a787-f31a83e4fbcb-kube-api-access-xnkpq\") pod \"authorino-5d4b67c446-lc2sx\" (UID: \"78697625-cb94-46cc-a787-f31a83e4fbcb\") " pod="kuadrant-system/authorino-5d4b67c446-lc2sx" Jun 14 16:19:34.086895 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.086868 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lc2sx"] Jun 14 16:19:34.087155 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.087124 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lc2sx" Jun 14 16:19:34.121976 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.121914 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f78fb9978-74xsp"] Jun 14 16:19:34.124254 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.124239 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f78fb9978-74xsp" Jun 14 16:19:34.133285 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.133243 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f78fb9978-74xsp"] Jun 14 16:19:34.192238 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.192203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm27c\" (UniqueName: \"kubernetes.io/projected/af2d428f-f031-4e68-a638-ea190a44cd94-kube-api-access-mm27c\") pod \"authorino-6f78fb9978-74xsp\" (UID: \"af2d428f-f031-4e68-a638-ea190a44cd94\") " pod="kuadrant-system/authorino-6f78fb9978-74xsp" Jun 14 16:19:34.218998 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.218965 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lc2sx"] Jun 14 16:19:34.221893 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:19:34.221865 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78697625_cb94_46cc_a787_f31a83e4fbcb.slice/crio-0cd00fab50313621db39474813ded1a6a9acdfafccc6837928749e799f5646ed WatchSource:0}: Error finding container 0cd00fab50313621db39474813ded1a6a9acdfafccc6837928749e799f5646ed: Status 404 returned error can't find the container with id 0cd00fab50313621db39474813ded1a6a9acdfafccc6837928749e799f5646ed Jun 14 16:19:34.292717 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.292694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm27c\" (UniqueName: \"kubernetes.io/projected/af2d428f-f031-4e68-a638-ea190a44cd94-kube-api-access-mm27c\") pod \"authorino-6f78fb9978-74xsp\" (UID: \"af2d428f-f031-4e68-a638-ea190a44cd94\") " pod="kuadrant-system/authorino-6f78fb9978-74xsp" Jun 14 16:19:34.306048 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.306024 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm27c\" (UniqueName: \"kubernetes.io/projected/af2d428f-f031-4e68-a638-ea190a44cd94-kube-api-access-mm27c\") pod \"authorino-6f78fb9978-74xsp\" (UID: \"af2d428f-f031-4e68-a638-ea190a44cd94\") " pod="kuadrant-system/authorino-6f78fb9978-74xsp" Jun 14 16:19:34.391183 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.391152 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f78fb9978-74xsp"] Jun 14 16:19:34.391408 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.391397 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f78fb9978-74xsp" Jun 14 16:19:34.419758 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.419733 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bdcb979b6-cjq4v"] Jun 14 16:19:34.422193 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.422175 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" Jun 14 16:19:34.424311 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.424292 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 14 16:19:34.433799 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.433777 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bdcb979b6-cjq4v"] Jun 14 16:19:34.494049 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.494019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81b6b0e2-d747-4b36-82dc-081dc2687b77-tls-cert\") pod \"authorino-5bdcb979b6-cjq4v\" (UID: \"81b6b0e2-d747-4b36-82dc-081dc2687b77\") " pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" Jun 14 16:19:34.494196 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.494122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w47x\" (UniqueName: \"kubernetes.io/projected/81b6b0e2-d747-4b36-82dc-081dc2687b77-kube-api-access-7w47x\") pod \"authorino-5bdcb979b6-cjq4v\" (UID: \"81b6b0e2-d747-4b36-82dc-081dc2687b77\") " pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" Jun 14 16:19:34.517462 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.517433 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f78fb9978-74xsp"] Jun 14 16:19:34.519453 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:19:34.519431 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf2d428f_f031_4e68_a638_ea190a44cd94.slice/crio-8fc085c44a772d3ec44bb6c4337acdc280a9d8007f43685605fc70a289e7cad8 WatchSource:0}: Error finding container 8fc085c44a772d3ec44bb6c4337acdc280a9d8007f43685605fc70a289e7cad8: Status 404 returned error can't find the container with id 8fc085c44a772d3ec44bb6c4337acdc280a9d8007f43685605fc70a289e7cad8 Jun 14 16:19:34.595249 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.595222 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w47x\" (UniqueName: \"kubernetes.io/projected/81b6b0e2-d747-4b36-82dc-081dc2687b77-kube-api-access-7w47x\") pod \"authorino-5bdcb979b6-cjq4v\" (UID: \"81b6b0e2-d747-4b36-82dc-081dc2687b77\") " pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" Jun 14 16:19:34.595368 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.595322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81b6b0e2-d747-4b36-82dc-081dc2687b77-tls-cert\") pod \"authorino-5bdcb979b6-cjq4v\" (UID: \"81b6b0e2-d747-4b36-82dc-081dc2687b77\") " pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" Jun 14 16:19:34.597558 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.597539 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81b6b0e2-d747-4b36-82dc-081dc2687b77-tls-cert\") pod \"authorino-5bdcb979b6-cjq4v\" (UID: \"81b6b0e2-d747-4b36-82dc-081dc2687b77\") " pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" Jun 14 16:19:34.603174 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.603155 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w47x\" (UniqueName: \"kubernetes.io/projected/81b6b0e2-d747-4b36-82dc-081dc2687b77-kube-api-access-7w47x\") pod \"authorino-5bdcb979b6-cjq4v\" (UID: \"81b6b0e2-d747-4b36-82dc-081dc2687b77\") " pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" Jun 14 16:19:34.731932 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.731905 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" Jun 14 16:19:34.858714 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.858687 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bdcb979b6-cjq4v"] Jun 14 16:19:34.859994 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:19:34.859966 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81b6b0e2_d747_4b36_82dc_081dc2687b77.slice/crio-822cb6a40e40024b43916f8eeda740c8dd2e7318ff0c1dc3d3c933a71f5522eb WatchSource:0}: Error finding container 822cb6a40e40024b43916f8eeda740c8dd2e7318ff0c1dc3d3c933a71f5522eb: Status 404 returned error can't find the container with id 822cb6a40e40024b43916f8eeda740c8dd2e7318ff0c1dc3d3c933a71f5522eb Jun 14 16:19:34.994695 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.994656 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f78fb9978-74xsp" event={"ID":"af2d428f-f031-4e68-a638-ea190a44cd94","Type":"ContainerStarted","Data":"eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a"} Jun 14 16:19:34.994928 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.994709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f78fb9978-74xsp" event={"ID":"af2d428f-f031-4e68-a638-ea190a44cd94","Type":"ContainerStarted","Data":"8fc085c44a772d3ec44bb6c4337acdc280a9d8007f43685605fc70a289e7cad8"} Jun 14 16:19:34.994928 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.994735 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6f78fb9978-74xsp" podUID="af2d428f-f031-4e68-a638-ea190a44cd94" containerName="authorino" containerID="cri-o://eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a" gracePeriod=30 Jun 14 16:19:34.996526 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.996490 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lc2sx" event={"ID":"78697625-cb94-46cc-a787-f31a83e4fbcb","Type":"ContainerStarted","Data":"406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5"} Jun 14 16:19:34.996526 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.996518 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-lc2sx" podUID="78697625-cb94-46cc-a787-f31a83e4fbcb" containerName="authorino" containerID="cri-o://406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5" gracePeriod=30 Jun 14 16:19:34.996526 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.996529 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lc2sx" event={"ID":"78697625-cb94-46cc-a787-f31a83e4fbcb","Type":"ContainerStarted","Data":"0cd00fab50313621db39474813ded1a6a9acdfafccc6837928749e799f5646ed"} Jun 14 16:19:34.998523 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:34.998495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" event={"ID":"81b6b0e2-d747-4b36-82dc-081dc2687b77","Type":"ContainerStarted","Data":"822cb6a40e40024b43916f8eeda740c8dd2e7318ff0c1dc3d3c933a71f5522eb"} Jun 14 16:19:35.009795 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:35.009749 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f78fb9978-74xsp" podStartSLOduration=0.667046278 podStartE2EDuration="1.009733298s" totalImagesPullingTime="342.68702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:19:35.008917461 +0000 UTC m=+496.772696566" watchObservedRunningTime="2026-06-14 16:19:35.009733298 +0000 UTC m=+496.773512399" Jun 14 16:19:35.024706 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:35.024669 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-lc2sx" podStartSLOduration=1.607453131 podStartE2EDuration="2.024655879s" totalImagesPullingTime="417.202748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:19:35.023766429 +0000 UTC m=+496.787545520" watchObservedRunningTime="2026-06-14 16:19:35.024655879 +0000 UTC m=+496.788434978" Jun 14 16:19:35.254795 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:35.254771 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f78fb9978-74xsp" Jun 14 16:19:35.264400 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:35.264381 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lc2sx" Jun 14 16:19:35.302371 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:35.302331 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnkpq\" (UniqueName: \"kubernetes.io/projected/78697625-cb94-46cc-a787-f31a83e4fbcb-kube-api-access-xnkpq\") pod \"78697625-cb94-46cc-a787-f31a83e4fbcb\" (UID: \"78697625-cb94-46cc-a787-f31a83e4fbcb\") " Jun 14 16:19:35.302541 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:35.302438 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm27c\" (UniqueName: \"kubernetes.io/projected/af2d428f-f031-4e68-a638-ea190a44cd94-kube-api-access-mm27c\") pod \"af2d428f-f031-4e68-a638-ea190a44cd94\" (UID: \"af2d428f-f031-4e68-a638-ea190a44cd94\") " Jun 14 16:19:35.304503 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:35.304475 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78697625-cb94-46cc-a787-f31a83e4fbcb-kube-api-access-xnkpq" (OuterVolumeSpecName: "kube-api-access-xnkpq") pod "78697625-cb94-46cc-a787-f31a83e4fbcb" (UID: "78697625-cb94-46cc-a787-f31a83e4fbcb"). InnerVolumeSpecName "kube-api-access-xnkpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:19:35.304726 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:35.304682 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2d428f-f031-4e68-a638-ea190a44cd94-kube-api-access-mm27c" (OuterVolumeSpecName: "kube-api-access-mm27c") pod "af2d428f-f031-4e68-a638-ea190a44cd94" (UID: "af2d428f-f031-4e68-a638-ea190a44cd94"). InnerVolumeSpecName "kube-api-access-mm27c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:19:35.403376 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:35.403298 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnkpq\" (UniqueName: \"kubernetes.io/projected/78697625-cb94-46cc-a787-f31a83e4fbcb-kube-api-access-xnkpq\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:19:35.403376 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:35.403323 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm27c\" (UniqueName: \"kubernetes.io/projected/af2d428f-f031-4e68-a638-ea190a44cd94-kube-api-access-mm27c\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:19:36.004240 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.004202 2575 generic.go:356] "Generic (PLEG): container finished" podID="af2d428f-f031-4e68-a638-ea190a44cd94" containerID="eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a" exitCode=0 Jun 14 16:19:36.004658 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.004282 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f78fb9978-74xsp" Jun 14 16:19:36.004658 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.004287 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f78fb9978-74xsp" event={"ID":"af2d428f-f031-4e68-a638-ea190a44cd94","Type":"ContainerDied","Data":"eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a"} Jun 14 16:19:36.004658 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.004330 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f78fb9978-74xsp" event={"ID":"af2d428f-f031-4e68-a638-ea190a44cd94","Type":"ContainerDied","Data":"8fc085c44a772d3ec44bb6c4337acdc280a9d8007f43685605fc70a289e7cad8"} Jun 14 16:19:36.004658 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.004348 2575 scope.go:117] "RemoveContainer" containerID="eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a" Jun 14 16:19:36.005727 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.005659 2575 generic.go:356] "Generic (PLEG): container finished" podID="78697625-cb94-46cc-a787-f31a83e4fbcb" containerID="406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5" exitCode=0 Jun 14 16:19:36.005727 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.005720 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lc2sx" Jun 14 16:19:36.005905 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.005750 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lc2sx" event={"ID":"78697625-cb94-46cc-a787-f31a83e4fbcb","Type":"ContainerDied","Data":"406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5"} Jun 14 16:19:36.005905 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.005779 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lc2sx" event={"ID":"78697625-cb94-46cc-a787-f31a83e4fbcb","Type":"ContainerDied","Data":"0cd00fab50313621db39474813ded1a6a9acdfafccc6837928749e799f5646ed"} Jun 14 16:19:36.008567 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.008208 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" event={"ID":"81b6b0e2-d747-4b36-82dc-081dc2687b77","Type":"ContainerStarted","Data":"a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162"} Jun 14 16:19:36.018853 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.018837 2575 scope.go:117] "RemoveContainer" containerID="eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a" Jun 14 16:19:36.019097 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:19:36.019075 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a\": container with ID starting with eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a not found: ID does not exist" containerID="eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a" Jun 14 16:19:36.019170 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.019105 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a"} err="failed to get container status \"eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a\": rpc error: code = NotFound desc = could not find container \"eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a\": container with ID starting with eb03afb998392f6aeec8435b43d1decaead135d3631eebb3e65cadc236308d5a not found: ID does not exist" Jun 14 16:19:36.019170 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.019121 2575 scope.go:117] "RemoveContainer" containerID="406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5" Jun 14 16:19:36.026316 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.026301 2575 scope.go:117] "RemoveContainer" containerID="406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5" Jun 14 16:19:36.026530 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:19:36.026515 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5\": container with ID starting with 406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5 not found: ID does not exist" containerID="406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5" Jun 14 16:19:36.026575 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.026535 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5"} err="failed to get container status \"406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5\": rpc error: code = NotFound desc = could not find container \"406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5\": container with ID starting with 406839eb775fbdd7308138ac991f203e78b3babafb310589a27dc8606f2a32d5 not found: ID does not exist" Jun 14 16:19:36.045234 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.045188 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" podStartSLOduration=1.759363368 podStartE2EDuration="2.045173595s" totalImagesPullingTime="285.810227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:19:36.043208586 +0000 UTC m=+497.806987687" watchObservedRunningTime="2026-06-14 16:19:36.045173595 +0000 UTC m=+497.808952695" Jun 14 16:19:36.066890 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.066865 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lc2sx"] Jun 14 16:19:36.071548 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.071523 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lc2sx"] Jun 14 16:19:36.092077 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.092055 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5hjs"] Jun 14 16:19:36.092235 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.092215 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-k5hjs" podUID="d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f" containerName="authorino" containerID="cri-o://5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8" gracePeriod=30 Jun 14 16:19:36.094192 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.094167 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f78fb9978-74xsp"] Jun 14 16:19:36.112358 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.112334 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f78fb9978-74xsp"] Jun 14 16:19:36.337291 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.337271 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k5hjs" Jun 14 16:19:36.412953 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.412926 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4w4v\" (UniqueName: \"kubernetes.io/projected/d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f-kube-api-access-l4w4v\") pod \"d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f\" (UID: \"d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f\") " Jun 14 16:19:36.414902 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.414871 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f-kube-api-access-l4w4v" (OuterVolumeSpecName: "kube-api-access-l4w4v") pod "d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f" (UID: "d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f"). InnerVolumeSpecName "kube-api-access-l4w4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:19:36.514112 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.514037 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4w4v\" (UniqueName: \"kubernetes.io/projected/d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f-kube-api-access-l4w4v\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:19:36.650174 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.650125 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78697625-cb94-46cc-a787-f31a83e4fbcb" path="/var/lib/kubelet/pods/78697625-cb94-46cc-a787-f31a83e4fbcb/volumes" Jun 14 16:19:36.650485 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:36.650472 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af2d428f-f031-4e68-a638-ea190a44cd94" path="/var/lib/kubelet/pods/af2d428f-f031-4e68-a638-ea190a44cd94/volumes" Jun 14 16:19:37.014105 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:37.014076 2575 generic.go:356] "Generic (PLEG): container finished" podID="d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f" containerID="5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8" exitCode=0 Jun 14 16:19:37.014530 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:37.014116 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k5hjs" Jun 14 16:19:37.014530 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:37.014165 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k5hjs" event={"ID":"d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f","Type":"ContainerDied","Data":"5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8"} Jun 14 16:19:37.014530 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:37.014217 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k5hjs" event={"ID":"d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f","Type":"ContainerDied","Data":"4dfa94010064601a6b80d50bd67a709ee6ce0ea28d28e0de1d77b764258fd2a6"} Jun 14 16:19:37.014530 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:37.014241 2575 scope.go:117] "RemoveContainer" containerID="5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8" Jun 14 16:19:37.022167 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:37.022129 2575 scope.go:117] "RemoveContainer" containerID="5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8" Jun 14 16:19:37.022417 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:19:37.022398 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8\": container with ID starting with 5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8 not found: ID does not exist" containerID="5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8" Jun 14 16:19:37.022482 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:37.022427 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8"} err="failed to get container status \"5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8\": rpc error: code = NotFound desc = could not find container \"5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8\": container with ID starting with 5d0f8c2e7c323efd818f3b28a5fc815d53fe67cc095c0fbc8005262157b927c8 not found: ID does not exist" Jun 14 16:19:37.030275 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:37.030254 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5hjs"] Jun 14 16:19:37.034254 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:37.034235 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k5hjs"] Jun 14 16:19:38.649962 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:19:38.649930 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f" path="/var/lib/kubelet/pods/d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f/volumes" Jun 14 16:21:01.395826 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.395786 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-694787899b-8khsh"] Jun 14 16:21:01.396460 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.396325 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f" containerName="authorino" Jun 14 16:21:01.396460 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.396346 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f" containerName="authorino" Jun 14 16:21:01.396460 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.396361 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78697625-cb94-46cc-a787-f31a83e4fbcb" containerName="authorino" Jun 14 16:21:01.396460 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.396370 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="78697625-cb94-46cc-a787-f31a83e4fbcb" containerName="authorino" Jun 14 16:21:01.396460 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.396384 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2d428f-f031-4e68-a638-ea190a44cd94" containerName="authorino" Jun 14 16:21:01.396460 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.396392 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2d428f-f031-4e68-a638-ea190a44cd94" containerName="authorino" Jun 14 16:21:01.396773 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.396467 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2d428f-f031-4e68-a638-ea190a44cd94" containerName="authorino" Jun 14 16:21:01.396773 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.396477 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d82d1cc1-0924-4739-92a1-ae2a4b7c5a2f" containerName="authorino" Jun 14 16:21:01.396773 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.396485 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="78697625-cb94-46cc-a787-f31a83e4fbcb" containerName="authorino" Jun 14 16:21:01.399684 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.399664 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.402606 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.402588 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 14 16:21:01.410992 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.410971 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-694787899b-8khsh"] Jun 14 16:21:01.561240 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.561203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58bbf06b-ac2b-4519-99a8-578120d013a2-tls-cert\") pod \"authorino-694787899b-8khsh\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.561416 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.561249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/58bbf06b-ac2b-4519-99a8-578120d013a2-oidc-ca\") pod \"authorino-694787899b-8khsh\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.561416 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.561283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk9tb\" (UniqueName: \"kubernetes.io/projected/58bbf06b-ac2b-4519-99a8-578120d013a2-kube-api-access-sk9tb\") pod \"authorino-694787899b-8khsh\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.661946 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.661865 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58bbf06b-ac2b-4519-99a8-578120d013a2-tls-cert\") pod \"authorino-694787899b-8khsh\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.661946 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.661900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/58bbf06b-ac2b-4519-99a8-578120d013a2-oidc-ca\") pod \"authorino-694787899b-8khsh\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.661946 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.661925 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk9tb\" (UniqueName: \"kubernetes.io/projected/58bbf06b-ac2b-4519-99a8-578120d013a2-kube-api-access-sk9tb\") pod \"authorino-694787899b-8khsh\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.662644 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.662623 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/58bbf06b-ac2b-4519-99a8-578120d013a2-oidc-ca\") pod \"authorino-694787899b-8khsh\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.664364 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.664331 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58bbf06b-ac2b-4519-99a8-578120d013a2-tls-cert\") pod \"authorino-694787899b-8khsh\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.670473 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.670450 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk9tb\" (UniqueName: \"kubernetes.io/projected/58bbf06b-ac2b-4519-99a8-578120d013a2-kube-api-access-sk9tb\") pod \"authorino-694787899b-8khsh\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.708479 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.708453 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:21:01.841253 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:01.841228 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-694787899b-8khsh"] Jun 14 16:21:01.843912 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:21:01.843874 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58bbf06b_ac2b_4519_99a8_578120d013a2.slice/crio-80600b51dfaa0d685057318ad7551da6b487b91501a0b1fe1f94ba8685565605 WatchSource:0}: Error finding container 80600b51dfaa0d685057318ad7551da6b487b91501a0b1fe1f94ba8685565605: Status 404 returned error can't find the container with id 80600b51dfaa0d685057318ad7551da6b487b91501a0b1fe1f94ba8685565605 Jun 14 16:21:02.391726 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.391688 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-694787899b-8khsh" event={"ID":"58bbf06b-ac2b-4519-99a8-578120d013a2","Type":"ContainerStarted","Data":"21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9"} Jun 14 16:21:02.391726 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.391728 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-694787899b-8khsh" event={"ID":"58bbf06b-ac2b-4519-99a8-578120d013a2","Type":"ContainerStarted","Data":"80600b51dfaa0d685057318ad7551da6b487b91501a0b1fe1f94ba8685565605"} Jun 14 16:21:02.412854 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.412798 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-694787899b-8khsh" podStartSLOduration=1.06861223 podStartE2EDuration="1.412778807s" totalImagesPullingTime="344.166577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:21:02.41212261 +0000 UTC m=+584.175901709" watchObservedRunningTime="2026-06-14 16:21:02.412778807 +0000 UTC m=+584.176557910" Jun 14 16:21:02.444413 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.444330 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bdcb979b6-cjq4v"] Jun 14 16:21:02.444563 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.444505 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" podUID="81b6b0e2-d747-4b36-82dc-081dc2687b77" containerName="authorino" containerID="cri-o://a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162" gracePeriod=30 Jun 14 16:21:02.689723 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.689700 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" Jun 14 16:21:02.875638 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.875557 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81b6b0e2-d747-4b36-82dc-081dc2687b77-tls-cert\") pod \"81b6b0e2-d747-4b36-82dc-081dc2687b77\" (UID: \"81b6b0e2-d747-4b36-82dc-081dc2687b77\") " Jun 14 16:21:02.875638 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.875624 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w47x\" (UniqueName: \"kubernetes.io/projected/81b6b0e2-d747-4b36-82dc-081dc2687b77-kube-api-access-7w47x\") pod \"81b6b0e2-d747-4b36-82dc-081dc2687b77\" (UID: \"81b6b0e2-d747-4b36-82dc-081dc2687b77\") " Jun 14 16:21:02.877584 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.877550 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b6b0e2-d747-4b36-82dc-081dc2687b77-kube-api-access-7w47x" (OuterVolumeSpecName: "kube-api-access-7w47x") pod "81b6b0e2-d747-4b36-82dc-081dc2687b77" (UID: "81b6b0e2-d747-4b36-82dc-081dc2687b77"). InnerVolumeSpecName "kube-api-access-7w47x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:21:02.885578 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.885549 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b6b0e2-d747-4b36-82dc-081dc2687b77-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "81b6b0e2-d747-4b36-82dc-081dc2687b77" (UID: "81b6b0e2-d747-4b36-82dc-081dc2687b77"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:21:02.976257 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.976226 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81b6b0e2-d747-4b36-82dc-081dc2687b77-tls-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:21:02.976257 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:02.976253 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w47x\" (UniqueName: \"kubernetes.io/projected/81b6b0e2-d747-4b36-82dc-081dc2687b77-kube-api-access-7w47x\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:21:03.397122 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:03.397084 2575 generic.go:356] "Generic (PLEG): container finished" podID="81b6b0e2-d747-4b36-82dc-081dc2687b77" containerID="a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162" exitCode=0 Jun 14 16:21:03.397320 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:03.397128 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" Jun 14 16:21:03.397320 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:03.397168 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" event={"ID":"81b6b0e2-d747-4b36-82dc-081dc2687b77","Type":"ContainerDied","Data":"a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162"} Jun 14 16:21:03.397320 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:03.397212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bdcb979b6-cjq4v" event={"ID":"81b6b0e2-d747-4b36-82dc-081dc2687b77","Type":"ContainerDied","Data":"822cb6a40e40024b43916f8eeda740c8dd2e7318ff0c1dc3d3c933a71f5522eb"} Jun 14 16:21:03.397320 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:03.397229 2575 scope.go:117] "RemoveContainer" containerID="a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162" Jun 14 16:21:03.406204 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:03.406185 2575 scope.go:117] "RemoveContainer" containerID="a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162" Jun 14 16:21:03.406454 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:21:03.406432 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162\": container with ID starting with a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162 not found: ID does not exist" containerID="a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162" Jun 14 16:21:03.406516 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:03.406465 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162"} err="failed to get container status \"a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162\": rpc error: code = NotFound desc = could not find container \"a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162\": container with ID starting with a3b395c60a97f3676d314ddb985774f2af401ab5b195577d08f23212d217a162 not found: ID does not exist" Jun 14 16:21:03.418574 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:03.418552 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bdcb979b6-cjq4v"] Jun 14 16:21:03.423110 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:03.423089 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bdcb979b6-cjq4v"] Jun 14 16:21:04.653432 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:04.653399 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81b6b0e2-d747-4b36-82dc-081dc2687b77" path="/var/lib/kubelet/pods/81b6b0e2-d747-4b36-82dc-081dc2687b77/volumes" Jun 14 16:21:26.575026 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.574994 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n"] Jun 14 16:21:26.575406 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.575369 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81b6b0e2-d747-4b36-82dc-081dc2687b77" containerName="authorino" Jun 14 16:21:26.575406 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.575382 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="81b6b0e2-d747-4b36-82dc-081dc2687b77" containerName="authorino" Jun 14 16:21:26.575477 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.575455 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="81b6b0e2-d747-4b36-82dc-081dc2687b77" containerName="authorino" Jun 14 16:21:26.579473 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.579453 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.582889 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.582854 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wqm6k\"" Jun 14 16:21:26.583028 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.582896 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 14 16:21:26.583105 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.583034 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 16:21:26.584080 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.584059 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 16:21:26.595870 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.595845 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n"] Jun 14 16:21:26.687301 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.687270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.687301 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.687303 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6tgc\" (UniqueName: \"kubernetes.io/projected/ed857ffa-f372-4fc0-babb-a91259a6ffac-kube-api-access-k6tgc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.687482 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.687337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed857ffa-f372-4fc0-babb-a91259a6ffac-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.687482 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.687358 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.687482 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.687385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.687482 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.687424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.788544 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.788508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.788681 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.788553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.788681 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.788604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.788681 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.788619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6tgc\" (UniqueName: \"kubernetes.io/projected/ed857ffa-f372-4fc0-babb-a91259a6ffac-kube-api-access-k6tgc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.788681 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.788643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed857ffa-f372-4fc0-babb-a91259a6ffac-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.788681 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.788660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.789009 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.788988 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.789079 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.789019 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.789124 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.789097 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.790942 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.790922 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed857ffa-f372-4fc0-babb-a91259a6ffac-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.791101 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.791082 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed857ffa-f372-4fc0-babb-a91259a6ffac-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.796854 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.796830 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6tgc\" (UniqueName: \"kubernetes.io/projected/ed857ffa-f372-4fc0-babb-a91259a6ffac-kube-api-access-k6tgc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bzg7n\" (UID: \"ed857ffa-f372-4fc0-babb-a91259a6ffac\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:26.889209 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:26.889180 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:21:27.028066 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:27.028002 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n"] Jun 14 16:21:27.030805 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:21:27.030779 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded857ffa_f372_4fc0_babb_a91259a6ffac.slice/crio-cd95348c0fec075a9cf7d88c23687fa84d08975c829bdcde35204f46219c04a5 WatchSource:0}: Error finding container cd95348c0fec075a9cf7d88c23687fa84d08975c829bdcde35204f46219c04a5: Status 404 returned error can't find the container with id cd95348c0fec075a9cf7d88c23687fa84d08975c829bdcde35204f46219c04a5 Jun 14 16:21:27.502360 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:27.502320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" event={"ID":"ed857ffa-f372-4fc0-babb-a91259a6ffac","Type":"ContainerStarted","Data":"cd95348c0fec075a9cf7d88c23687fa84d08975c829bdcde35204f46219c04a5"} Jun 14 16:21:30.519390 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:30.519354 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" event={"ID":"ed857ffa-f372-4fc0-babb-a91259a6ffac","Type":"ContainerStarted","Data":"50a75e2ca9c36ea54ff4232d18ae6b8f27b2514d5afd0ee9dd675de9a778c8a0"} Jun 14 16:21:56.366866 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.366784 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw"] Jun 14 16:21:56.385841 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.385811 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.391216 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.391186 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 14 16:21:56.393578 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.393553 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw"] Jun 14 16:21:56.450346 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.450310 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.450520 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.450355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdd614a6-797f-450a-af9c-3977a01a8771-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.450520 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.450457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.450520 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.450486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdnbj\" (UniqueName: \"kubernetes.io/projected/fdd614a6-797f-450a-af9c-3977a01a8771-kube-api-access-jdnbj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.450627 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.450531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.450627 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.450552 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.551905 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.551868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.551905 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.551917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdnbj\" (UniqueName: \"kubernetes.io/projected/fdd614a6-797f-450a-af9c-3977a01a8771-kube-api-access-jdnbj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.552184 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.551991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.552184 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.552025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.552184 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.552089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.552184 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.552124 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdd614a6-797f-450a-af9c-3977a01a8771-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.552500 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.552471 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.552591 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.552498 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.552591 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.552532 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.554158 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.554108 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdd614a6-797f-450a-af9c-3977a01a8771-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.554472 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.554456 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdd614a6-797f-450a-af9c-3977a01a8771-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.561062 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.561043 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdnbj\" (UniqueName: \"kubernetes.io/projected/fdd614a6-797f-450a-af9c-3977a01a8771-kube-api-access-jdnbj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nd4bw\" (UID: \"fdd614a6-797f-450a-af9c-3977a01a8771\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.696962 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.696929 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:21:56.835578 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:56.835553 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw"] Jun 14 16:21:56.837306 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:21:56.837277 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd614a6_797f_450a_af9c_3977a01a8771.slice/crio-1628e3d0728e65ddd3bd1c280421f799c90ff378c9c0d5c25ce9d4b0406c2962 WatchSource:0}: Error finding container 1628e3d0728e65ddd3bd1c280421f799c90ff378c9c0d5c25ce9d4b0406c2962: Status 404 returned error can't find the container with id 1628e3d0728e65ddd3bd1c280421f799c90ff378c9c0d5c25ce9d4b0406c2962 Jun 14 16:21:57.637443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:57.637407 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" event={"ID":"fdd614a6-797f-450a-af9c-3977a01a8771","Type":"ContainerStarted","Data":"5aa25633031bf7c3abb0e0e62d525953c2b23c20737856abf9c6da7a08ef6ab5"} Jun 14 16:21:57.637443 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:21:57.637450 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" event={"ID":"fdd614a6-797f-450a-af9c-3977a01a8771","Type":"ContainerStarted","Data":"1628e3d0728e65ddd3bd1c280421f799c90ff378c9c0d5c25ce9d4b0406c2962"} Jun 14 16:22:49.861690 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:49.861655 2575 generic.go:356] "Generic (PLEG): container finished" podID="fdd614a6-797f-450a-af9c-3977a01a8771" containerID="5aa25633031bf7c3abb0e0e62d525953c2b23c20737856abf9c6da7a08ef6ab5" exitCode=0 Jun 14 16:22:49.862063 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:49.861730 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" event={"ID":"fdd614a6-797f-450a-af9c-3977a01a8771","Type":"ContainerDied","Data":"5aa25633031bf7c3abb0e0e62d525953c2b23c20737856abf9c6da7a08ef6ab5"} Jun 14 16:22:49.862350 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:49.862333 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 16:22:51.873381 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:51.873346 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" event={"ID":"fdd614a6-797f-450a-af9c-3977a01a8771","Type":"ContainerStarted","Data":"5d41577691186af148e539ca943f266829230d595ae65a4f2ba8a9950428d946"} Jun 14 16:22:51.893709 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:51.893659 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" podStartSLOduration=2.128206945 podStartE2EDuration="55.893644377s" totalImagesPullingTime="994.192901ms" totalInitContainerRuntime="52.771244531s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:22:51.892121063 +0000 UTC m=+693.655900182" watchObservedRunningTime="2026-06-14 16:22:51.893644377 +0000 UTC m=+693.657423478" Jun 14 16:22:56.697949 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:56.697907 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:22:56.698369 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:56.697962 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:22:56.710425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:56.710402 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:22:56.905916 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:56.905888 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nd4bw" Jun 14 16:22:58.337737 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.337703 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8467757569-lvr2d"] Jun 14 16:22:58.341431 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.341415 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.349549 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.349524 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8467757569-lvr2d"] Jun 14 16:22:58.410837 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.410807 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec677717-42be-4dca-ae09-7fc1b9616da5-tls-cert\") pod \"authorino-8467757569-lvr2d\" (UID: \"ec677717-42be-4dca-ae09-7fc1b9616da5\") " pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.410837 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.410845 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wntvb\" (UniqueName: \"kubernetes.io/projected/ec677717-42be-4dca-ae09-7fc1b9616da5-kube-api-access-wntvb\") pod \"authorino-8467757569-lvr2d\" (UID: \"ec677717-42be-4dca-ae09-7fc1b9616da5\") " pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.411056 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.410884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec677717-42be-4dca-ae09-7fc1b9616da5-oidc-ca\") pod \"authorino-8467757569-lvr2d\" (UID: \"ec677717-42be-4dca-ae09-7fc1b9616da5\") " pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.512127 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.512101 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec677717-42be-4dca-ae09-7fc1b9616da5-oidc-ca\") pod \"authorino-8467757569-lvr2d\" (UID: \"ec677717-42be-4dca-ae09-7fc1b9616da5\") " pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.512294 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.512210 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec677717-42be-4dca-ae09-7fc1b9616da5-tls-cert\") pod \"authorino-8467757569-lvr2d\" (UID: \"ec677717-42be-4dca-ae09-7fc1b9616da5\") " pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.512294 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.512230 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wntvb\" (UniqueName: \"kubernetes.io/projected/ec677717-42be-4dca-ae09-7fc1b9616da5-kube-api-access-wntvb\") pod \"authorino-8467757569-lvr2d\" (UID: \"ec677717-42be-4dca-ae09-7fc1b9616da5\") " pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.512986 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.512962 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec677717-42be-4dca-ae09-7fc1b9616da5-oidc-ca\") pod \"authorino-8467757569-lvr2d\" (UID: \"ec677717-42be-4dca-ae09-7fc1b9616da5\") " pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.514586 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.514565 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec677717-42be-4dca-ae09-7fc1b9616da5-tls-cert\") pod \"authorino-8467757569-lvr2d\" (UID: \"ec677717-42be-4dca-ae09-7fc1b9616da5\") " pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.519809 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.519783 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wntvb\" (UniqueName: \"kubernetes.io/projected/ec677717-42be-4dca-ae09-7fc1b9616da5-kube-api-access-wntvb\") pod \"authorino-8467757569-lvr2d\" (UID: \"ec677717-42be-4dca-ae09-7fc1b9616da5\") " pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.650986 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.650953 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8467757569-lvr2d" Jun 14 16:22:58.801699 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.801637 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8467757569-lvr2d"] Jun 14 16:22:58.803966 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:22:58.803940 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec677717_42be_4dca_ae09_7fc1b9616da5.slice/crio-5f937d21303827ac94c6208034164cd4c029b5909bc756e71263326856b2ad50 WatchSource:0}: Error finding container 5f937d21303827ac94c6208034164cd4c029b5909bc756e71263326856b2ad50: Status 404 returned error can't find the container with id 5f937d21303827ac94c6208034164cd4c029b5909bc756e71263326856b2ad50 Jun 14 16:22:58.904089 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:58.904016 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8467757569-lvr2d" event={"ID":"ec677717-42be-4dca-ae09-7fc1b9616da5","Type":"ContainerStarted","Data":"5f937d21303827ac94c6208034164cd4c029b5909bc756e71263326856b2ad50"} Jun 14 16:22:59.910823 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:59.910787 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8467757569-lvr2d" event={"ID":"ec677717-42be-4dca-ae09-7fc1b9616da5","Type":"ContainerStarted","Data":"5e227044fd666fcd96a2e9c1d189662c22dca9d70a2cc7528351c683e6f6386d"} Jun 14 16:22:59.953823 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:22:59.953769 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8467757569-lvr2d" podStartSLOduration=1.638504543 podStartE2EDuration="1.953751867s" totalImagesPullingTime="315.247324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:22:59.952025215 +0000 UTC m=+701.715804313" watchObservedRunningTime="2026-06-14 16:22:59.953751867 +0000 UTC m=+701.717530967" Jun 14 16:23:00.020699 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.020661 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-694787899b-8khsh"] Jun 14 16:23:00.020882 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.020830 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-694787899b-8khsh" podUID="58bbf06b-ac2b-4519-99a8-578120d013a2" containerName="authorino" containerID="cri-o://21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9" gracePeriod=30 Jun 14 16:23:00.288025 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.287992 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:23:00.430569 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.430531 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/58bbf06b-ac2b-4519-99a8-578120d013a2-oidc-ca\") pod \"58bbf06b-ac2b-4519-99a8-578120d013a2\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " Jun 14 16:23:00.430744 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.430588 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58bbf06b-ac2b-4519-99a8-578120d013a2-tls-cert\") pod \"58bbf06b-ac2b-4519-99a8-578120d013a2\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " Jun 14 16:23:00.430744 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.430641 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk9tb\" (UniqueName: \"kubernetes.io/projected/58bbf06b-ac2b-4519-99a8-578120d013a2-kube-api-access-sk9tb\") pod \"58bbf06b-ac2b-4519-99a8-578120d013a2\" (UID: \"58bbf06b-ac2b-4519-99a8-578120d013a2\") " Jun 14 16:23:00.432617 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.432585 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58bbf06b-ac2b-4519-99a8-578120d013a2-kube-api-access-sk9tb" (OuterVolumeSpecName: "kube-api-access-sk9tb") pod "58bbf06b-ac2b-4519-99a8-578120d013a2" (UID: "58bbf06b-ac2b-4519-99a8-578120d013a2"). InnerVolumeSpecName "kube-api-access-sk9tb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:23:00.435331 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.435306 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58bbf06b-ac2b-4519-99a8-578120d013a2-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "58bbf06b-ac2b-4519-99a8-578120d013a2" (UID: "58bbf06b-ac2b-4519-99a8-578120d013a2"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:23:00.442021 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.441998 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58bbf06b-ac2b-4519-99a8-578120d013a2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "58bbf06b-ac2b-4519-99a8-578120d013a2" (UID: "58bbf06b-ac2b-4519-99a8-578120d013a2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 16:23:00.531609 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.531578 2575 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/58bbf06b-ac2b-4519-99a8-578120d013a2-oidc-ca\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:23:00.531609 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.531606 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58bbf06b-ac2b-4519-99a8-578120d013a2-tls-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:23:00.531771 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.531615 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk9tb\" (UniqueName: \"kubernetes.io/projected/58bbf06b-ac2b-4519-99a8-578120d013a2-kube-api-access-sk9tb\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jun 14 16:23:00.915944 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.915908 2575 generic.go:356] "Generic (PLEG): container finished" podID="58bbf06b-ac2b-4519-99a8-578120d013a2" containerID="21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9" exitCode=0 Jun 14 16:23:00.916379 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.915949 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-694787899b-8khsh" Jun 14 16:23:00.916379 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.915983 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-694787899b-8khsh" event={"ID":"58bbf06b-ac2b-4519-99a8-578120d013a2","Type":"ContainerDied","Data":"21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9"} Jun 14 16:23:00.916379 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.916024 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-694787899b-8khsh" event={"ID":"58bbf06b-ac2b-4519-99a8-578120d013a2","Type":"ContainerDied","Data":"80600b51dfaa0d685057318ad7551da6b487b91501a0b1fe1f94ba8685565605"} Jun 14 16:23:00.916379 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.916040 2575 scope.go:117] "RemoveContainer" containerID="21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9" Jun 14 16:23:00.924461 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.924439 2575 scope.go:117] "RemoveContainer" containerID="21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9" Jun 14 16:23:00.924692 ip-10-0-138-105 kubenswrapper[2575]: E0614 16:23:00.924674 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9\": container with ID starting with 21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9 not found: ID does not exist" containerID="21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9" Jun 14 16:23:00.924752 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.924700 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9"} err="failed to get container status \"21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9\": rpc error: code = NotFound desc = could not find container \"21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9\": container with ID starting with 21efddc9565dd8d00ebbbb6de98cf283e2edfe8f3a7e47a210f3e716031a15e9 not found: ID does not exist" Jun 14 16:23:00.932320 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.932295 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-694787899b-8khsh"] Jun 14 16:23:00.942789 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:00.942765 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-694787899b-8khsh"] Jun 14 16:23:02.649291 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:23:02.649259 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58bbf06b-ac2b-4519-99a8-578120d013a2" path="/var/lib/kubelet/pods/58bbf06b-ac2b-4519-99a8-578120d013a2/volumes" Jun 14 16:24:11.234297 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:24:11.234259 2575 generic.go:356] "Generic (PLEG): container finished" podID="ed857ffa-f372-4fc0-babb-a91259a6ffac" containerID="50a75e2ca9c36ea54ff4232d18ae6b8f27b2514d5afd0ee9dd675de9a778c8a0" exitCode=0 Jun 14 16:24:11.234815 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:24:11.234332 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" event={"ID":"ed857ffa-f372-4fc0-babb-a91259a6ffac","Type":"ContainerDied","Data":"50a75e2ca9c36ea54ff4232d18ae6b8f27b2514d5afd0ee9dd675de9a778c8a0"} Jun 14 16:24:12.241243 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:24:12.241208 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" event={"ID":"ed857ffa-f372-4fc0-babb-a91259a6ffac","Type":"ContainerStarted","Data":"2046180ae2b2207303be251fba10a1c9607e734ac6fb5b0e3f0c55f5cc76eade"} Jun 14 16:24:12.262944 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:24:12.262883 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" podStartSLOduration=2.629110185 podStartE2EDuration="2m46.262865785s" totalImagesPullingTime="3.013177057s" totalInitContainerRuntime="2m40.620578543s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:21:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:24:12.261942203 +0000 UTC m=+774.025721305" watchObservedRunningTime="2026-06-14 16:24:12.262865785 +0000 UTC m=+774.026644886" Jun 14 16:24:16.890251 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:24:16.890213 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:24:16.890718 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:24:16.890278 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:24:16.903242 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:24:16.903219 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:24:17.275472 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:24:17.275380 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bzg7n" Jun 14 16:48:01.507102 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:01.507073 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8467757569-lvr2d_ec677717-42be-4dca-ae09-7fc1b9616da5/authorino/0.log" Jun 14 16:48:07.568436 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:07.568409 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b9bbd87fc-vsv79_815f4603-1439-458e-ad45-c28e0bfe2d54/copy-manifests/0.log" Jun 14 16:48:07.574363 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:07.574342 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b9bbd87fc-vsv79_815f4603-1439-458e-ad45-c28e0bfe2d54/manager/0.log" Jun 14 16:48:07.683577 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:07.683557 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-58pbd_c1b8b62e-dc14-4cd4-aa7e-105e0c968e23/postgres/0.log" Jun 14 16:48:08.955038 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:08.955013 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8467757569-lvr2d_ec677717-42be-4dca-ae09-7fc1b9616da5/authorino/0.log" Jun 14 16:48:09.300167 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:09.300062 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xhjvf_66a11076-f698-4937-99cf-79725685e76d/kuadrant-console-plugin/0.log" Jun 14 16:48:10.332549 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:10.332520 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86847bf95-7wb8f_75e81a29-4ebd-486e-b89e-92809d7cec5d/kube-auth-proxy/0.log" Jun 14 16:48:11.376949 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:11.376906 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-bzg7n_ed857ffa-f372-4fc0-babb-a91259a6ffac/storage-initializer/0.log" Jun 14 16:48:11.382650 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:11.382628 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-bzg7n_ed857ffa-f372-4fc0-babb-a91259a6ffac/main/0.log" Jun 14 16:48:11.853488 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:11.853430 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-nd4bw_fdd614a6-797f-450a-af9c-3977a01a8771/storage-initializer/0.log" Jun 14 16:48:11.861636 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:11.861608 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-nd4bw_fdd614a6-797f-450a-af9c-3977a01a8771/main/0.log" Jun 14 16:48:15.911501 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.911466 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f5b2r/must-gather-jwxjj"] Jun 14 16:48:15.911876 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.911803 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58bbf06b-ac2b-4519-99a8-578120d013a2" containerName="authorino" Jun 14 16:48:15.911876 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.911815 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="58bbf06b-ac2b-4519-99a8-578120d013a2" containerName="authorino" Jun 14 16:48:15.911955 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.911880 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="58bbf06b-ac2b-4519-99a8-578120d013a2" containerName="authorino" Jun 14 16:48:15.914538 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.914521 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5b2r/must-gather-jwxjj" Jun 14 16:48:15.916762 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.916737 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f5b2r\"/\"kube-root-ca.crt\"" Jun 14 16:48:15.916865 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.916741 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f5b2r\"/\"default-dockercfg-r2wxl\"" Jun 14 16:48:15.917208 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.917190 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f5b2r\"/\"openshift-service-ca.crt\"" Jun 14 16:48:15.930381 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.930360 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5b2r/must-gather-jwxjj"] Jun 14 16:48:15.977042 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.977018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/050d0532-ef07-43f3-b2d8-55dcf63e1f88-must-gather-output\") pod \"must-gather-jwxjj\" (UID: \"050d0532-ef07-43f3-b2d8-55dcf63e1f88\") " pod="openshift-must-gather-f5b2r/must-gather-jwxjj" Jun 14 16:48:15.977201 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:15.977076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvc5l\" (UniqueName: \"kubernetes.io/projected/050d0532-ef07-43f3-b2d8-55dcf63e1f88-kube-api-access-jvc5l\") pod \"must-gather-jwxjj\" (UID: \"050d0532-ef07-43f3-b2d8-55dcf63e1f88\") " pod="openshift-must-gather-f5b2r/must-gather-jwxjj" Jun 14 16:48:16.078446 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:16.078419 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/050d0532-ef07-43f3-b2d8-55dcf63e1f88-must-gather-output\") pod \"must-gather-jwxjj\" (UID: \"050d0532-ef07-43f3-b2d8-55dcf63e1f88\") " pod="openshift-must-gather-f5b2r/must-gather-jwxjj" Jun 14 16:48:16.078612 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:16.078469 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvc5l\" (UniqueName: \"kubernetes.io/projected/050d0532-ef07-43f3-b2d8-55dcf63e1f88-kube-api-access-jvc5l\") pod \"must-gather-jwxjj\" (UID: \"050d0532-ef07-43f3-b2d8-55dcf63e1f88\") " pod="openshift-must-gather-f5b2r/must-gather-jwxjj" Jun 14 16:48:16.078806 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:16.078783 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/050d0532-ef07-43f3-b2d8-55dcf63e1f88-must-gather-output\") pod \"must-gather-jwxjj\" (UID: \"050d0532-ef07-43f3-b2d8-55dcf63e1f88\") " pod="openshift-must-gather-f5b2r/must-gather-jwxjj" Jun 14 16:48:16.087044 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:16.087024 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvc5l\" (UniqueName: \"kubernetes.io/projected/050d0532-ef07-43f3-b2d8-55dcf63e1f88-kube-api-access-jvc5l\") pod \"must-gather-jwxjj\" (UID: \"050d0532-ef07-43f3-b2d8-55dcf63e1f88\") " pod="openshift-must-gather-f5b2r/must-gather-jwxjj" Jun 14 16:48:16.224472 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:16.224404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5b2r/must-gather-jwxjj" Jun 14 16:48:16.351357 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:16.351275 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5b2r/must-gather-jwxjj"] Jun 14 16:48:16.353702 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:48:16.353676 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod050d0532_ef07_43f3_b2d8_55dcf63e1f88.slice/crio-ca38892ad631135bdf7fbeca37bc203db0f42c6eaa4c2dcda1a62b77ada4cd7e WatchSource:0}: Error finding container ca38892ad631135bdf7fbeca37bc203db0f42c6eaa4c2dcda1a62b77ada4cd7e: Status 404 returned error can't find the container with id ca38892ad631135bdf7fbeca37bc203db0f42c6eaa4c2dcda1a62b77ada4cd7e Jun 14 16:48:16.355625 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:16.355604 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 16:48:16.737445 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:16.737411 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5b2r/must-gather-jwxjj" event={"ID":"050d0532-ef07-43f3-b2d8-55dcf63e1f88","Type":"ContainerStarted","Data":"ca38892ad631135bdf7fbeca37bc203db0f42c6eaa4c2dcda1a62b77ada4cd7e"} Jun 14 16:48:17.745672 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:17.745630 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5b2r/must-gather-jwxjj" event={"ID":"050d0532-ef07-43f3-b2d8-55dcf63e1f88","Type":"ContainerStarted","Data":"89da49a2521f3719a81c0b8726eebb556c4633c98cd18e0bc66d142c8c426ec5"} Jun 14 16:48:17.745672 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:17.745675 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5b2r/must-gather-jwxjj" event={"ID":"050d0532-ef07-43f3-b2d8-55dcf63e1f88","Type":"ContainerStarted","Data":"c38ccfd4f15e5c1f8f798e1f48f96cfc7a7c5adee700cf00a0a4af2e2d791354"} Jun 14 16:48:17.759890 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:17.759829 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f5b2r/must-gather-jwxjj" podStartSLOduration=2.053256638 podStartE2EDuration="2.759810945s" totalImagesPullingTime="706.554307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:48:17.758336363 +0000 UTC m=+2219.522115466" watchObservedRunningTime="2026-06-14 16:48:17.759810945 +0000 UTC m=+2219.523590044" Jun 14 16:48:18.830773 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:18.830736 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-28jlf_83b85971-813a-4b24-b5f4-4ab6ad5b5516/global-pull-secret-syncer/0.log" Jun 14 16:48:19.023788 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:19.023759 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x8dgj_cd99c833-5d8a-4c0f-b177-16e44ec4c5e4/konnectivity-agent/0.log" Jun 14 16:48:19.104336 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:19.104267 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-105.ec2.internal_9d8c88ad5edfec2dac26fd7fc76a13cf/haproxy/0.log" Jun 14 16:48:24.121073 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:24.121036 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8467757569-lvr2d_ec677717-42be-4dca-ae09-7fc1b9616da5/authorino/0.log" Jun 14 16:48:24.204259 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:24.204232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xhjvf_66a11076-f698-4937-99cf-79725685e76d/kuadrant-console-plugin/0.log" Jun 14 16:48:26.170153 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.169864 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-rww2w_7c77c569-3eac-4875-b566-6a3c1125d51a/kube-state-metrics/0.log" Jun 14 16:48:26.186696 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.186671 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-rww2w_7c77c569-3eac-4875-b566-6a3c1125d51a/kube-rbac-proxy-main/0.log" Jun 14 16:48:26.209756 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.209692 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-rww2w_7c77c569-3eac-4875-b566-6a3c1125d51a/kube-rbac-proxy-self/0.log" Jun 14 16:48:26.246516 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.246328 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58bd9fb79f-9skxs_3a73ef74-beb7-4739-aba9-d76f08a8136d/metrics-server/0.log" Jun 14 16:48:26.274218 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.274090 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-6kcx6_4cd22690-253a-4290-b6a3-6dfeab0d78e7/monitoring-plugin/0.log" Jun 14 16:48:26.381666 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.381545 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpnbg_516759c0-a44b-48cd-88c8-4c9908808c0f/node-exporter/0.log" Jun 14 16:48:26.400538 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.400494 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpnbg_516759c0-a44b-48cd-88c8-4c9908808c0f/kube-rbac-proxy/0.log" Jun 14 16:48:26.426632 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.426606 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpnbg_516759c0-a44b-48cd-88c8-4c9908808c0f/init-textfile/0.log" Jun 14 16:48:26.567152 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.567111 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-km5h6_de2ac286-314a-476e-bec4-fd5435ff4300/kube-rbac-proxy-main/0.log" Jun 14 16:48:26.602884 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.602840 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-km5h6_de2ac286-314a-476e-bec4-fd5435ff4300/kube-rbac-proxy-self/0.log" Jun 14 16:48:26.630278 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.630238 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-km5h6_de2ac286-314a-476e-bec4-fd5435ff4300/openshift-state-metrics/0.log" Jun 14 16:48:26.688670 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.688570 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94c1d981-f271-43b1-9cbb-94625f2289cb/prometheus/0.log" Jun 14 16:48:26.721277 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.721244 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94c1d981-f271-43b1-9cbb-94625f2289cb/config-reloader/0.log" Jun 14 16:48:26.747955 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.747900 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94c1d981-f271-43b1-9cbb-94625f2289cb/thanos-sidecar/0.log" Jun 14 16:48:26.776934 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.776901 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94c1d981-f271-43b1-9cbb-94625f2289cb/kube-rbac-proxy-web/0.log" Jun 14 16:48:26.803154 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.801414 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94c1d981-f271-43b1-9cbb-94625f2289cb/kube-rbac-proxy/0.log" Jun 14 16:48:26.825680 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.825614 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94c1d981-f271-43b1-9cbb-94625f2289cb/kube-rbac-proxy-thanos/0.log" Jun 14 16:48:26.851398 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.851372 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_94c1d981-f271-43b1-9cbb-94625f2289cb/init-config-reloader/0.log" Jun 14 16:48:26.968885 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.968775 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86879889f-vxqn6_2961d10f-85ec-4cab-bb61-cbc98722471e/telemeter-client/0.log" Jun 14 16:48:26.989876 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:26.989847 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86879889f-vxqn6_2961d10f-85ec-4cab-bb61-cbc98722471e/reload/0.log" Jun 14 16:48:27.011367 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:27.011335 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86879889f-vxqn6_2961d10f-85ec-4cab-bb61-cbc98722471e/kube-rbac-proxy/0.log" Jun 14 16:48:27.045370 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:27.045339 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bf47dd4d-zppbn_432fb1a7-a2dc-46f4-8099-f79e85de3c5f/thanos-query/0.log" Jun 14 16:48:27.065385 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:27.065348 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bf47dd4d-zppbn_432fb1a7-a2dc-46f4-8099-f79e85de3c5f/kube-rbac-proxy-web/0.log" Jun 14 16:48:27.086469 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:27.086432 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bf47dd4d-zppbn_432fb1a7-a2dc-46f4-8099-f79e85de3c5f/kube-rbac-proxy/0.log" Jun 14 16:48:27.106344 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:27.106314 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bf47dd4d-zppbn_432fb1a7-a2dc-46f4-8099-f79e85de3c5f/prom-label-proxy/0.log" Jun 14 16:48:27.126805 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:27.126774 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bf47dd4d-zppbn_432fb1a7-a2dc-46f4-8099-f79e85de3c5f/kube-rbac-proxy-rules/0.log" Jun 14 16:48:27.151903 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:27.151830 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bf47dd4d-zppbn_432fb1a7-a2dc-46f4-8099-f79e85de3c5f/kube-rbac-proxy-metrics/0.log" Jun 14 16:48:29.762877 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:29.762837 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-784dd4c7bb-bsq7r_812444c5-3fb0-4ad2-9271-33dcf1d95e19/console/0.log" Jun 14 16:48:30.395205 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.395173 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n"] Jun 14 16:48:30.403034 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.403004 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.407955 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.407920 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n"] Jun 14 16:48:30.554189 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.554154 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-lib-modules\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.554380 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.554311 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-sys\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.554380 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.554359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2skn8\" (UniqueName: \"kubernetes.io/projected/76023ee8-3070-4305-b8c0-cfa0471b827a-kube-api-access-2skn8\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.554509 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.554391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-proc\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.554509 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.554416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-podres\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.655681 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.655573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-proc\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.655681 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.655623 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-podres\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.655924 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.655720 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-proc\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.655924 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.655763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-lib-modules\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.655924 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.655794 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-sys\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.655924 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.655830 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2skn8\" (UniqueName: \"kubernetes.io/projected/76023ee8-3070-4305-b8c0-cfa0471b827a-kube-api-access-2skn8\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.655924 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.655835 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-podres\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.655924 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.655911 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-sys\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.655924 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.655918 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76023ee8-3070-4305-b8c0-cfa0471b827a-lib-modules\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.663840 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.663810 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2skn8\" (UniqueName: \"kubernetes.io/projected/76023ee8-3070-4305-b8c0-cfa0471b827a-kube-api-access-2skn8\") pod \"perf-node-gather-daemonset-7gv7n\" (UID: \"76023ee8-3070-4305-b8c0-cfa0471b827a\") " pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.721184 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.721117 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:30.909425 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:30.909289 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n"] Jun 14 16:48:30.914835 ip-10-0-138-105 kubenswrapper[2575]: W0614 16:48:30.914805 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76023ee8_3070_4305_b8c0_cfa0471b827a.slice/crio-dbdc85ca2df8bde7dca8c2d2a54328e211af02d15cc7c1828da5276e5b9d76da WatchSource:0}: Error finding container dbdc85ca2df8bde7dca8c2d2a54328e211af02d15cc7c1828da5276e5b9d76da: Status 404 returned error can't find the container with id dbdc85ca2df8bde7dca8c2d2a54328e211af02d15cc7c1828da5276e5b9d76da Jun 14 16:48:31.707737 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:31.707706 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k7vnp_0c129bd5-69a6-492c-9b28-8a603d7391f9/dns/0.log" Jun 14 16:48:31.726367 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:31.726335 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k7vnp_0c129bd5-69a6-492c-9b28-8a603d7391f9/kube-rbac-proxy/0.log" Jun 14 16:48:31.844821 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:31.844789 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" event={"ID":"76023ee8-3070-4305-b8c0-cfa0471b827a","Type":"ContainerStarted","Data":"cf993f971dea708b52ddc3143356b7b4ee47c04ce8061baac7c211fe2731d631"} Jun 14 16:48:31.845005 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:31.844838 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" event={"ID":"76023ee8-3070-4305-b8c0-cfa0471b827a","Type":"ContainerStarted","Data":"dbdc85ca2df8bde7dca8c2d2a54328e211af02d15cc7c1828da5276e5b9d76da"} Jun 14 16:48:31.845005 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:31.844922 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:31.861065 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:31.861020 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" podStartSLOduration=1.861005064 podStartE2EDuration="1.861005064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:48:31.859384945 +0000 UTC m=+2233.623164044" watchObservedRunningTime="2026-06-14 16:48:31.861005064 +0000 UTC m=+2233.624784164" Jun 14 16:48:31.890454 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:31.890423 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tjnmg_64597af5-39c6-4da0-87e1-7bcb067ede1f/dns-node-resolver/0.log" Jun 14 16:48:32.428857 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:32.428825 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b9b46c595-cxmzr_e445f4f8-a013-40c3-8298-83200c164c3e/registry/0.log" Jun 14 16:48:32.472075 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:32.472042 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q82zg_79eecdfa-bf81-4295-9a47-4089823923f9/node-ca/0.log" Jun 14 16:48:33.584973 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:33.584940 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86847bf95-7wb8f_75e81a29-4ebd-486e-b89e-92809d7cec5d/kube-auth-proxy/0.log" Jun 14 16:48:34.408224 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:34.408190 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j4t6v_90f350e0-294f-4aa6-a04a-d201ccfe6c18/serve-healthcheck-canary/0.log" Jun 14 16:48:34.930285 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:34.930259 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fpq27_e140c399-d1d1-420b-9375-51e3a6aa6501/kube-rbac-proxy/0.log" Jun 14 16:48:34.949158 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:34.949108 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fpq27_e140c399-d1d1-420b-9375-51e3a6aa6501/exporter/0.log" Jun 14 16:48:34.968755 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:34.968731 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fpq27_e140c399-d1d1-420b-9375-51e3a6aa6501/extractor/0.log" Jun 14 16:48:37.816501 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:37.816471 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b9bbd87fc-vsv79_815f4603-1439-458e-ad45-c28e0bfe2d54/manager/0.log" Jun 14 16:48:37.836368 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:37.836341 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b9bbd87fc-vsv79_815f4603-1439-458e-ad45-c28e0bfe2d54/copy-manifests/0.log" Jun 14 16:48:37.858883 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:37.858857 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-58pbd_c1b8b62e-dc14-4cd4-aa7e-105e0c968e23/postgres/0.log" Jun 14 16:48:37.860316 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:37.860296 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f5b2r/perf-node-gather-daemonset-7gv7n" Jun 14 16:48:39.484060 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:39.484033 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74f4f55f59-f9cln_7c41bfc6-466b-4abf-8ad1-302f2bdc10ed/manager/0.log" Jun 14 16:48:43.843456 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:43.843419 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86847bf95-7wb8f_75e81a29-4ebd-486e-b89e-92809d7cec5d/kube-auth-proxy/0.log" Jun 14 16:48:45.270302 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:45.270264 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86847bf95-7wb8f_75e81a29-4ebd-486e-b89e-92809d7cec5d/kube-auth-proxy/0.log" Jun 14 16:48:46.657324 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:46.657292 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2rxrc_d55727f0-c2f2-4f11-a204-e8138466d477/kube-multus-additional-cni-plugins/0.log" Jun 14 16:48:46.677150 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:46.677109 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2rxrc_d55727f0-c2f2-4f11-a204-e8138466d477/egress-router-binary-copy/0.log" Jun 14 16:48:46.697541 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:46.697489 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2rxrc_d55727f0-c2f2-4f11-a204-e8138466d477/cni-plugins/0.log" Jun 14 16:48:46.727778 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:46.727754 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2rxrc_d55727f0-c2f2-4f11-a204-e8138466d477/bond-cni-plugin/0.log" Jun 14 16:48:46.748726 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:46.748699 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2rxrc_d55727f0-c2f2-4f11-a204-e8138466d477/routeoverride-cni/0.log" Jun 14 16:48:46.769535 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:46.769500 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2rxrc_d55727f0-c2f2-4f11-a204-e8138466d477/whereabouts-cni-bincopy/0.log" Jun 14 16:48:46.787902 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:46.787881 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2rxrc_d55727f0-c2f2-4f11-a204-e8138466d477/whereabouts-cni/0.log" Jun 14 16:48:47.164534 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:47.164502 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cpmjd_066ee268-854c-4e75-9a3f-46791967ef38/kube-multus/0.log" Jun 14 16:48:47.167325 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:47.167290 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86847bf95-7wb8f_75e81a29-4ebd-486e-b89e-92809d7cec5d/kube-auth-proxy/0.log" Jun 14 16:48:47.308265 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:47.308235 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kzd85_3541cb76-3850-4307-95a7-ad4356fb71f1/network-metrics-daemon/0.log" Jun 14 16:48:47.325704 ip-10-0-138-105 kubenswrapper[2575]: I0614 16:48:47.325673 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kzd85_3541cb76-3850-4307-95a7-ad4356fb71f1/kube-rbac-proxy/0.log"