Jun 09 12:28:57.941442 ip-10-0-135-164 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 12:28:57.941454 ip-10-0-135-164 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 12:28:57.941461 ip-10-0-135-164 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 12:28:57.941665 ip-10-0-135-164 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 12:29:07.963380 ip-10-0-135-164 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 12:29:07.963397 ip-10-0-135-164 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3551784a452b4afe9a61a1d572c84628 -- Jun 09 12:31:32.367299 ip-10-0-135-164 systemd[1]: Starting Kubernetes Kubelet... Jun 09 12:31:32.790179 ip-10-0-135-164 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:31:32.790179 ip-10-0-135-164 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 12:31:32.790179 ip-10-0-135-164 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:31:32.790179 ip-10-0-135-164 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 12:31:32.790179 ip-10-0-135-164 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:31:32.790836 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.790254 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 12:31:32.798113 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798078 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:32.798113 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798107 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:32.798113 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798112 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:32.798113 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798116 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:32.798113 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798120 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798125 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798129 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798133 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798136 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798140 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798144 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798147 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798151 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798154 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798158 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798161 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798165 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798170 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798174 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798180 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798185 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798190 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798193 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798197 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:32.798398 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798201 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798205 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798208 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798213 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798217 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798221 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798225 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798230 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798234 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798238 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798242 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798246 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798250 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798254 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798260 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798264 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798268 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798272 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798276 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798281 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:32.799233 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798285 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798289 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798293 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798298 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798302 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798306 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798310 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798314 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798318 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798322 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798328 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798332 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798337 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798341 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798345 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798350 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798354 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798358 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798363 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798367 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:32.800097 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798371 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798375 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798380 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798384 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798388 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798395 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798401 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798406 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798411 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798416 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798421 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798426 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798430 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798435 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798440 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798444 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798449 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798456 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798462 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:32.800971 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798471 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798476 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798481 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798485 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798490 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798494 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798498 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798502 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798507 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798511 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798515 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798519 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798524 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798528 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798532 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.798537 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799698 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799710 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799715 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799721 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:32.801806 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799726 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799730 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799735 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799739 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799744 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799748 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799752 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799756 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799760 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799765 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799769 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799773 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799778 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799783 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799790 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799798 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799803 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799808 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799813 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:32.802681 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799817 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799821 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799826 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799830 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799835 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799839 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799844 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799850 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799854 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799858 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799863 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799867 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799872 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799876 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799880 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799884 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799888 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799892 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799897 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:32.803286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799900 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799905 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799909 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799913 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799917 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799921 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799926 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799930 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799935 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799939 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799943 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799949 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799953 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799957 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799961 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799965 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799969 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799973 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799977 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:32.803827 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799981 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799985 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799989 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.799993 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800020 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800025 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800030 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800034 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800038 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800042 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800046 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800050 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800054 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800058 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800062 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800066 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800071 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800075 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800079 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800085 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:32.804483 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800091 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800095 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800101 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800106 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800111 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800115 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800119 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800123 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800127 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800131 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800135 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800140 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800144 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800148 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800152 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800156 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800160 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800165 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800858 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800870 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:32.805212 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800875 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800880 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800886 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800890 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800895 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800899 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800904 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800908 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800912 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800917 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800921 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800928 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800933 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800939 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800952 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800961 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800965 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800969 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800973 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800977 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:32.805711 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800980 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800984 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800988 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800992 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.800996 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801021 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801026 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801030 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801034 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801038 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801044 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801049 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801053 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801057 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801061 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801065 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801069 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801073 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801077 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:32.806307 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801081 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801085 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801089 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801094 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801098 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801102 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801106 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801111 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801116 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801121 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801125 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801129 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801133 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801137 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801141 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801145 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801149 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801153 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801157 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:32.806782 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801161 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801166 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801170 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801174 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801178 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801182 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801187 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801191 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801195 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801199 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801203 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801207 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801211 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801215 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801222 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801228 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801232 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801243 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801249 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:32.807292 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801253 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801258 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801262 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801267 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801271 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801275 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801280 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801284 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801288 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801292 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801298 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801303 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801308 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801312 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801316 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801320 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801324 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801328 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801332 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.801337 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:32.807746 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801444 2555 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801455 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801466 2555 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801473 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801479 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801485 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801491 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801498 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801503 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801507 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801512 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801517 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801523 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801527 2555 flags.go:64] FLAG: --cgroup-root="" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801532 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801537 2555 flags.go:64] FLAG: --client-ca-file="" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801542 2555 flags.go:64] FLAG: --cloud-provider="external" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801547 2555 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801552 2555 flags.go:64] FLAG: --cluster-domain="" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801557 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801562 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801567 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801572 2555 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801578 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 12:31:32.808268 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801583 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801588 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801593 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801597 2555 flags.go:64] FLAG: --contention-profiling="false" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801602 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801607 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801612 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801616 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801622 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801627 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801632 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801636 2555 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801640 2555 flags.go:64] FLAG: --enable-server="true" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801645 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801654 2555 flags.go:64] FLAG: --event-burst="100" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801658 2555 flags.go:64] FLAG: --event-qps="50" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801663 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801668 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801672 2555 flags.go:64] FLAG: --eviction-hard="" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801678 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801683 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801687 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801693 2555 flags.go:64] FLAG: --eviction-soft="" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801698 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801702 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 12:31:32.808849 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801708 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801713 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801718 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801722 2555 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801726 2555 flags.go:64] FLAG: --feature-gates="" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801732 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801737 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801742 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801747 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801751 2555 flags.go:64] FLAG: --healthz-port="10248" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801757 2555 flags.go:64] FLAG: --help="false" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801761 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-135-164.ec2.internal" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801766 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801771 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801775 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801781 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801787 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801791 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801795 2555 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801800 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801804 2555 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801808 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801813 2555 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801817 2555 flags.go:64] FLAG: --kube-reserved="" Jun 09 12:31:32.809600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801821 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801826 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801831 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801835 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801839 2555 flags.go:64] FLAG: --lock-file="" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801847 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801851 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801857 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801866 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801871 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801875 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801880 2555 flags.go:64] FLAG: --logging-format="text" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801885 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801890 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801894 2555 flags.go:64] FLAG: --manifest-url="" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801898 2555 flags.go:64] FLAG: --manifest-url-header="" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801905 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801909 2555 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801917 2555 flags.go:64] FLAG: --max-pods="110" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801922 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801926 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801931 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801935 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801940 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801944 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 12:31:32.810715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801949 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801960 2555 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801965 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801970 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801975 2555 flags.go:64] FLAG: --pod-cidr="" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801979 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801987 2555 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.801992 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802014 2555 flags.go:64] FLAG: --pods-per-core="0" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802019 2555 flags.go:64] FLAG: --port="10250" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802024 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802029 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-005e136f1c8e890d3" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802035 2555 flags.go:64] FLAG: --qos-reserved="" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802040 2555 flags.go:64] FLAG: --read-only-port="10255" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802045 2555 flags.go:64] FLAG: --register-node="true" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802050 2555 flags.go:64] FLAG: --register-with-taints="" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802061 2555 flags.go:64] FLAG: --registry-burst="10" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802067 2555 flags.go:64] FLAG: --registry-qps="5" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802072 2555 flags.go:64] FLAG: --reserved-cpus="" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802076 2555 flags.go:64] FLAG: --reserved-memory="" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802092 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802098 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802103 2555 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802108 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802112 2555 flags.go:64] FLAG: --runonce="false" Jun 09 12:31:32.811799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802116 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802126 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802131 2555 flags.go:64] FLAG: --seccomp-default="false" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802135 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802140 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802145 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802149 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802154 2555 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802158 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802163 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802167 2555 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802172 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802177 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802182 2555 flags.go:64] FLAG: --system-cgroups="" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802186 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802195 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802199 2555 flags.go:64] FLAG: --tls-cert-file="" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802203 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802210 2555 flags.go:64] FLAG: --tls-min-version="" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802216 2555 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802220 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802225 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802229 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802234 2555 flags.go:64] FLAG: --v="2" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802240 2555 flags.go:64] FLAG: --version="false" Jun 09 12:31:32.812959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802247 2555 flags.go:64] FLAG: --vmodule="" Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802253 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.802258 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802444 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802451 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802456 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802460 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802465 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802471 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802475 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802479 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802483 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802487 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802491 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802496 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802500 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802504 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802510 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802515 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802520 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:32.813767 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802525 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802529 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802535 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802541 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802546 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802551 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802557 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802561 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802565 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802570 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802574 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802578 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802582 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802587 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802591 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802595 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802599 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802603 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802607 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:32.814621 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802612 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802618 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802622 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802626 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802630 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802634 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802638 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802642 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802647 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802651 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802655 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802659 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802663 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802667 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802671 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802675 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802679 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802683 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802687 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802692 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:32.815360 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802696 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802700 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802704 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802708 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802712 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802717 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802721 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802726 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802731 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802735 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802740 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802744 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802749 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802754 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802759 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802763 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802767 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802771 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802775 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802779 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:32.815945 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802784 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802788 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802792 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802795 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802800 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802805 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802809 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802813 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802817 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802821 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802826 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802831 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802835 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802842 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802848 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802852 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802857 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802862 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802866 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:32.816498 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802871 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802876 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802880 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.802885 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.803630 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.811798 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.811816 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.811843 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.811853 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811934 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811942 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811947 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811951 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811956 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811961 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:32.816969 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811966 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811970 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811975 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811979 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811983 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811987 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.811992 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812018 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812023 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812028 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812032 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812037 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812041 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812045 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812049 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812053 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812057 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812061 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812065 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812069 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:32.817427 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812073 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812078 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812082 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812087 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812091 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812096 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812100 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812104 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812108 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812111 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812116 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812120 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812124 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812130 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812136 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812140 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812144 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812148 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812153 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:32.817912 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812159 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812165 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812170 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812175 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812180 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812184 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812189 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812193 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812197 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812201 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812206 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812210 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812214 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812218 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812223 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812227 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812231 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812236 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812241 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812245 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:32.818497 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812249 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812253 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812257 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812261 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812265 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812269 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812273 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812277 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812281 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812285 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812289 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812293 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812297 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812301 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812305 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812310 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812314 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812317 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812322 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812326 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:32.819018 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812331 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812337 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812342 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812347 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812353 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812357 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812362 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812366 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812371 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812376 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812381 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812386 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812391 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812395 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.812403 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:31:32.819630 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812582 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812591 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812595 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812600 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812604 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812608 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812612 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812615 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812619 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812624 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812629 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812633 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812637 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812642 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812647 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812651 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812654 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812658 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812662 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:32.820336 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812667 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812674 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812678 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812685 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812690 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812695 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812699 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812704 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812709 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812714 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812718 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812722 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812726 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812730 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812734 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812738 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812742 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812746 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812750 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:32.821117 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812754 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812758 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812762 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812766 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812770 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812774 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812778 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812782 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812786 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812790 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812794 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812798 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812802 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812806 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812810 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812814 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812818 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812821 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812825 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812829 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:32.821908 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812833 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812837 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812844 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812849 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812853 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812857 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812861 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812865 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812869 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812873 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812877 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812882 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812886 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812890 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812894 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812898 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812903 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812906 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812911 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812915 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:32.822590 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812919 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812923 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812927 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812931 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812935 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812939 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812943 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812948 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812952 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812955 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812959 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812963 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812968 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812972 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812978 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812981 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812988 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.812994 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.813017 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:32.823099 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.813021 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:32.823577 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:32.813025 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:32.823577 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.813033 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:31:32.823577 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.813185 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 12:31:32.823577 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.815789 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 12:31:32.823577 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.817272 2555 server.go:1019] "Starting client certificate rotation" Jun 09 12:31:32.823577 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.817379 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 12:31:32.823577 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.817416 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 12:31:32.823577 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.820568 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 12:31:32.823577 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.822268 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 12:31:32.833594 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.833576 2555 log.go:25] "Validated CRI v1 runtime API" Jun 09 12:31:32.836120 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.836095 2555 log.go:25] "Validated CRI v1 image API" Jun 09 12:31:32.836946 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.836927 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 12:31:32.843064 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.843042 2555 fs.go:135] Filesystem UUIDs: map[292c388e-1d12-4fd9-a7b8-d263a90a2cfa:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b884f059-9ce9-406b-a520-56be44faa038:/dev/nvme0n1p4] Jun 09 12:31:32.843064 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.843060 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 12:31:32.848793 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.848677 2555 manager.go:216] Machine: {Timestamp:2026-06-09 12:31:32.847335653 +0000 UTC m=+0.361483735 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3151474 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24fd048adbc2101a378a84ca18db67 SystemUUID:ec24fd04-8adb-c210-1a37-8a84ca18db67 BootID:3551784a-452b-4afe-9a61-a1d572c84628 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:f8:6b:89:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:f8:6b:89:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:b7:da:f5:51:6a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 12:31:32.848793 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.848785 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 12:31:32.848934 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.848860 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 12:31:32.852064 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.852035 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 12:31:32.852201 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.852067 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-164.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 12:31:32.852753 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.852744 2555 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 12:31:32.852782 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.852757 2555 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 12:31:32.852782 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.852765 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 12:31:32.853490 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.853480 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 12:31:32.854479 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.854469 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 12:31:32.857482 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.857470 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 09 12:31:32.857595 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.857585 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 12:31:32.857633 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.857618 2555 kubelet.go:486] "Attempting to sync node with API server" Jun 09 12:31:32.857633 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.857627 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 12:31:32.857686 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.857640 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 12:31:32.857686 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.857649 2555 kubelet.go:398] "Adding apiserver pod source" Jun 09 12:31:32.857686 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.857658 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 12:31:32.858024 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.858013 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 12:31:32.858073 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.858033 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 12:31:32.862307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.862292 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 12:31:32.863648 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.863629 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 12:31:32.863697 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.863665 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 12:31:32.864475 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.864455 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 12:31:32.865150 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865138 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 12:31:32.865199 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865176 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 12:31:32.865199 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865185 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 12:31:32.865199 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865192 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 12:31:32.865279 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865202 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 12:31:32.865279 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865210 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 12:31:32.865279 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865221 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 12:31:32.865279 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865228 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 12:31:32.865279 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865235 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 12:31:32.865279 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865242 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 12:31:32.865279 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865262 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 12:31:32.865279 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.865271 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 12:31:32.866417 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.866408 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 12:31:32.866417 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.866417 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 12:31:32.869828 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.869815 2555 server.go:1268] "Started kubelet" Jun 09 12:31:32.869925 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.869900 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 12:31:32.869980 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.869893 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 12:31:32.869980 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.869961 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 12:31:32.870738 ip-10-0-135-164 systemd[1]: Started Kubernetes Kubelet. Jun 09 12:31:32.871762 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.871689 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 12:31:32.875916 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.875854 2555 server.go:310] "Adding debug handlers to kubelet server" Jun 09 12:31:32.876536 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.876514 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-164.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 12:31:32.876536 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.876518 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 12:31:32.877288 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.877260 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 12:31:32.880784 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.878443 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-164.ec2.internal.18b7699b2e87459e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-164.ec2.internal,UID:ip-10-0-135-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-164.ec2.internal,},FirstTimestamp:2026-06-09 12:31:32.86978499 +0000 UTC m=+0.383933110,LastTimestamp:2026-06-09 12:31:32.86978499 +0000 UTC m=+0.383933110,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-164.ec2.internal,}" Jun 09 12:31:32.881820 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.881800 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 12:31:32.883319 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.883300 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 12:31:32.883319 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.883316 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 12:31:32.883472 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.883446 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:32.883926 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.883908 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 12:31:32.883926 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.883912 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 12:31:32.884248 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.883931 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 12:31:32.884248 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.884076 2555 reconstruct.go:97] "Volume reconstruction finished" Jun 09 12:31:32.884248 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.884083 2555 reconciler.go:29] "Reconciler: start to sync state" Jun 09 12:31:32.884984 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.884953 2555 factory.go:55] Registering systemd factory Jun 09 12:31:32.884984 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.884973 2555 factory.go:223] Registration of the systemd container factory successfully Jun 09 12:31:32.885231 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.885213 2555 factory.go:153] Registering CRI-O factory Jun 09 12:31:32.885231 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.885232 2555 factory.go:223] Registration of the crio container factory successfully Jun 09 12:31:32.885368 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.885297 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 12:31:32.885368 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.885320 2555 factory.go:103] Registering Raw factory Jun 09 12:31:32.885368 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.885335 2555 manager.go:1196] Started watching for new ooms in manager Jun 09 12:31:32.885746 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.885729 2555 manager.go:349] Starting recovery of all containers Jun 09 12:31:32.888505 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.888478 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 12:31:32.888624 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.888603 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 12:31:32.896017 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.895988 2555 manager.go:354] Recovery completed Jun 09 12:31:32.900196 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.900181 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:32.901820 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.901787 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:32.901919 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.901833 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:32.901919 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.901846 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:32.902723 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.902707 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 12:31:32.902723 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.902718 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:32.902723 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.902722 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 12:31:32.902832 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.902741 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 09 12:31:32.903481 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.903464 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:32.903537 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.903492 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:32.903537 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.903503 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:32.903965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.903954 2555 policy_none.go:49] "None policy: Start" Jun 09 12:31:32.904052 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.903971 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 12:31:32.904052 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.903981 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 12:31:32.904177 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.904064 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-164.ec2.internal.18b7699b30700da9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-164.ec2.internal,UID:ip-10-0-135-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-164.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-164.ec2.internal,},FirstTimestamp:2026-06-09 12:31:32.901817769 +0000 UTC m=+0.415965846,LastTimestamp:2026-06-09 12:31:32.901817769 +0000 UTC m=+0.415965846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-164.ec2.internal,}" Jun 09 12:31:32.904934 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.904923 2555 policy_none.go:47] "Start" Jun 09 12:31:32.912587 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.912520 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-164.ec2.internal.18b7699b3070653c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-164.ec2.internal,UID:ip-10-0-135-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-164.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-164.ec2.internal,},FirstTimestamp:2026-06-09 12:31:32.901840188 +0000 UTC m=+0.415988264,LastTimestamp:2026-06-09 12:31:32.901840188 +0000 UTC m=+0.415988264,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-164.ec2.internal,}" Jun 09 12:31:32.920385 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.920366 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cg5c8" Jun 09 12:31:32.922499 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.922407 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-164.ec2.internal.18b7699b30708cd3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-164.ec2.internal,UID:ip-10-0-135-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-164.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-164.ec2.internal,},FirstTimestamp:2026-06-09 12:31:32.901850323 +0000 UTC m=+0.415998400,LastTimestamp:2026-06-09 12:31:32.901850323 +0000 UTC m=+0.415998400,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-164.ec2.internal,}" Jun 09 12:31:32.926369 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.926219 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cg5c8" Jun 09 12:31:32.943738 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.943566 2555 manager.go:337] "Starting Device Plugin manager" Jun 09 12:31:32.956712 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.943761 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 12:31:32.956712 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.943775 2555 server.go:87] "Starting device plugin registration server" Jun 09 12:31:32.956712 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.944072 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 12:31:32.956712 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.944086 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 12:31:32.956712 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.944161 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 12:31:32.956712 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.944247 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 12:31:32.956712 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.944258 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 12:31:32.956712 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.944841 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 12:31:32.956712 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.944894 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:32.956712 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.955721 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 12:31:32.957109 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.957095 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 12:31:32.957152 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.957133 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 12:31:32.957189 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.957152 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 12:31:32.957238 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:32.957221 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 12:31:32.958768 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:32.958753 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:33.044607 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.044510 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:33.051208 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.051191 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:33.051277 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.051223 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:33.051277 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.051237 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:33.051354 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.051282 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.057507 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.057489 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal"] Jun 09 12:31:33.057564 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.057552 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:33.060455 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.060432 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.060455 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.060456 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-164.ec2.internal\": node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:33.063580 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.063561 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:33.063647 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.063592 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:33.063647 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.063604 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:33.064900 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.064887 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:33.065041 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.065023 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.065104 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.065060 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:33.065565 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.065552 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:33.065612 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.065574 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:33.065612 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.065589 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:33.065679 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.065648 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:33.065679 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.065673 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:33.065744 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.065683 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:33.066716 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.066702 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.066765 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.066728 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:33.070729 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.070716 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:33.070793 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.070737 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:33.070793 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.070753 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:33.082500 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.082486 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:33.102734 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.102717 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-164.ec2.internal\" not found" node="ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.107161 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.107142 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-164.ec2.internal\" not found" node="ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.183023 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.182977 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:33.185216 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.185198 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21767ba89e30e25bc416cb63b8be6401-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal\" (UID: \"21767ba89e30e25bc416cb63b8be6401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.185292 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.185224 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21767ba89e30e25bc416cb63b8be6401-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal\" (UID: \"21767ba89e30e25bc416cb63b8be6401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.185292 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.185242 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4aaeb683b3b1a7a518043c3fe0c1ee5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-164.ec2.internal\" (UID: \"a4aaeb683b3b1a7a518043c3fe0c1ee5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.283390 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.283350 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:33.285557 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.285535 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21767ba89e30e25bc416cb63b8be6401-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal\" (UID: \"21767ba89e30e25bc416cb63b8be6401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.285635 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.285572 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21767ba89e30e25bc416cb63b8be6401-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal\" (UID: \"21767ba89e30e25bc416cb63b8be6401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.285635 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.285595 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4aaeb683b3b1a7a518043c3fe0c1ee5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-164.ec2.internal\" (UID: \"a4aaeb683b3b1a7a518043c3fe0c1ee5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.285721 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.285639 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21767ba89e30e25bc416cb63b8be6401-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal\" (UID: \"21767ba89e30e25bc416cb63b8be6401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.285721 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.285656 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21767ba89e30e25bc416cb63b8be6401-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal\" (UID: \"21767ba89e30e25bc416cb63b8be6401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.285721 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.285655 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4aaeb683b3b1a7a518043c3fe0c1ee5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-164.ec2.internal\" (UID: \"a4aaeb683b3b1a7a518043c3fe0c1ee5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.384023 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.383947 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:33.407286 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.407265 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.412072 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.412053 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.484148 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.484113 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:33.584510 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.584477 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:33.685059 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.684969 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:33.727229 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.727205 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:33.785691 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.785662 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-164.ec2.internal\" not found" Jun 09 12:31:33.787464 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.787441 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:33.816724 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.816697 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 12:31:33.817381 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.816859 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:31:33.817381 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.816900 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:31:33.817381 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.816900 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:31:33.829984 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:33.829956 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4aaeb683b3b1a7a518043c3fe0c1ee5.slice/crio-fac077c4d4b95aa03b9d6426abfcfb09b611e158637ab905ef18d2b715105d57 WatchSource:0}: Error finding container fac077c4d4b95aa03b9d6426abfcfb09b611e158637ab905ef18d2b715105d57: Status 404 returned error can't find the container with id fac077c4d4b95aa03b9d6426abfcfb09b611e158637ab905ef18d2b715105d57 Jun 09 12:31:33.830278 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:33.830258 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21767ba89e30e25bc416cb63b8be6401.slice/crio-ecfa98cabc5c0da2151f0d0abd8ab09df9e08c187750dfa63f4efe1970bb6519 WatchSource:0}: Error finding container ecfa98cabc5c0da2151f0d0abd8ab09df9e08c187750dfa63f4efe1970bb6519: Status 404 returned error can't find the container with id ecfa98cabc5c0da2151f0d0abd8ab09df9e08c187750dfa63f4efe1970bb6519 Jun 09 12:31:33.837127 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.836961 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:31:33.858622 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.858604 2555 apiserver.go:52] "Watching apiserver" Jun 09 12:31:33.867592 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.867575 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 12:31:33.871111 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.871077 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-kl8b4","openshift-dns/node-resolver-v5262","openshift-multus/multus-57qw8","openshift-multus/multus-additional-cni-plugins-qhtgk","openshift-ovn-kubernetes/ovnkube-node-rrzdh","openshift-image-registry/node-ca-bjbzc","openshift-multus/network-metrics-daemon-7sknt","openshift-network-diagnostics/network-check-target-t5nkh","openshift-network-operator/iptables-alerter-pwrq7","kube-system/global-pull-secret-syncer-qxl9t","kube-system/konnectivity-agent-krdzp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k"] Jun 09 12:31:33.873290 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.873269 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.874287 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.874265 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:33.875410 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.875392 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.876208 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.876192 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:31:33.876381 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.876367 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dv5dc\"" Jun 09 12:31:33.876457 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.876418 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 12:31:33.876705 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.876691 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.877293 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.877276 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 12:31:33.877380 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.877305 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 12:31:33.877525 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.877512 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q9j9v\"" Jun 09 12:31:33.877782 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.877764 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.878128 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.877936 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 12:31:33.878461 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.878445 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 12:31:33.878527 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.878471 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 12:31:33.878527 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.878445 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q5rr6\"" Jun 09 12:31:33.878621 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.878487 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 12:31:33.878935 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.878902 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 12:31:33.879088 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.879053 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 12:31:33.879088 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.879076 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gs8ct\"" Jun 09 12:31:33.879392 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.879378 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:33.880626 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.880145 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svcsw\"" Jun 09 12:31:33.880626 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.880235 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 12:31:33.880626 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.880363 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 12:31:33.880626 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.880364 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 12:31:33.880961 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.880734 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:33.880961 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.880805 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 12:31:33.880961 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.880799 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:33.880961 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.880912 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 12:31:33.880961 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.880927 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 12:31:33.881623 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.881609 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 12:31:33.881956 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.881941 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:33.882052 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.882032 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:33.882052 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.882048 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 12:31:33.882191 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.882099 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 12:31:33.882277 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.882221 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wmbxc\"" Jun 09 12:31:33.883254 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.883237 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:33.883481 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.883461 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 12:31:33.883573 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.883499 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.884818 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.884798 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:33.884908 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.884872 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:33.885749 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.885729 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 12:31:33.885840 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.885729 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fhhxn\"" Jun 09 12:31:33.886238 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.885981 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:31:33.886238 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.886024 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 12:31:33.886376 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.886298 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:33.887650 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.887617 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:33.887650 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.887625 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-cni-netd\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.887812 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.887653 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7506101-7084-45c3-a578-63385c4c52b1-ovn-node-metrics-cert\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.887812 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.887690 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-system-cni-dir\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.887812 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.887715 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-systemd\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.887812 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.887786 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-lib-modules\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.888048 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.887868 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-run-netns\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.888048 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.887896 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-run-k8s-cni-cncf-io\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.888048 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.887960 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxfj\" (UniqueName: \"kubernetes.io/projected/b56c1dcf-b085-4924-9af2-538c61c8dfff-kube-api-access-dnxfj\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.888179 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888054 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-kubelet\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.888179 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888089 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/defc77c1-b17f-4f7e-b81d-fe817b6423f4-serviceca\") pod \"node-ca-bjbzc\" (UID: \"defc77c1-b17f-4f7e-b81d-fe817b6423f4\") " pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:33.888179 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888120 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwqzs\" (UniqueName: \"kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs\") pod \"network-check-target-t5nkh\" (UID: \"28a999b4-6592-4ae4-8ea9-a0e774756e1a\") " pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:33.888179 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888150 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-os-release\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.888370 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888194 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-hostroot\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.888370 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888225 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79e89228-0242-4e97-98a2-5432c7b7e319-kubelet-config\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:33.888370 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-kubernetes\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.888370 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-run\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.888370 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888348 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/90eff6cf-05c0-47be-a6f2-40f689890444-hosts-file\") pod \"node-resolver-v5262\" (UID: \"90eff6cf-05c0-47be-a6f2-40f689890444\") " pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:33.888620 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888388 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-systemd-units\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.888620 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888496 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/defc77c1-b17f-4f7e-b81d-fe817b6423f4-host\") pod \"node-ca-bjbzc\" (UID: \"defc77c1-b17f-4f7e-b81d-fe817b6423f4\") " pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:33.888620 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-295zq\" (UniqueName: \"kubernetes.io/projected/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-kube-api-access-295zq\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:33.888620 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888586 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sr72\" (UniqueName: \"kubernetes.io/projected/0be6b982-394a-4ec7-a1f8-f193b2d85261-kube-api-access-7sr72\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.888762 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888631 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-modprobe-d\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.888762 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888680 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-host\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.888762 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.888762 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfh8g\" (UniqueName: \"kubernetes.io/projected/d7506101-7084-45c3-a578-63385c4c52b1-kube-api-access-rfh8g\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.888762 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888740 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-run-multus-certs\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.888762 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-var-lib-kubelet\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.888965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888765 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-daemon-config\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.888965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gqsf\" (UniqueName: \"kubernetes.io/projected/a7555fee-a54b-42c5-8a04-966ddf7fe315-kube-api-access-8gqsf\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.888965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888818 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-run-openvswitch\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.888965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888847 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7506101-7084-45c3-a578-63385c4c52b1-ovnkube-config\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.888965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888881 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b56c1dcf-b085-4924-9af2-538c61c8dfff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.888965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888910 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-sysctl-conf\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.888965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7506101-7084-45c3-a578-63385c4c52b1-ovnkube-script-lib\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.888965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888960 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-system-cni-dir\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.888988 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-run-netns\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889038 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-cnibin\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zxr8\" (UniqueName: \"kubernetes.io/projected/90eff6cf-05c0-47be-a6f2-40f689890444-kube-api-access-6zxr8\") pod \"node-resolver-v5262\" (UID: \"90eff6cf-05c0-47be-a6f2-40f689890444\") " pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889101 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-run-ovn\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889127 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-log-socket\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889146 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-cni-dir\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889165 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-cnibin\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889203 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0be6b982-394a-4ec7-a1f8-f193b2d85261-cni-binary-copy\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889233 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-etc-kubernetes\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889258 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-os-release\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-var-lib-openvswitch\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.889307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889307 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-etc-openvswitch\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889330 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-node-log\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889355 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-cni-bin\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889391 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7506101-7084-45c3-a578-63385c4c52b1-env-overrides\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889418 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-conf-dir\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b56c1dcf-b085-4924-9af2-538c61c8dfff-cni-binary-copy\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889480 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-slash\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889504 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889526 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889574 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5lsr\" (UniqueName: \"kubernetes.io/projected/354dce40-b7a5-4851-85ea-e83ab53c8507-kube-api-access-z5lsr\") pod \"iptables-alerter-pwrq7\" (UID: \"354dce40-b7a5-4851-85ea-e83ab53c8507\") " pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79e89228-0242-4e97-98a2-5432c7b7e319-dbus\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889646 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/354dce40-b7a5-4851-85ea-e83ab53c8507-iptables-alerter-script\") pod \"iptables-alerter-pwrq7\" (UID: \"354dce40-b7a5-4851-85ea-e83ab53c8507\") " pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889719 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889779 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-tuned\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889813 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7555fee-a54b-42c5-8a04-966ddf7fe315-tmp\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.889917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889836 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90eff6cf-05c0-47be-a6f2-40f689890444-tmp-dir\") pod \"node-resolver-v5262\" (UID: \"90eff6cf-05c0-47be-a6f2-40f689890444\") " pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889877 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6gvv\" (UniqueName: \"kubernetes.io/projected/defc77c1-b17f-4f7e-b81d-fe817b6423f4-kube-api-access-t6gvv\") pod \"node-ca-bjbzc\" (UID: \"defc77c1-b17f-4f7e-b81d-fe817b6423f4\") " pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-socket-dir-parent\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889920 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-sys\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889951 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-var-lib-cni-bin\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.889987 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-var-lib-kubelet\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.890030 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b56c1dcf-b085-4924-9af2-538c61c8dfff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.890055 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-run-systemd\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.890069 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-var-lib-cni-multus\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.890112 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/354dce40-b7a5-4851-85ea-e83ab53c8507-host-slash\") pod \"iptables-alerter-pwrq7\" (UID: \"354dce40-b7a5-4851-85ea-e83ab53c8507\") " pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.890134 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-sysconfig\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.890147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-sysctl-d\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.890666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.890532 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 12:31:33.891897 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.891876 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-phgdz\"" Jun 09 12:31:33.892012 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.891927 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 12:31:33.893087 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.893070 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4v6q6\"" Jun 09 12:31:33.893178 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.893122 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 12:31:33.893178 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.893168 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 12:31:33.903241 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.903220 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 12:31:33.907668 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.907651 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 12:31:33.908304 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.908290 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 12:31:33.908373 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.908362 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal" Jun 09 12:31:33.908481 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.908466 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal"] Jun 09 12:31:33.924633 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.924611 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal"] Jun 09 12:31:33.924738 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.924716 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 12:31:33.930607 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.930568 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 12:26:32 +0000 UTC" deadline="2028-03-13 11:41:56.148983264 +0000 UTC" Jun 09 12:31:33.930607 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.930607 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15431h10m22.218378729s" Jun 09 12:31:33.944103 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.944033 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k4z45" Jun 09 12:31:33.953400 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.953380 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k4z45" Jun 09 12:31:33.960832 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.960784 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal" event={"ID":"a4aaeb683b3b1a7a518043c3fe0c1ee5","Type":"ContainerStarted","Data":"fac077c4d4b95aa03b9d6426abfcfb09b611e158637ab905ef18d2b715105d57"} Jun 09 12:31:33.961722 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.961705 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" event={"ID":"21767ba89e30e25bc416cb63b8be6401","Type":"ContainerStarted","Data":"ecfa98cabc5c0da2151f0d0abd8ab09df9e08c187750dfa63f4efe1970bb6519"} Jun 09 12:31:33.985148 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.985130 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 12:31:33.990678 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990650 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-run-netns\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.990831 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990685 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-run-k8s-cni-cncf-io\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.990831 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990712 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxfj\" (UniqueName: \"kubernetes.io/projected/b56c1dcf-b085-4924-9af2-538c61c8dfff-kube-api-access-dnxfj\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.990831 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990720 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-run-netns\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.990831 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990738 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-kubelet\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.990831 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990748 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-run-k8s-cni-cncf-io\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.990831 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990762 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/defc77c1-b17f-4f7e-b81d-fe817b6423f4-serviceca\") pod \"node-ca-bjbzc\" (UID: \"defc77c1-b17f-4f7e-b81d-fe817b6423f4\") " pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:33.990831 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990787 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqzs\" (UniqueName: \"kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs\") pod \"network-check-target-t5nkh\" (UID: \"28a999b4-6592-4ae4-8ea9-a0e774756e1a\") " pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:33.990831 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-os-release\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.990831 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990802 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-kubelet\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990838 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-hostroot\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79e89228-0242-4e97-98a2-5432c7b7e319-kubelet-config\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990888 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-kubernetes\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990911 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-run\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990929 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-os-release\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990936 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/90eff6cf-05c0-47be-a6f2-40f689890444-hosts-file\") pod \"node-resolver-v5262\" (UID: \"90eff6cf-05c0-47be-a6f2-40f689890444\") " pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.990985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991026 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-run\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991034 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-systemd-units\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991022 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79e89228-0242-4e97-98a2-5432c7b7e319-kubelet-config\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991067 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-hostroot\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991082 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-systemd-units\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991089 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-kubernetes\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991112 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/defc77c1-b17f-4f7e-b81d-fe817b6423f4-host\") pod \"node-ca-bjbzc\" (UID: \"defc77c1-b17f-4f7e-b81d-fe817b6423f4\") " pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991142 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-295zq\" (UniqueName: \"kubernetes.io/projected/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-kube-api-access-295zq\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991105 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/90eff6cf-05c0-47be-a6f2-40f689890444-hosts-file\") pod \"node-resolver-v5262\" (UID: \"90eff6cf-05c0-47be-a6f2-40f689890444\") " pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991183 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/defc77c1-b17f-4f7e-b81d-fe817b6423f4-host\") pod \"node-ca-bjbzc\" (UID: \"defc77c1-b17f-4f7e-b81d-fe817b6423f4\") " pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:33.991318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991250 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sr72\" (UniqueName: \"kubernetes.io/projected/0be6b982-394a-4ec7-a1f8-f193b2d85261-kube-api-access-7sr72\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991252 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/defc77c1-b17f-4f7e-b81d-fe817b6423f4-serviceca\") pod \"node-ca-bjbzc\" (UID: \"defc77c1-b17f-4f7e-b81d-fe817b6423f4\") " pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991276 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-modprobe-d\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991315 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-host\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991341 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr9qp\" (UniqueName: \"kubernetes.io/projected/276b0198-b470-4ea3-85dc-07d5aeb518e7-kube-api-access-jr9qp\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991367 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-modprobe-d\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991400 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991401 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfh8g\" (UniqueName: \"kubernetes.io/projected/d7506101-7084-45c3-a578-63385c4c52b1-kube-api-access-rfh8g\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991371 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-host\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991453 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-run-multus-certs\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991484 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-var-lib-kubelet\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991510 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-sys-fs\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991547 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-run-multus-certs\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991561 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-var-lib-kubelet\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/572ea6d9-269a-4d3a-86e8-a19b840b7724-konnectivity-ca\") pod \"konnectivity-agent-krdzp\" (UID: \"572ea6d9-269a-4d3a-86e8-a19b840b7724\") " pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991623 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-daemon-config\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.992068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991639 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gqsf\" (UniqueName: \"kubernetes.io/projected/a7555fee-a54b-42c5-8a04-966ddf7fe315-kube-api-access-8gqsf\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991665 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/572ea6d9-269a-4d3a-86e8-a19b840b7724-agent-certs\") pod \"konnectivity-agent-krdzp\" (UID: \"572ea6d9-269a-4d3a-86e8-a19b840b7724\") " pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-run-openvswitch\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991792 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-run-openvswitch\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991799 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7506101-7084-45c3-a578-63385c4c52b1-ovnkube-config\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991825 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b56c1dcf-b085-4924-9af2-538c61c8dfff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991844 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-sysctl-conf\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991859 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7506101-7084-45c3-a578-63385c4c52b1-ovnkube-script-lib\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991883 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-system-cni-dir\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991907 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-run-netns\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991951 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-system-cni-dir\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991953 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-run-netns\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.991991 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-cnibin\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992026 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-sysctl-conf\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992046 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zxr8\" (UniqueName: \"kubernetes.io/projected/90eff6cf-05c0-47be-a6f2-40f689890444-kube-api-access-6zxr8\") pod \"node-resolver-v5262\" (UID: \"90eff6cf-05c0-47be-a6f2-40f689890444\") " pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992066 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-cnibin\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992072 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-run-ovn\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.992870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992110 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-run-ovn\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992185 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-log-socket\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992217 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-cni-dir\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992225 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-log-socket\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992254 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-cnibin\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992302 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-cni-dir\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992319 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-cnibin\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992327 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0be6b982-394a-4ec7-a1f8-f193b2d85261-cni-binary-copy\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992329 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-daemon-config\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992354 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-etc-kubernetes\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992353 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7506101-7084-45c3-a578-63385c4c52b1-ovnkube-config\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992370 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-os-release\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992405 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-etc-kubernetes\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992420 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-os-release\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992433 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-var-lib-openvswitch\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992438 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7506101-7084-45c3-a578-63385c4c52b1-ovnkube-script-lib\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992466 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-etc-openvswitch\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992477 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-var-lib-openvswitch\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.993666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992491 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-node-log\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992509 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-cni-bin\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992514 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-etc-openvswitch\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992523 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7506101-7084-45c3-a578-63385c4c52b1-env-overrides\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992527 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b56c1dcf-b085-4924-9af2-538c61c8dfff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992544 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-conf-dir\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992554 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-node-log\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992562 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-cni-bin\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992589 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-conf-dir\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992628 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b56c1dcf-b085-4924-9af2-538c61c8dfff-cni-binary-copy\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992655 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-slash\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992670 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992726 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-slash\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992731 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lsr\" (UniqueName: \"kubernetes.io/projected/354dce40-b7a5-4851-85ea-e83ab53c8507-kube-api-access-z5lsr\") pod \"iptables-alerter-pwrq7\" (UID: \"354dce40-b7a5-4851-85ea-e83ab53c8507\") " pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992754 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0be6b982-394a-4ec7-a1f8-f193b2d85261-cni-binary-copy\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992815 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79e89228-0242-4e97-98a2-5432c7b7e319-dbus\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.992821 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:33.994382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-device-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992869 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.992889 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs podName:f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:34.492869486 +0000 UTC m=+2.007017556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs") pod "network-metrics-daemon-7sknt" (UID: "f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992892 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992900 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7506101-7084-45c3-a578-63385c4c52b1-env-overrides\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992907 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992941 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/354dce40-b7a5-4851-85ea-e83ab53c8507-iptables-alerter-script\") pod \"iptables-alerter-pwrq7\" (UID: \"354dce40-b7a5-4851-85ea-e83ab53c8507\") " pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993017 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.992970 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79e89228-0242-4e97-98a2-5432c7b7e319-dbus\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993044 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b56c1dcf-b085-4924-9af2-538c61c8dfff-cni-binary-copy\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.993073 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993125 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-tuned\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993150 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7555fee-a54b-42c5-8a04-966ddf7fe315-tmp\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:33.993163 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret podName:79e89228-0242-4e97-98a2-5432c7b7e319 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:34.493148562 +0000 UTC m=+2.007296625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret") pod "global-pull-secret-syncer-qxl9t" (UID: "79e89228-0242-4e97-98a2-5432c7b7e319") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993184 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90eff6cf-05c0-47be-a6f2-40f689890444-tmp-dir\") pod \"node-resolver-v5262\" (UID: \"90eff6cf-05c0-47be-a6f2-40f689890444\") " pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993200 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-socket-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:33.994933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993222 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6gvv\" (UniqueName: \"kubernetes.io/projected/defc77c1-b17f-4f7e-b81d-fe817b6423f4-kube-api-access-t6gvv\") pod \"node-ca-bjbzc\" (UID: \"defc77c1-b17f-4f7e-b81d-fe817b6423f4\") " pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993254 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-socket-dir-parent\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993277 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-sys\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993316 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-registration-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993343 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-sys\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993330 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-multus-socket-dir-parent\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993387 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-var-lib-cni-bin\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993451 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-var-lib-cni-bin\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993458 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-var-lib-kubelet\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993504 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b56c1dcf-b085-4924-9af2-538c61c8dfff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993508 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-var-lib-kubelet\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993509 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/354dce40-b7a5-4851-85ea-e83ab53c8507-iptables-alerter-script\") pod \"iptables-alerter-pwrq7\" (UID: \"354dce40-b7a5-4851-85ea-e83ab53c8507\") " pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993529 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-run-systemd\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993560 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993571 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90eff6cf-05c0-47be-a6f2-40f689890444-tmp-dir\") pod \"node-resolver-v5262\" (UID: \"90eff6cf-05c0-47be-a6f2-40f689890444\") " pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993592 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-var-lib-cni-multus\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993629 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-run-systemd\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.995422 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993660 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/354dce40-b7a5-4851-85ea-e83ab53c8507-host-slash\") pod \"iptables-alerter-pwrq7\" (UID: \"354dce40-b7a5-4851-85ea-e83ab53c8507\") " pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993682 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-sysconfig\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993710 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0be6b982-394a-4ec7-a1f8-f193b2d85261-host-var-lib-cni-multus\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993720 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-sysctl-d\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993731 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/354dce40-b7a5-4851-85ea-e83ab53c8507-host-slash\") pod \"iptables-alerter-pwrq7\" (UID: \"354dce40-b7a5-4851-85ea-e83ab53c8507\") " pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993762 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-sysconfig\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993773 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-cni-netd\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993797 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7506101-7084-45c3-a578-63385c4c52b1-ovn-node-metrics-cert\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993820 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-system-cni-dir\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993849 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-sysctl-d\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993856 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-systemd\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993868 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7506101-7084-45c3-a578-63385c4c52b1-host-cni-netd\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993896 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-lib-modules\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993914 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b56c1dcf-b085-4924-9af2-538c61c8dfff-system-cni-dir\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993929 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b56c1dcf-b085-4924-9af2-538c61c8dfff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993981 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-systemd\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.995932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.993993 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7555fee-a54b-42c5-8a04-966ddf7fe315-lib-modules\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.996763 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.996740 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7506101-7084-45c3-a578-63385c4c52b1-ovn-node-metrics-cert\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:33.996841 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.996765 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7555fee-a54b-42c5-8a04-966ddf7fe315-tmp\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:33.996841 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:33.996800 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a7555fee-a54b-42c5-8a04-966ddf7fe315-etc-tuned\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:34.001485 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.001466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxfj\" (UniqueName: \"kubernetes.io/projected/b56c1dcf-b085-4924-9af2-538c61c8dfff-kube-api-access-dnxfj\") pod \"multus-additional-cni-plugins-qhtgk\" (UID: \"b56c1dcf-b085-4924-9af2-538c61c8dfff\") " pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:34.003229 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.003209 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:34.003482 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.003235 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:34.003482 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.003249 2555 projected.go:196] Error preparing data for projected volume kube-api-access-gwqzs for pod openshift-network-diagnostics/network-check-target-t5nkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:34.003631 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.003482 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs podName:28a999b4-6592-4ae4-8ea9-a0e774756e1a nodeName:}" failed. No retries permitted until 2026-06-09 12:31:34.503371209 +0000 UTC m=+2.017519274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gwqzs" (UniqueName: "kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs") pod "network-check-target-t5nkh" (UID: "28a999b4-6592-4ae4-8ea9-a0e774756e1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:34.005427 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.005378 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gqsf\" (UniqueName: \"kubernetes.io/projected/a7555fee-a54b-42c5-8a04-966ddf7fe315-kube-api-access-8gqsf\") pod \"tuned-kl8b4\" (UID: \"a7555fee-a54b-42c5-8a04-966ddf7fe315\") " pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:34.005518 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.005467 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfh8g\" (UniqueName: \"kubernetes.io/projected/d7506101-7084-45c3-a578-63385c4c52b1-kube-api-access-rfh8g\") pod \"ovnkube-node-rrzdh\" (UID: \"d7506101-7084-45c3-a578-63385c4c52b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:34.005804 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.005758 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sr72\" (UniqueName: \"kubernetes.io/projected/0be6b982-394a-4ec7-a1f8-f193b2d85261-kube-api-access-7sr72\") pod \"multus-57qw8\" (UID: \"0be6b982-394a-4ec7-a1f8-f193b2d85261\") " pod="openshift-multus/multus-57qw8" Jun 09 12:31:34.006206 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.006179 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-295zq\" (UniqueName: \"kubernetes.io/projected/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-kube-api-access-295zq\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:34.006598 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.006578 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6gvv\" (UniqueName: \"kubernetes.io/projected/defc77c1-b17f-4f7e-b81d-fe817b6423f4-kube-api-access-t6gvv\") pod \"node-ca-bjbzc\" (UID: \"defc77c1-b17f-4f7e-b81d-fe817b6423f4\") " pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:34.006972 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.006952 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5lsr\" (UniqueName: \"kubernetes.io/projected/354dce40-b7a5-4851-85ea-e83ab53c8507-kube-api-access-z5lsr\") pod \"iptables-alerter-pwrq7\" (UID: \"354dce40-b7a5-4851-85ea-e83ab53c8507\") " pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:34.007452 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.007437 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zxr8\" (UniqueName: \"kubernetes.io/projected/90eff6cf-05c0-47be-a6f2-40f689890444-kube-api-access-6zxr8\") pod \"node-resolver-v5262\" (UID: \"90eff6cf-05c0-47be-a6f2-40f689890444\") " pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:34.094333 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094306 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-device-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094333 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094345 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-socket-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094534 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094364 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094534 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094388 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-registration-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094534 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094430 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-device-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094534 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094467 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094534 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094498 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9qp\" (UniqueName: \"kubernetes.io/projected/276b0198-b470-4ea3-85dc-07d5aeb518e7-kube-api-access-jr9qp\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094534 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094485 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094534 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094533 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094856 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094500 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-registration-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094856 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094532 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-sys-fs\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094856 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094565 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-socket-dir\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094856 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094606 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/276b0198-b470-4ea3-85dc-07d5aeb518e7-sys-fs\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.094856 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094708 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/572ea6d9-269a-4d3a-86e8-a19b840b7724-konnectivity-ca\") pod \"konnectivity-agent-krdzp\" (UID: \"572ea6d9-269a-4d3a-86e8-a19b840b7724\") " pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:34.094856 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.094754 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/572ea6d9-269a-4d3a-86e8-a19b840b7724-agent-certs\") pod \"konnectivity-agent-krdzp\" (UID: \"572ea6d9-269a-4d3a-86e8-a19b840b7724\") " pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:34.095580 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.095550 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/572ea6d9-269a-4d3a-86e8-a19b840b7724-konnectivity-ca\") pod \"konnectivity-agent-krdzp\" (UID: \"572ea6d9-269a-4d3a-86e8-a19b840b7724\") " pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:34.099429 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.099408 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/572ea6d9-269a-4d3a-86e8-a19b840b7724-agent-certs\") pod \"konnectivity-agent-krdzp\" (UID: \"572ea6d9-269a-4d3a-86e8-a19b840b7724\") " pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:34.104154 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.104134 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr9qp\" (UniqueName: \"kubernetes.io/projected/276b0198-b470-4ea3-85dc-07d5aeb518e7-kube-api-access-jr9qp\") pod \"aws-ebs-csi-driver-node-vf56k\" (UID: \"276b0198-b470-4ea3-85dc-07d5aeb518e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.183728 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.183688 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" Jun 09 12:31:34.190691 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.190672 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5262" Jun 09 12:31:34.192359 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:34.192307 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7555fee_a54b_42c5_8a04_966ddf7fe315.slice/crio-71bc4e245a547ea28f518f5bf37747c58ce01a5285f490e96b0d43a41dfeb8e7 WatchSource:0}: Error finding container 71bc4e245a547ea28f518f5bf37747c58ce01a5285f490e96b0d43a41dfeb8e7: Status 404 returned error can't find the container with id 71bc4e245a547ea28f518f5bf37747c58ce01a5285f490e96b0d43a41dfeb8e7 Jun 09 12:31:34.197113 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.197097 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-57qw8" Jun 09 12:31:34.197870 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:34.197848 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90eff6cf_05c0_47be_a6f2_40f689890444.slice/crio-29cce382a3a2ececc3a04584ead735b15a0347511df3b20773d78e5fb702d28b WatchSource:0}: Error finding container 29cce382a3a2ececc3a04584ead735b15a0347511df3b20773d78e5fb702d28b: Status 404 returned error can't find the container with id 29cce382a3a2ececc3a04584ead735b15a0347511df3b20773d78e5fb702d28b Jun 09 12:31:34.203480 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.203461 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" Jun 09 12:31:34.205570 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:34.205543 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be6b982_394a_4ec7_a1f8_f193b2d85261.slice/crio-225bc4231cb90146f9e179fd41e37c12788e9f3e83d8276acf4b16c5d44e44bd WatchSource:0}: Error finding container 225bc4231cb90146f9e179fd41e37c12788e9f3e83d8276acf4b16c5d44e44bd: Status 404 returned error can't find the container with id 225bc4231cb90146f9e179fd41e37c12788e9f3e83d8276acf4b16c5d44e44bd Jun 09 12:31:34.207903 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.207848 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:31:34.211500 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:34.211477 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56c1dcf_b085_4924_9af2_538c61c8dfff.slice/crio-6305e24671a35f561296c872df72aed01ace494a2838a199d0acbeeb3b87206c WatchSource:0}: Error finding container 6305e24671a35f561296c872df72aed01ace494a2838a199d0acbeeb3b87206c: Status 404 returned error can't find the container with id 6305e24671a35f561296c872df72aed01ace494a2838a199d0acbeeb3b87206c Jun 09 12:31:34.213244 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.213221 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjbzc" Jun 09 12:31:34.217901 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:34.217878 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7506101_7084_45c3_a578_63385c4c52b1.slice/crio-4eba8400b843768e85680a371e6420ce093aa468a8d3b436e789a6bfe3ca7174 WatchSource:0}: Error finding container 4eba8400b843768e85680a371e6420ce093aa468a8d3b436e789a6bfe3ca7174: Status 404 returned error can't find the container with id 4eba8400b843768e85680a371e6420ce093aa468a8d3b436e789a6bfe3ca7174 Jun 09 12:31:34.219336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.219054 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pwrq7" Jun 09 12:31:34.224378 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.224232 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:34.224558 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:34.224537 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefc77c1_b17f_4f7e_b81d_fe817b6423f4.slice/crio-0278ca918278317f12072658a85aa19441ff434f1572b3701280ccfdd9d73588 WatchSource:0}: Error finding container 0278ca918278317f12072658a85aa19441ff434f1572b3701280ccfdd9d73588: Status 404 returned error can't find the container with id 0278ca918278317f12072658a85aa19441ff434f1572b3701280ccfdd9d73588 Jun 09 12:31:34.229693 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.229674 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" Jun 09 12:31:34.230902 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:34.230879 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354dce40_b7a5_4851_85ea_e83ab53c8507.slice/crio-65cec7a6114f8a01079468a897b9a47be3c6752da2520f4ef5189a781c3890c5 WatchSource:0}: Error finding container 65cec7a6114f8a01079468a897b9a47be3c6752da2520f4ef5189a781c3890c5: Status 404 returned error can't find the container with id 65cec7a6114f8a01079468a897b9a47be3c6752da2520f4ef5189a781c3890c5 Jun 09 12:31:34.236636 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:34.236613 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572ea6d9_269a_4d3a_86e8_a19b840b7724.slice/crio-2cfbf27472f8eeee4d61379fbf026dd371f5fd6c2645a24703b90bee9941897d WatchSource:0}: Error finding container 2cfbf27472f8eeee4d61379fbf026dd371f5fd6c2645a24703b90bee9941897d: Status 404 returned error can't find the container with id 2cfbf27472f8eeee4d61379fbf026dd371f5fd6c2645a24703b90bee9941897d Jun 09 12:31:34.239058 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:31:34.239037 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276b0198_b470_4ea3_85dc_07d5aeb518e7.slice/crio-d572e71b918d5ea0948b285d04f32af173695835c3f9132365fe672e14773272 WatchSource:0}: Error finding container d572e71b918d5ea0948b285d04f32af173695835c3f9132365fe672e14773272: Status 404 returned error can't find the container with id d572e71b918d5ea0948b285d04f32af173695835c3f9132365fe672e14773272 Jun 09 12:31:34.427296 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.427259 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:34.498460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.498383 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:34.498460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.498434 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:34.498656 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.498546 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:34.498656 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.498597 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret podName:79e89228-0242-4e97-98a2-5432c7b7e319 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:35.498583418 +0000 UTC m=+3.012731481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret") pod "global-pull-secret-syncer-qxl9t" (UID: "79e89228-0242-4e97-98a2-5432c7b7e319") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:34.499016 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.498986 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:34.499105 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.499065 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs podName:f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:35.499049073 +0000 UTC m=+3.013197142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs") pod "network-metrics-daemon-7sknt" (UID: "f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:34.598777 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.598740 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqzs\" (UniqueName: \"kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs\") pod \"network-check-target-t5nkh\" (UID: \"28a999b4-6592-4ae4-8ea9-a0e774756e1a\") " pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:34.598951 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.598918 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:34.598951 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.598940 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:34.598951 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.598953 2555 projected.go:196] Error preparing data for projected volume kube-api-access-gwqzs for pod openshift-network-diagnostics/network-check-target-t5nkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:34.599530 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:34.599508 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs podName:28a999b4-6592-4ae4-8ea9-a0e774756e1a nodeName:}" failed. No retries permitted until 2026-06-09 12:31:35.599483103 +0000 UTC m=+3.113631180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwqzs" (UniqueName: "kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs") pod "network-check-target-t5nkh" (UID: "28a999b4-6592-4ae4-8ea9-a0e774756e1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:34.860041 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.856056 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:34.955931 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.955888 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 12:26:33 +0000 UTC" deadline="2028-01-10 12:02:20.5646644 +0000 UTC" Jun 09 12:31:34.955931 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.955929 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13919h30m45.608739204s" Jun 09 12:31:34.983414 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.983376 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" event={"ID":"276b0198-b470-4ea3-85dc-07d5aeb518e7","Type":"ContainerStarted","Data":"d572e71b918d5ea0948b285d04f32af173695835c3f9132365fe672e14773272"} Jun 09 12:31:34.988193 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.988163 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pwrq7" event={"ID":"354dce40-b7a5-4851-85ea-e83ab53c8507","Type":"ContainerStarted","Data":"65cec7a6114f8a01079468a897b9a47be3c6752da2520f4ef5189a781c3890c5"} Jun 09 12:31:34.998597 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:34.998550 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjbzc" event={"ID":"defc77c1-b17f-4f7e-b81d-fe817b6423f4","Type":"ContainerStarted","Data":"0278ca918278317f12072658a85aa19441ff434f1572b3701280ccfdd9d73588"} Jun 09 12:31:35.001768 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.001704 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" event={"ID":"b56c1dcf-b085-4924-9af2-538c61c8dfff","Type":"ContainerStarted","Data":"6305e24671a35f561296c872df72aed01ace494a2838a199d0acbeeb3b87206c"} Jun 09 12:31:35.005174 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.005098 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5262" event={"ID":"90eff6cf-05c0-47be-a6f2-40f689890444","Type":"ContainerStarted","Data":"29cce382a3a2ececc3a04584ead735b15a0347511df3b20773d78e5fb702d28b"} Jun 09 12:31:35.010927 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.010863 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" event={"ID":"a7555fee-a54b-42c5-8a04-966ddf7fe315","Type":"ContainerStarted","Data":"71bc4e245a547ea28f518f5bf37747c58ce01a5285f490e96b0d43a41dfeb8e7"} Jun 09 12:31:35.012803 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.012774 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krdzp" event={"ID":"572ea6d9-269a-4d3a-86e8-a19b840b7724","Type":"ContainerStarted","Data":"2cfbf27472f8eeee4d61379fbf026dd371f5fd6c2645a24703b90bee9941897d"} Jun 09 12:31:35.028295 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.028267 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" event={"ID":"d7506101-7084-45c3-a578-63385c4c52b1","Type":"ContainerStarted","Data":"4eba8400b843768e85680a371e6420ce093aa468a8d3b436e789a6bfe3ca7174"} Jun 09 12:31:35.053778 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.053750 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-57qw8" event={"ID":"0be6b982-394a-4ec7-a1f8-f193b2d85261","Type":"ContainerStarted","Data":"225bc4231cb90146f9e179fd41e37c12788e9f3e83d8276acf4b16c5d44e44bd"} Jun 09 12:31:35.505662 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.505624 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:35.505851 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.505691 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:35.505920 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.505855 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:35.505920 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.505916 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret podName:79e89228-0242-4e97-98a2-5432c7b7e319 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:37.505897884 +0000 UTC m=+5.020045963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret") pod "global-pull-secret-syncer-qxl9t" (UID: "79e89228-0242-4e97-98a2-5432c7b7e319") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:35.506363 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.506339 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:35.506457 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.506389 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs podName:f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:37.506374774 +0000 UTC m=+5.020522842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs") pod "network-metrics-daemon-7sknt" (UID: "f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:35.607037 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.606441 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqzs\" (UniqueName: \"kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs\") pod \"network-check-target-t5nkh\" (UID: \"28a999b4-6592-4ae4-8ea9-a0e774756e1a\") " pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:35.607037 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.606592 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:35.607037 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.606612 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:35.607037 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.606624 2555 projected.go:196] Error preparing data for projected volume kube-api-access-gwqzs for pod openshift-network-diagnostics/network-check-target-t5nkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:35.607037 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.606681 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs podName:28a999b4-6592-4ae4-8ea9-a0e774756e1a nodeName:}" failed. No retries permitted until 2026-06-09 12:31:37.606663918 +0000 UTC m=+5.120811996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwqzs" (UniqueName: "kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs") pod "network-check-target-t5nkh" (UID: "28a999b4-6592-4ae4-8ea9-a0e774756e1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:35.957336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.957160 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 12:26:33 +0000 UTC" deadline="2028-02-17 05:20:06.532742628 +0000 UTC" Jun 09 12:31:35.957336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.957199 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14824h48m30.575548779s" Jun 09 12:31:35.957859 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.957368 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:35.957859 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.957494 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:35.957859 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.957608 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:35.957859 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.957698 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:35.957859 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:35.957765 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:35.957859 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:35.957833 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:36.069725 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:36.069698 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:36.307794 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:36.307716 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:37.525426 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:37.525382 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:37.525863 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:37.525432 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:37.525863 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.525531 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:37.525863 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.525576 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret podName:79e89228-0242-4e97-98a2-5432c7b7e319 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:41.525564398 +0000 UTC m=+9.039712462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret") pod "global-pull-secret-syncer-qxl9t" (UID: "79e89228-0242-4e97-98a2-5432c7b7e319") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:37.526078 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.525896 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:37.526078 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.525936 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs podName:f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:41.525925201 +0000 UTC m=+9.040073265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs") pod "network-metrics-daemon-7sknt" (UID: "f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:37.626606 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:37.626414 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqzs\" (UniqueName: \"kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs\") pod \"network-check-target-t5nkh\" (UID: \"28a999b4-6592-4ae4-8ea9-a0e774756e1a\") " pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:37.626798 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.626612 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:37.626798 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.626634 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:37.626798 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.626645 2555 projected.go:196] Error preparing data for projected volume kube-api-access-gwqzs for pod openshift-network-diagnostics/network-check-target-t5nkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:37.626798 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.626709 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs podName:28a999b4-6592-4ae4-8ea9-a0e774756e1a nodeName:}" failed. No retries permitted until 2026-06-09 12:31:41.626691252 +0000 UTC m=+9.140839316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwqzs" (UniqueName: "kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs") pod "network-check-target-t5nkh" (UID: "28a999b4-6592-4ae4-8ea9-a0e774756e1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:37.957460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:37.957366 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:37.957460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:37.957396 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:37.957701 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.957516 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:37.957983 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.957925 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:37.958077 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:37.957985 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:37.958235 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:37.958213 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:39.957732 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:39.957704 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:39.958232 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:39.957832 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:39.958232 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:39.957711 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:39.958232 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:39.957947 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:39.958232 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:39.957704 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:39.958232 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:39.958050 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:41.564669 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:41.564631 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:41.565084 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:41.564686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:41.565084 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.564832 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:41.565084 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.564884 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret podName:79e89228-0242-4e97-98a2-5432c7b7e319 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:49.564871286 +0000 UTC m=+17.079019349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret") pod "global-pull-secret-syncer-qxl9t" (UID: "79e89228-0242-4e97-98a2-5432c7b7e319") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:41.565261 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.565101 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:41.565261 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.565148 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs podName:f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:49.565133607 +0000 UTC m=+17.079281671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs") pod "network-metrics-daemon-7sknt" (UID: "f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:41.665162 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:41.665133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqzs\" (UniqueName: \"kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs\") pod \"network-check-target-t5nkh\" (UID: \"28a999b4-6592-4ae4-8ea9-a0e774756e1a\") " pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:41.665312 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.665258 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:41.665312 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.665281 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:41.665312 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.665294 2555 projected.go:196] Error preparing data for projected volume kube-api-access-gwqzs for pod openshift-network-diagnostics/network-check-target-t5nkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:41.665442 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.665352 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs podName:28a999b4-6592-4ae4-8ea9-a0e774756e1a nodeName:}" failed. No retries permitted until 2026-06-09 12:31:49.665335946 +0000 UTC m=+17.179484017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwqzs" (UniqueName: "kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs") pod "network-check-target-t5nkh" (UID: "28a999b4-6592-4ae4-8ea9-a0e774756e1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:41.957745 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:41.957708 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:41.957910 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:41.957749 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:41.957910 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:41.957719 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:41.957910 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.957813 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:41.958084 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.957922 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:41.958084 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:41.958034 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:43.958117 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:43.958072 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:43.958511 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:43.958072 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:43.958511 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:43.958212 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:43.958511 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:43.958218 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:43.958511 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:43.958346 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:43.958511 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:43.958443 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:45.958406 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:45.958360 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:45.958830 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:45.958413 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:45.958830 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:45.958419 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:45.958830 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:45.958510 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:45.958830 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:45.958588 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:45.958830 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:45.958683 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:47.957656 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:47.957621 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:47.957656 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:47.957644 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:47.957656 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:47.957656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:47.958198 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:47.957767 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:47.958198 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:47.957840 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:47.958198 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:47.957928 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:49.622971 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:49.622935 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:49.622971 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:49.622978 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:49.623511 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.623114 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:49.623511 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.623125 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:49.623511 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.623188 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs podName:f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:05.623165926 +0000 UTC m=+33.137314005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs") pod "network-metrics-daemon-7sknt" (UID: "f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:49.623511 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.623211 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret podName:79e89228-0242-4e97-98a2-5432c7b7e319 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:05.623201397 +0000 UTC m=+33.137349473 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret") pod "global-pull-secret-syncer-qxl9t" (UID: "79e89228-0242-4e97-98a2-5432c7b7e319") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:49.723546 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:49.723524 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqzs\" (UniqueName: \"kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs\") pod \"network-check-target-t5nkh\" (UID: \"28a999b4-6592-4ae4-8ea9-a0e774756e1a\") " pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:49.723665 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.723652 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:49.723705 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.723671 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:49.723705 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.723679 2555 projected.go:196] Error preparing data for projected volume kube-api-access-gwqzs for pod openshift-network-diagnostics/network-check-target-t5nkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:49.723781 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.723728 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs podName:28a999b4-6592-4ae4-8ea9-a0e774756e1a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:05.723714552 +0000 UTC m=+33.237862617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwqzs" (UniqueName: "kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs") pod "network-check-target-t5nkh" (UID: "28a999b4-6592-4ae4-8ea9-a0e774756e1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:49.957415 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:49.957327 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:49.957415 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:49.957362 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:49.957415 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:49.957371 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:49.957727 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.957449 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:49.957727 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.957568 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:49.957727 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:49.957655 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:51.958238 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:51.958210 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:51.958736 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:51.958251 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:51.958736 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:51.958210 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:51.958736 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:51.958334 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:51.958736 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:51.958406 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:51.958736 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:51.958491 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:53.958146 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:53.958118 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:53.958504 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:53.958118 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:53.958504 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:53.958222 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:53.958504 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:53.958125 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:53.958504 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:53.958295 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:53.958504 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:53.958348 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:55.094181 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.093913 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal" event={"ID":"a4aaeb683b3b1a7a518043c3fe0c1ee5","Type":"ContainerStarted","Data":"641b9d477158eae2c58aa2fc8e3a3e473b0dac217bf43db933cff1329c5abebe"} Jun 09 12:31:55.095460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.095435 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" event={"ID":"a7555fee-a54b-42c5-8a04-966ddf7fe315","Type":"ContainerStarted","Data":"45d69ac1780c2124fd2543098d1c28304e647e59ec08790fb4a57166507ec173"} Jun 09 12:31:55.098376 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.098324 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" event={"ID":"d7506101-7084-45c3-a578-63385c4c52b1","Type":"ContainerStarted","Data":"3909937d1ddb966dc3adff8fb5c5d76d7d9b5a37d87ee165ce2b0e7518e240e7"} Jun 09 12:31:55.098483 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.098413 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" event={"ID":"d7506101-7084-45c3-a578-63385c4c52b1","Type":"ContainerStarted","Data":"fbb8d31b2f302642f73c68cffa098e48f2dfde87c2341d21e2ba6ac5aaea03c2"} Jun 09 12:31:55.098483 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.098463 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" event={"ID":"d7506101-7084-45c3-a578-63385c4c52b1","Type":"ContainerStarted","Data":"83bf4a1fff6c1a5377d1bf50a0e31a588eaa2c47171f0746102c924a2a1429b4"} Jun 09 12:31:55.098555 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.098509 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" event={"ID":"d7506101-7084-45c3-a578-63385c4c52b1","Type":"ContainerStarted","Data":"1579685b4b0a668cc5e438e21356fe38de77a0f57ca6c3d2658c9fbaf3aabd40"} Jun 09 12:31:55.098555 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.098543 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" event={"ID":"d7506101-7084-45c3-a578-63385c4c52b1","Type":"ContainerStarted","Data":"c28ed77b17f3235d3e66a9767ce07c4ee381f68deb21b25b9b73db41d8351985"} Jun 09 12:31:55.098618 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.098569 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" event={"ID":"d7506101-7084-45c3-a578-63385c4c52b1","Type":"ContainerStarted","Data":"a1614a6ffcd315786dbdd9979d668b92fd5091c6b22f0016711cd73a23e3f6dc"} Jun 09 12:31:55.101363 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.101345 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-57qw8" event={"ID":"0be6b982-394a-4ec7-a1f8-f193b2d85261","Type":"ContainerStarted","Data":"b02006034b9531e03180fec949e379095198479466a8f6de456cb98a96fd74ce"} Jun 09 12:31:55.109593 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.109540 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-164.ec2.internal" podStartSLOduration=22.109528107 podStartE2EDuration="22.109528107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:55.10934185 +0000 UTC m=+22.623489947" watchObservedRunningTime="2026-06-09 12:31:55.109528107 +0000 UTC m=+22.623676193" Jun 09 12:31:55.141728 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.141678 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kl8b4" podStartSLOduration=2.006636746 podStartE2EDuration="22.14166362s" totalImagesPullingTime="20.135026874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:55.141531703 +0000 UTC m=+22.655679789" watchObservedRunningTime="2026-06-09 12:31:55.14166362 +0000 UTC m=+22.655811705" Jun 09 12:31:55.141871 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.141793 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-57qw8" podStartSLOduration=1.987356047 podStartE2EDuration="22.141787712s" totalImagesPullingTime="20.154431665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:55.12591586 +0000 UTC m=+22.640063947" watchObservedRunningTime="2026-06-09 12:31:55.141787712 +0000 UTC m=+22.655935797" Jun 09 12:31:55.958027 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.957790 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:55.958199 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.957901 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:55.958199 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:55.958154 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:55.958199 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:55.957912 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:55.958307 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:55.958198 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:55.958307 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:55.958274 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:56.104877 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.104839 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" event={"ID":"276b0198-b470-4ea3-85dc-07d5aeb518e7","Type":"ContainerStarted","Data":"6ecacc9a3fd40f6fb5c23f994d17f7c083cb9cfbae07c647ea07af9911046b2a"} Jun 09 12:31:56.106763 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.106399 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pwrq7" event={"ID":"354dce40-b7a5-4851-85ea-e83ab53c8507","Type":"ContainerStarted","Data":"4bb8fb8da564560c53bdf778c503745df89626b502be46579d8311120f822c43"} Jun 09 12:31:56.107962 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.107933 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjbzc" event={"ID":"defc77c1-b17f-4f7e-b81d-fe817b6423f4","Type":"ContainerStarted","Data":"0a669a25610ee242f6ee743d80f5e78154f18c7fe7d9137c095990aa01bc3e45"} Jun 09 12:31:56.111677 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.111654 2555 generic.go:356] "Generic (PLEG): container finished" podID="b56c1dcf-b085-4924-9af2-538c61c8dfff" containerID="25f1845b91417d11a10a66031b2eb32969383d7e8008011c5a6284eefdbc83b9" exitCode=0 Jun 09 12:31:56.111795 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.111738 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" event={"ID":"b56c1dcf-b085-4924-9af2-538c61c8dfff","Type":"ContainerDied","Data":"25f1845b91417d11a10a66031b2eb32969383d7e8008011c5a6284eefdbc83b9"} Jun 09 12:31:56.113681 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.113645 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5262" event={"ID":"90eff6cf-05c0-47be-a6f2-40f689890444","Type":"ContainerStarted","Data":"71b4dbaf8bd11bf2816642eddedc091ca81f7ceb2bc8d19143bef355f1f37bbc"} Jun 09 12:31:56.115287 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.115269 2555 generic.go:356] "Generic (PLEG): container finished" podID="21767ba89e30e25bc416cb63b8be6401" containerID="dc0a80359a142b97744b4af27f5f7dca6ce8ae304e160518a88edef45516bf58" exitCode=0 Jun 09 12:31:56.115365 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.115323 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" event={"ID":"21767ba89e30e25bc416cb63b8be6401","Type":"ContainerDied","Data":"dc0a80359a142b97744b4af27f5f7dca6ce8ae304e160518a88edef45516bf58"} Jun 09 12:31:56.117216 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.117195 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krdzp" event={"ID":"572ea6d9-269a-4d3a-86e8-a19b840b7724","Type":"ContainerStarted","Data":"152f867f2feefdf27e11bb3643d6d818c74902afc196376e453c08a1e6b69d2b"} Jun 09 12:31:56.122089 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.122044 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pwrq7" podStartSLOduration=3.047648374 podStartE2EDuration="23.122032839s" totalImagesPullingTime="20.074384465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:56.121651207 +0000 UTC m=+23.635799292" watchObservedRunningTime="2026-06-09 12:31:56.122032839 +0000 UTC m=+23.636180938" Jun 09 12:31:56.171281 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.171221 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bjbzc" podStartSLOduration=3.068580245 podStartE2EDuration="23.171201505s" totalImagesPullingTime="20.10262126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:56.170386936 +0000 UTC m=+23.684535023" watchObservedRunningTime="2026-06-09 12:31:56.171201505 +0000 UTC m=+23.685349591" Jun 09 12:31:56.190570 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.190521 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-krdzp" podStartSLOduration=3.078597337 podStartE2EDuration="23.190503801s" totalImagesPullingTime="20.111906464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:56.18998465 +0000 UTC m=+23.704132741" watchObservedRunningTime="2026-06-09 12:31:56.190503801 +0000 UTC m=+23.704651888" Jun 09 12:31:56.207758 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.207716 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v5262" podStartSLOduration=3.431454787 podStartE2EDuration="23.20769961s" totalImagesPullingTime="19.776244823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:56.20744003 +0000 UTC m=+23.721588115" watchObservedRunningTime="2026-06-09 12:31:56.20769961 +0000 UTC m=+23.721847760" Jun 09 12:31:56.520100 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.520069 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:56.592821 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.592794 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 12:31:56.956368 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.956220 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T12:31:56.59281437Z","UUID":"f84d38d8-664e-4cd5-9bc9-ccec61dfdeab","Handler":null,"Name":"","Endpoint":""} Jun 09 12:31:56.957913 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.957893 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 12:31:56.958028 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:56.957934 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 12:31:57.121283 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:57.121249 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" event={"ID":"276b0198-b470-4ea3-85dc-07d5aeb518e7","Type":"ContainerStarted","Data":"c2d7525c10428530a69ea76c2a9b16e6881307c10a28deab3794dd7c2daeac5a"} Jun 09 12:31:57.124137 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:57.124111 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" event={"ID":"21767ba89e30e25bc416cb63b8be6401","Type":"ContainerStarted","Data":"7c69e6aac1b449df4e9855d6236e1b835abd339b790eac0d4c8e68c4edaaf40c"} Jun 09 12:31:57.143304 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:57.143252 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-164.ec2.internal" podStartSLOduration=24.143237331999998 podStartE2EDuration="24.143237332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:57.142460524 +0000 UTC m=+24.656608612" watchObservedRunningTime="2026-06-09 12:31:57.143237332 +0000 UTC m=+24.657385418" Jun 09 12:31:57.957579 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:57.957378 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:57.957729 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:57.957444 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:57.957729 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:57.957616 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:57.957729 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:57.957444 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:57.957729 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:57.957693 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:31:57.957855 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:57.957767 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:58.128464 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:58.128434 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" event={"ID":"d7506101-7084-45c3-a578-63385c4c52b1","Type":"ContainerStarted","Data":"b6703bdab5700869d1006b6902c57a75b93c91bf3ace7aae13b1a1680842848b"} Jun 09 12:31:58.130474 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:58.130449 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" event={"ID":"276b0198-b470-4ea3-85dc-07d5aeb518e7","Type":"ContainerStarted","Data":"00397e73b12fae1a900cd485439c9b06df97a8f09404b2c40373411116b14d13"} Jun 09 12:31:58.149172 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:58.149116 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vf56k" podStartSLOduration=2.792375526 podStartE2EDuration="25.149093942s" totalImagesPullingTime="22.356718416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:58.147173774 +0000 UTC m=+25.661321892" watchObservedRunningTime="2026-06-09 12:31:58.149093942 +0000 UTC m=+25.663242029" Jun 09 12:31:58.922098 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:58.922048 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:58.922764 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:58.922740 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:59.133549 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:59.133523 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-krdzp" Jun 09 12:31:59.957414 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:59.957390 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:31:59.957414 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:59.957401 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:31:59.957620 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:31:59.957390 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:31:59.957620 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:59.957487 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:31:59.957620 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:59.957572 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:31:59.957707 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:31:59.957657 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:32:00.138750 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:00.138711 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" event={"ID":"d7506101-7084-45c3-a578-63385c4c52b1","Type":"ContainerStarted","Data":"f7e77c077f2e26a010a5cf77b92b281a0eae660cccdbd6169454c3652b9aea35"} Jun 09 12:32:00.139283 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:00.139040 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:32:00.156326 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:00.156301 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:32:00.165942 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:00.165760 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" podStartSLOduration=6.945161218 podStartE2EDuration="27.165748383s" totalImagesPullingTime="20.220587165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:00.164447374 +0000 UTC m=+27.678595453" watchObservedRunningTime="2026-06-09 12:32:00.165748383 +0000 UTC m=+27.679896468" Jun 09 12:32:01.142248 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:01.142215 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:32:01.142642 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:01.142301 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:32:01.158697 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:01.158673 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:32:01.625748 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:01.625716 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t5nkh"] Jun 09 12:32:01.625910 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:01.625856 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:32:01.625987 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:01.625966 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:32:01.629445 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:01.629416 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qxl9t"] Jun 09 12:32:01.629560 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:01.629475 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7sknt"] Jun 09 12:32:01.629619 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:01.629561 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:32:01.629798 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:01.629663 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:32:01.629798 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:01.629735 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:32:01.629946 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:01.629804 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:32:02.958874 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:02.958839 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:32:02.959461 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:02.958942 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:32:02.959461 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:02.958980 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:32:02.959461 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:02.958983 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:32:02.959461 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:02.959075 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:32:02.959461 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:02.959140 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:32:04.150073 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:04.150035 2555 generic.go:356] "Generic (PLEG): container finished" podID="b56c1dcf-b085-4924-9af2-538c61c8dfff" containerID="0993f76510978f303a64c0efb2a86d18dde0b18ef0036138477982e5a1de22cb" exitCode=0 Jun 09 12:32:04.150073 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:04.150082 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" event={"ID":"b56c1dcf-b085-4924-9af2-538c61c8dfff","Type":"ContainerDied","Data":"0993f76510978f303a64c0efb2a86d18dde0b18ef0036138477982e5a1de22cb"} Jun 09 12:32:04.958591 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:04.958342 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:32:04.958758 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:04.958343 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:32:04.958758 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:04.958697 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:32:04.958758 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:04.958375 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:32:04.958927 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:04.958798 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:32:04.958927 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:04.958888 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:32:05.639799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:05.639770 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:32:05.640232 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:05.639809 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:32:05.640232 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:05.639926 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:32:05.640232 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:05.639940 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:32:05.640232 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:05.639983 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret podName:79e89228-0242-4e97-98a2-5432c7b7e319 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:37.639969785 +0000 UTC m=+65.154117848 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret") pod "global-pull-secret-syncer-qxl9t" (UID: "79e89228-0242-4e97-98a2-5432c7b7e319") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:32:05.640232 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:05.640042 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs podName:f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:37.639990915 +0000 UTC m=+65.154138999 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs") pod "network-metrics-daemon-7sknt" (UID: "f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:32:05.740608 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:05.740529 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqzs\" (UniqueName: \"kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs\") pod \"network-check-target-t5nkh\" (UID: \"28a999b4-6592-4ae4-8ea9-a0e774756e1a\") " pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:32:05.740757 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:05.740700 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:32:05.740757 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:05.740726 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:32:05.740757 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:05.740738 2555 projected.go:196] Error preparing data for projected volume kube-api-access-gwqzs for pod openshift-network-diagnostics/network-check-target-t5nkh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:32:05.740854 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:05.740788 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs podName:28a999b4-6592-4ae4-8ea9-a0e774756e1a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:37.740775364 +0000 UTC m=+65.254923441 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwqzs" (UniqueName: "kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs") pod "network-check-target-t5nkh" (UID: "28a999b4-6592-4ae4-8ea9-a0e774756e1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:32:06.156071 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:06.156038 2555 generic.go:356] "Generic (PLEG): container finished" podID="b56c1dcf-b085-4924-9af2-538c61c8dfff" containerID="9711de621dbdb2de5114df60179246724c412563e931fabc5b87cee36b7b28b8" exitCode=0 Jun 09 12:32:06.156222 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:06.156080 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" event={"ID":"b56c1dcf-b085-4924-9af2-538c61c8dfff","Type":"ContainerDied","Data":"9711de621dbdb2de5114df60179246724c412563e931fabc5b87cee36b7b28b8"} Jun 09 12:32:06.957940 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:06.957904 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:32:06.957940 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:06.957929 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:32:06.958379 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:06.957905 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:32:06.958379 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:06.958036 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5nkh" podUID="28a999b4-6592-4ae4-8ea9-a0e774756e1a" Jun 09 12:32:06.958379 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:06.958105 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:32:06.958379 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:06.958170 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxl9t" podUID="79e89228-0242-4e97-98a2-5432c7b7e319" Jun 09 12:32:07.263513 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.263490 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-164.ec2.internal" event="NodeReady" Jun 09 12:32:07.263624 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.263613 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 12:32:07.299398 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.299360 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c5c7c7f74-5kbxc"] Jun 09 12:32:07.321306 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.320425 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pgcb7"] Jun 09 12:32:07.321451 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.321313 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.325025 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.324986 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 12:32:07.325502 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.325479 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 12:32:07.325660 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.325031 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 12:32:07.325775 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.325085 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n2brk\"" Jun 09 12:32:07.331742 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.331720 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 12:32:07.338435 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.338408 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lhhw2"] Jun 09 12:32:07.338582 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.338549 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.341142 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.341119 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 12:32:07.341237 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.341203 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b8l29\"" Jun 09 12:32:07.341237 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.341210 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 12:32:07.354382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.354362 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5c7c7f74-5kbxc"] Jun 09 12:32:07.354460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.354391 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pgcb7"] Jun 09 12:32:07.354460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.354412 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lhhw2"] Jun 09 12:32:07.354518 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.354460 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lhhw2" Jun 09 12:32:07.356809 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.356792 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 12:32:07.356924 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.356909 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ksb5z\"" Jun 09 12:32:07.356982 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.356937 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 12:32:07.356982 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.356963 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 12:32:07.452775 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.452745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58e7cc69-6586-4fe2-8051-01ff87f28b2b-config-volume\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.452876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.452797 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.452876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.452833 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-installation-pull-secrets\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.452876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.452857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-bound-sa-token\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.452876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.452875 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h86f7\" (UniqueName: \"kubernetes.io/projected/58e7cc69-6586-4fe2-8051-01ff87f28b2b-kube-api-access-h86f7\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.453058 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.452897 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-registry-certificates\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.453058 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.452926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.453058 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.452942 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-image-registry-private-configuration\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.453058 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.452958 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217-cert\") pod \"ingress-canary-lhhw2\" (UID: \"2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217\") " pod="openshift-ingress-canary/ingress-canary-lhhw2" Jun 09 12:32:07.453186 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.453065 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-trusted-ca\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.453186 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.453100 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e7cc69-6586-4fe2-8051-01ff87f28b2b-tmp-dir\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.453186 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.453121 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlrnk\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-kube-api-access-mlrnk\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.453186 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.453158 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1717328b-1111-46ff-937a-5cff6b493665-ca-trust-extracted\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.453325 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.453233 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg6gx\" (UniqueName: \"kubernetes.io/projected/2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217-kube-api-access-bg6gx\") pod \"ingress-canary-lhhw2\" (UID: \"2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217\") " pod="openshift-ingress-canary/ingress-canary-lhhw2" Jun 09 12:32:07.553976 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.553889 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.553976 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.553925 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-installation-pull-secrets\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.553976 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.553945 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-bound-sa-token\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.553976 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.553970 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h86f7\" (UniqueName: \"kubernetes.io/projected/58e7cc69-6586-4fe2-8051-01ff87f28b2b-kube-api-access-h86f7\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.553993 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-registry-certificates\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554043 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554078 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-image-registry-private-configuration\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:07.554081 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554101 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217-cert\") pod \"ingress-canary-lhhw2\" (UID: \"2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217\") " pod="openshift-ingress-canary/ingress-canary-lhhw2" Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-trusted-ca\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:07.554105 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5c7c7f74-5kbxc: secret "image-registry-tls" not found Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554181 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e7cc69-6586-4fe2-8051-01ff87f28b2b-tmp-dir\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554238 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlrnk\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-kube-api-access-mlrnk\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:07.554257 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls podName:1717328b-1111-46ff-937a-5cff6b493665 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:08.054236989 +0000 UTC m=+35.568385069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls") pod "image-registry-6c5c7c7f74-5kbxc" (UID: "1717328b-1111-46ff-937a-5cff6b493665") : secret "image-registry-tls" not found Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554296 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1717328b-1111-46ff-937a-5cff6b493665-ca-trust-extracted\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.554336 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554332 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg6gx\" (UniqueName: \"kubernetes.io/projected/2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217-kube-api-access-bg6gx\") pod \"ingress-canary-lhhw2\" (UID: \"2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217\") " pod="openshift-ingress-canary/ingress-canary-lhhw2" Jun 09 12:32:07.554975 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554397 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58e7cc69-6586-4fe2-8051-01ff87f28b2b-config-volume\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.554975 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:07.554154 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:07.554975 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:07.554475 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls podName:58e7cc69-6586-4fe2-8051-01ff87f28b2b nodeName:}" failed. No retries permitted until 2026-06-09 12:32:08.054455335 +0000 UTC m=+35.568603400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls") pod "dns-default-pgcb7" (UID: "58e7cc69-6586-4fe2-8051-01ff87f28b2b") : secret "dns-default-metrics-tls" not found Jun 09 12:32:07.554975 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-registry-certificates\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.554975 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554916 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1717328b-1111-46ff-937a-5cff6b493665-ca-trust-extracted\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.554975 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58e7cc69-6586-4fe2-8051-01ff87f28b2b-config-volume\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.554975 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.554950 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e7cc69-6586-4fe2-8051-01ff87f28b2b-tmp-dir\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.555396 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.555183 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-trusted-ca\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.558458 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.558432 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-image-registry-private-configuration\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.558556 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.558439 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-installation-pull-secrets\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.558556 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.558514 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217-cert\") pod \"ingress-canary-lhhw2\" (UID: \"2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217\") " pod="openshift-ingress-canary/ingress-canary-lhhw2" Jun 09 12:32:07.563029 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.562977 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h86f7\" (UniqueName: \"kubernetes.io/projected/58e7cc69-6586-4fe2-8051-01ff87f28b2b-kube-api-access-h86f7\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:07.563156 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.563137 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlrnk\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-kube-api-access-mlrnk\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.563204 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.563170 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg6gx\" (UniqueName: \"kubernetes.io/projected/2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217-kube-api-access-bg6gx\") pod \"ingress-canary-lhhw2\" (UID: \"2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217\") " pod="openshift-ingress-canary/ingress-canary-lhhw2" Jun 09 12:32:07.563353 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.563336 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-bound-sa-token\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:07.672341 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.672299 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lhhw2" Jun 09 12:32:07.868339 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:07.868290 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lhhw2"] Jun 09 12:32:07.873088 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:32:07.873061 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb1ee7f_a2c0_4047_a06c_7a5bdfe59217.slice/crio-89209a814a5277c115e73fb711c0e96df35a385a50df22fdf5cac2dba6f260eb WatchSource:0}: Error finding container 89209a814a5277c115e73fb711c0e96df35a385a50df22fdf5cac2dba6f260eb: Status 404 returned error can't find the container with id 89209a814a5277c115e73fb711c0e96df35a385a50df22fdf5cac2dba6f260eb Jun 09 12:32:08.058117 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.058076 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:08.058495 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.058129 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:08.058495 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:08.058221 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:32:08.058495 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:08.058239 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5c7c7f74-5kbxc: secret "image-registry-tls" not found Jun 09 12:32:08.058495 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:08.058275 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:08.058495 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:08.058293 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls podName:1717328b-1111-46ff-937a-5cff6b493665 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:09.058277389 +0000 UTC m=+36.572425457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls") pod "image-registry-6c5c7c7f74-5kbxc" (UID: "1717328b-1111-46ff-937a-5cff6b493665") : secret "image-registry-tls" not found Jun 09 12:32:08.058495 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:08.058325 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls podName:58e7cc69-6586-4fe2-8051-01ff87f28b2b nodeName:}" failed. No retries permitted until 2026-06-09 12:32:09.058309395 +0000 UTC m=+36.572457466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls") pod "dns-default-pgcb7" (UID: "58e7cc69-6586-4fe2-8051-01ff87f28b2b") : secret "dns-default-metrics-tls" not found Jun 09 12:32:08.162597 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.162562 2555 generic.go:356] "Generic (PLEG): container finished" podID="b56c1dcf-b085-4924-9af2-538c61c8dfff" containerID="a6eeca3478127f01a46672c3408e2b5787cdae261bf73a28f68b2bf4eed0c543" exitCode=0 Jun 09 12:32:08.162798 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.162643 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" event={"ID":"b56c1dcf-b085-4924-9af2-538c61c8dfff","Type":"ContainerDied","Data":"a6eeca3478127f01a46672c3408e2b5787cdae261bf73a28f68b2bf4eed0c543"} Jun 09 12:32:08.163827 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.163805 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lhhw2" event={"ID":"2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217","Type":"ContainerStarted","Data":"89209a814a5277c115e73fb711c0e96df35a385a50df22fdf5cac2dba6f260eb"} Jun 09 12:32:08.958677 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.958475 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:32:08.959125 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.959108 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:32:08.959592 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.959577 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:32:08.961875 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.961693 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 12:32:08.962441 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.962251 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 12:32:08.963094 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.962913 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 12:32:08.963763 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.963739 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4k8hn\"" Jun 09 12:32:08.963763 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.963754 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4297v\"" Jun 09 12:32:08.963987 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:08.963974 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 12:32:09.064867 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:09.064833 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:09.065431 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:09.064880 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:09.065431 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:09.064989 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:09.065431 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:09.064995 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:32:09.065431 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:09.065034 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5c7c7f74-5kbxc: secret "image-registry-tls" not found Jun 09 12:32:09.065431 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:09.065076 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls podName:58e7cc69-6586-4fe2-8051-01ff87f28b2b nodeName:}" failed. No retries permitted until 2026-06-09 12:32:11.065057112 +0000 UTC m=+38.579205175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls") pod "dns-default-pgcb7" (UID: "58e7cc69-6586-4fe2-8051-01ff87f28b2b") : secret "dns-default-metrics-tls" not found Jun 09 12:32:09.065431 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:09.065134 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls podName:1717328b-1111-46ff-937a-5cff6b493665 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:11.065109235 +0000 UTC m=+38.579257306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls") pod "image-registry-6c5c7c7f74-5kbxc" (UID: "1717328b-1111-46ff-937a-5cff6b493665") : secret "image-registry-tls" not found Jun 09 12:32:11.081093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:11.081057 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:11.081843 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:11.081105 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:11.081843 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:11.081219 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:32:11.081843 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:11.081232 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:11.081843 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:11.081243 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5c7c7f74-5kbxc: secret "image-registry-tls" not found Jun 09 12:32:11.081843 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:11.081294 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls podName:58e7cc69-6586-4fe2-8051-01ff87f28b2b nodeName:}" failed. No retries permitted until 2026-06-09 12:32:15.081278879 +0000 UTC m=+42.595426958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls") pod "dns-default-pgcb7" (UID: "58e7cc69-6586-4fe2-8051-01ff87f28b2b") : secret "dns-default-metrics-tls" not found Jun 09 12:32:11.081843 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:11.081309 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls podName:1717328b-1111-46ff-937a-5cff6b493665 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:15.081303425 +0000 UTC m=+42.595451489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls") pod "image-registry-6c5c7c7f74-5kbxc" (UID: "1717328b-1111-46ff-937a-5cff6b493665") : secret "image-registry-tls" not found Jun 09 12:32:11.173283 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:11.173215 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lhhw2" event={"ID":"2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217","Type":"ContainerStarted","Data":"a32597dbfda41b7dd88cd73dd1961370a98223ab3d021d0fbb9f3a174aff56fc"} Jun 09 12:32:11.190112 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:11.190054 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lhhw2" podStartSLOduration=1.4711086 podStartE2EDuration="4.190036363s" totalImagesPullingTime="2.718927763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:11.189924109 +0000 UTC m=+38.704072207" watchObservedRunningTime="2026-06-09 12:32:11.190036363 +0000 UTC m=+38.704184445" Jun 09 12:32:13.181145 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:13.180923 2555 generic.go:356] "Generic (PLEG): container finished" podID="b56c1dcf-b085-4924-9af2-538c61c8dfff" containerID="a4e724f1a8d7c0f124c4839cc2e55aa7fbce9adef576b090ced269173644edcc" exitCode=0 Jun 09 12:32:13.181416 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:13.181136 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" event={"ID":"b56c1dcf-b085-4924-9af2-538c61c8dfff","Type":"ContainerDied","Data":"a4e724f1a8d7c0f124c4839cc2e55aa7fbce9adef576b090ced269173644edcc"} Jun 09 12:32:14.186508 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:14.186480 2555 generic.go:356] "Generic (PLEG): container finished" podID="b56c1dcf-b085-4924-9af2-538c61c8dfff" containerID="007384af7376152b44a34e73ee0614178a104ed579b1f103225cf05ebb8b4fc9" exitCode=0 Jun 09 12:32:14.186874 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:14.186529 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" event={"ID":"b56c1dcf-b085-4924-9af2-538c61c8dfff","Type":"ContainerDied","Data":"007384af7376152b44a34e73ee0614178a104ed579b1f103225cf05ebb8b4fc9"} Jun 09 12:32:15.123744 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:15.123703 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:15.123744 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:15.123752 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:15.124046 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:15.123853 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:15.124046 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:15.123858 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:32:15.124046 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:15.123879 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5c7c7f74-5kbxc: secret "image-registry-tls" not found Jun 09 12:32:15.124046 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:15.123920 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls podName:58e7cc69-6586-4fe2-8051-01ff87f28b2b nodeName:}" failed. No retries permitted until 2026-06-09 12:32:23.123902258 +0000 UTC m=+50.638050342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls") pod "dns-default-pgcb7" (UID: "58e7cc69-6586-4fe2-8051-01ff87f28b2b") : secret "dns-default-metrics-tls" not found Jun 09 12:32:15.124046 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:15.123936 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls podName:1717328b-1111-46ff-937a-5cff6b493665 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:23.12392827 +0000 UTC m=+50.638076338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls") pod "image-registry-6c5c7c7f74-5kbxc" (UID: "1717328b-1111-46ff-937a-5cff6b493665") : secret "image-registry-tls" not found Jun 09 12:32:15.194548 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:15.194517 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" event={"ID":"b56c1dcf-b085-4924-9af2-538c61c8dfff","Type":"ContainerStarted","Data":"b9f4a9d01716236d1ad1d44252f1038195c7a5a6566706b3743f2539df895c3a"} Jun 09 12:32:15.219856 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:15.219809 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qhtgk" podStartSLOduration=8.168277684 podStartE2EDuration="42.219795802s" totalImagesPullingTime="34.051518118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:15.217865893 +0000 UTC m=+42.732013979" watchObservedRunningTime="2026-06-09 12:32:15.219795802 +0000 UTC m=+42.733943888" Jun 09 12:32:23.182922 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:23.182884 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:23.183362 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:23.182930 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:23.183362 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:23.183049 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:32:23.183362 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:23.183067 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5c7c7f74-5kbxc: secret "image-registry-tls" not found Jun 09 12:32:23.183362 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:23.183072 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:23.183362 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:23.183116 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls podName:58e7cc69-6586-4fe2-8051-01ff87f28b2b nodeName:}" failed. No retries permitted until 2026-06-09 12:32:39.183103442 +0000 UTC m=+66.697251507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls") pod "dns-default-pgcb7" (UID: "58e7cc69-6586-4fe2-8051-01ff87f28b2b") : secret "dns-default-metrics-tls" not found Jun 09 12:32:23.183362 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:23.183133 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls podName:1717328b-1111-46ff-937a-5cff6b493665 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:39.183124007 +0000 UTC m=+66.697272090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls") pod "image-registry-6c5c7c7f74-5kbxc" (UID: "1717328b-1111-46ff-937a-5cff6b493665") : secret "image-registry-tls" not found Jun 09 12:32:33.156565 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:33.156531 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrzdh" Jun 09 12:32:37.687145 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.687095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:32:37.687145 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.687150 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:32:37.689902 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.689875 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 12:32:37.689989 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.689941 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 12:32:37.698193 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:37.698172 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 12:32:37.698268 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:37.698230 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs podName:f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4 nodeName:}" failed. No retries permitted until 2026-06-09 12:33:41.698213406 +0000 UTC m=+129.212361471 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs") pod "network-metrics-daemon-7sknt" (UID: "f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4") : secret "metrics-daemon-secret" not found Jun 09 12:32:37.701140 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.701126 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e89228-0242-4e97-98a2-5432c7b7e319-original-pull-secret\") pod \"global-pull-secret-syncer-qxl9t\" (UID: \"79e89228-0242-4e97-98a2-5432c7b7e319\") " pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:32:37.772790 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.772766 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxl9t" Jun 09 12:32:37.788089 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.788064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqzs\" (UniqueName: \"kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs\") pod \"network-check-target-t5nkh\" (UID: \"28a999b4-6592-4ae4-8ea9-a0e774756e1a\") " pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:32:37.790994 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.790967 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 12:32:37.802174 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.802155 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 12:32:37.812371 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.812348 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwqzs\" (UniqueName: \"kubernetes.io/projected/28a999b4-6592-4ae4-8ea9-a0e774756e1a-kube-api-access-gwqzs\") pod \"network-check-target-t5nkh\" (UID: \"28a999b4-6592-4ae4-8ea9-a0e774756e1a\") " pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:32:37.891523 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:37.891491 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qxl9t"] Jun 09 12:32:37.894236 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:32:37.894208 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e89228_0242_4e97_98a2_5432c7b7e319.slice/crio-38aaa03015dd86c5d02b99ac0d83892d78b59634a44670db16b297bb8c53c056 WatchSource:0}: Error finding container 38aaa03015dd86c5d02b99ac0d83892d78b59634a44670db16b297bb8c53c056: Status 404 returned error can't find the container with id 38aaa03015dd86c5d02b99ac0d83892d78b59634a44670db16b297bb8c53c056 Jun 09 12:32:38.088051 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:38.088022 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4297v\"" Jun 09 12:32:38.096263 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:38.096243 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:32:38.214384 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:38.214357 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t5nkh"] Jun 09 12:32:38.216865 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:32:38.216839 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a999b4_6592_4ae4_8ea9_a0e774756e1a.slice/crio-4f567a751b0fa06a55e1579ccd815de4a7376d3407e2ec696b74a42fefcc38e8 WatchSource:0}: Error finding container 4f567a751b0fa06a55e1579ccd815de4a7376d3407e2ec696b74a42fefcc38e8: Status 404 returned error can't find the container with id 4f567a751b0fa06a55e1579ccd815de4a7376d3407e2ec696b74a42fefcc38e8 Jun 09 12:32:38.248154 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:38.248123 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t5nkh" event={"ID":"28a999b4-6592-4ae4-8ea9-a0e774756e1a","Type":"ContainerStarted","Data":"4f567a751b0fa06a55e1579ccd815de4a7376d3407e2ec696b74a42fefcc38e8"} Jun 09 12:32:38.249155 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:38.249135 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qxl9t" event={"ID":"79e89228-0242-4e97-98a2-5432c7b7e319","Type":"ContainerStarted","Data":"38aaa03015dd86c5d02b99ac0d83892d78b59634a44670db16b297bb8c53c056"} Jun 09 12:32:39.198043 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:39.197986 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:32:39.198498 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:39.198116 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:32:39.198498 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:39.198174 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:39.198498 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:39.198232 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:32:39.198498 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:39.198244 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5c7c7f74-5kbxc: secret "image-registry-tls" not found Jun 09 12:32:39.198498 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:39.198253 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls podName:58e7cc69-6586-4fe2-8051-01ff87f28b2b nodeName:}" failed. No retries permitted until 2026-06-09 12:33:11.19823374 +0000 UTC m=+98.712381805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls") pod "dns-default-pgcb7" (UID: "58e7cc69-6586-4fe2-8051-01ff87f28b2b") : secret "dns-default-metrics-tls" not found Jun 09 12:32:39.198498 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:32:39.198282 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls podName:1717328b-1111-46ff-937a-5cff6b493665 nodeName:}" failed. No retries permitted until 2026-06-09 12:33:11.198271121 +0000 UTC m=+98.712419187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls") pod "image-registry-6c5c7c7f74-5kbxc" (UID: "1717328b-1111-46ff-937a-5cff6b493665") : secret "image-registry-tls" not found Jun 09 12:32:43.264863 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:43.264825 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t5nkh" event={"ID":"28a999b4-6592-4ae4-8ea9-a0e774756e1a","Type":"ContainerStarted","Data":"68d202e28a0a5a4bf31edce440051155f36dc8a8a728e567b04e32ec5b218b33"} Jun 09 12:32:43.265321 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:43.264903 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:32:43.266361 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:43.266332 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qxl9t" event={"ID":"79e89228-0242-4e97-98a2-5432c7b7e319","Type":"ContainerStarted","Data":"ddf5b35364743fc0b4da0dd53fd814a942ffec4386b97d2b1a47846c1f8cfe8b"} Jun 09 12:32:43.282436 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:43.282393 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t5nkh" podStartSLOduration=65.767563321 podStartE2EDuration="1m10.282378014s" totalImagesPullingTime="4.514814693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:43.281650461 +0000 UTC m=+70.795798546" watchObservedRunningTime="2026-06-09 12:32:43.282378014 +0000 UTC m=+70.796526100" Jun 09 12:32:43.297315 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:32:43.297278 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qxl9t" podStartSLOduration=65.455377522 podStartE2EDuration="1m10.297265848s" totalImagesPullingTime="4.841888326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:43.296949487 +0000 UTC m=+70.811097572" watchObservedRunningTime="2026-06-09 12:32:43.297265848 +0000 UTC m=+70.811413934" Jun 09 12:33:11.216737 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:33:11.216696 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:33:11.216737 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:33:11.216741 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:33:11.217220 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:33:11.216831 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:33:11.217220 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:33:11.216841 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:33:11.217220 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:33:11.216860 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5c7c7f74-5kbxc: secret "image-registry-tls" not found Jun 09 12:33:11.217220 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:33:11.216891 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls podName:58e7cc69-6586-4fe2-8051-01ff87f28b2b nodeName:}" failed. No retries permitted until 2026-06-09 12:34:15.216877685 +0000 UTC m=+162.731025749 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls") pod "dns-default-pgcb7" (UID: "58e7cc69-6586-4fe2-8051-01ff87f28b2b") : secret "dns-default-metrics-tls" not found Jun 09 12:33:11.217220 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:33:11.216913 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls podName:1717328b-1111-46ff-937a-5cff6b493665 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:15.216897383 +0000 UTC m=+162.731045448 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls") pod "image-registry-6c5c7c7f74-5kbxc" (UID: "1717328b-1111-46ff-937a-5cff6b493665") : secret "image-registry-tls" not found Jun 09 12:33:14.270828 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:33:14.270792 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t5nkh" Jun 09 12:33:41.713994 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:33:41.713941 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:33:41.714518 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:33:41.714125 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 12:33:41.714518 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:33:41.714215 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs podName:f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:43.714198159 +0000 UTC m=+251.228346223 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs") pod "network-metrics-daemon-7sknt" (UID: "f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4") : secret "metrics-daemon-secret" not found Jun 09 12:34:10.338995 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:10.338943 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" podUID="1717328b-1111-46ff-937a-5cff6b493665" Jun 09 12:34:10.349767 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:10.349732 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pgcb7" podUID="58e7cc69-6586-4fe2-8051-01ff87f28b2b" Jun 09 12:34:10.466017 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:10.465981 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgcb7" Jun 09 12:34:10.466177 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:10.466032 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:34:11.979578 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:11.979531 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7sknt" podUID="f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4" Jun 09 12:34:15.251846 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:15.251803 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:34:15.251846 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:15.251853 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:34:15.252418 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:15.251967 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:34:15.252418 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:15.251970 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:34:15.252418 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:15.251993 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5c7c7f74-5kbxc: secret "image-registry-tls" not found Jun 09 12:34:15.252418 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:15.252072 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls podName:58e7cc69-6586-4fe2-8051-01ff87f28b2b nodeName:}" failed. No retries permitted until 2026-06-09 12:36:17.252051772 +0000 UTC m=+284.766199850 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls") pod "dns-default-pgcb7" (UID: "58e7cc69-6586-4fe2-8051-01ff87f28b2b") : secret "dns-default-metrics-tls" not found Jun 09 12:34:15.252418 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:15.252091 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls podName:1717328b-1111-46ff-937a-5cff6b493665 nodeName:}" failed. No retries permitted until 2026-06-09 12:36:17.252083149 +0000 UTC m=+284.766231213 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls") pod "image-registry-6c5c7c7f74-5kbxc" (UID: "1717328b-1111-46ff-937a-5cff6b493665") : secret "image-registry-tls" not found Jun 09 12:34:26.957956 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:26.957864 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:34:57.265222 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.265191 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t"] Jun 09 12:34:57.267264 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.267231 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-fnvcd"] Jun 09 12:34:57.267405 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.267383 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.269359 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.269339 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5"] Jun 09 12:34:57.269472 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.269449 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.271168 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.271149 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:57.273015 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.272982 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 12:34:57.274523 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.274497 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 12:34:57.274619 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.274548 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:34:57.274727 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.274712 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 12:34:57.274989 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.274972 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mgnpr\"" Jun 09 12:34:57.275100 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.274994 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 12:34:57.275100 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.275040 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 12:34:57.275199 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.275104 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 12:34:57.275350 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.275336 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 12:34:57.276387 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.276369 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 12:34:57.276535 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.276393 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 12:34:57.276535 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.276414 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j989r\"" Jun 09 12:34:57.276693 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.276438 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 12:34:57.276795 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.276776 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9nvr7\"" Jun 09 12:34:57.276877 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.276860 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 12:34:57.279641 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.279622 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 12:34:57.297546 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.297525 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t"] Jun 09 12:34:57.298260 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.298243 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5"] Jun 09 12:34:57.298932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.298909 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-fnvcd"] Jun 09 12:34:57.328060 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328034 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-trusted-ca-bundle\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.328170 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328085 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-snapshots\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.328170 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328113 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a64ba593-a393-4481-8b7d-71adabdea606-config\") pod \"service-ca-operator-6bc5ff68f5-sr44t\" (UID: \"a64ba593-a393-4481-8b7d-71adabdea606\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.328170 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-serving-cert\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.328170 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:57.328170 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328163 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvz98\" (UniqueName: \"kubernetes.io/projected/a64ba593-a393-4481-8b7d-71adabdea606-kube-api-access-vvz98\") pod \"service-ca-operator-6bc5ff68f5-sr44t\" (UID: \"a64ba593-a393-4481-8b7d-71adabdea606\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.328324 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328180 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-tmp\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.328324 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328195 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh2mg\" (UniqueName: \"kubernetes.io/projected/13b42da2-bc96-4e3e-a072-29f0119aed46-kube-api-access-mh2mg\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:57.328324 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328248 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a64ba593-a393-4481-8b7d-71adabdea606-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-sr44t\" (UID: \"a64ba593-a393-4481-8b7d-71adabdea606\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.328324 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328279 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13b42da2-bc96-4e3e-a072-29f0119aed46-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:57.328324 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328304 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-service-ca-bundle\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.328468 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.328327 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5wwd\" (UniqueName: \"kubernetes.io/projected/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-kube-api-access-k5wwd\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.360469 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.360443 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v"] Jun 09 12:34:57.362447 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.362432 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.366338 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.366311 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 12:34:57.366516 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.366431 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5l8dk\"" Jun 09 12:34:57.366604 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.366577 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 12:34:57.366604 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.366595 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:34:57.366717 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.366679 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 12:34:57.392340 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.392311 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v"] Jun 09 12:34:57.428727 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.428701 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13b42da2-bc96-4e3e-a072-29f0119aed46-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:57.428823 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.428735 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-service-ca-bundle\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.428823 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.428758 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5wwd\" (UniqueName: \"kubernetes.io/projected/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-kube-api-access-k5wwd\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.428823 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.428809 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d57d8daf-9039-45b2-a295-18a24463c3bd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jdc5v\" (UID: \"d57d8daf-9039-45b2-a295-18a24463c3bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.428950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.428836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a64ba593-a393-4481-8b7d-71adabdea606-config\") pod \"service-ca-operator-6bc5ff68f5-sr44t\" (UID: \"a64ba593-a393-4481-8b7d-71adabdea606\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.428950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.428861 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-tmp\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.428950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.428884 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trrrn\" (UniqueName: \"kubernetes.io/projected/d57d8daf-9039-45b2-a295-18a24463c3bd-kube-api-access-trrrn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jdc5v\" (UID: \"d57d8daf-9039-45b2-a295-18a24463c3bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.428950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.428943 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d57d8daf-9039-45b2-a295-18a24463c3bd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jdc5v\" (UID: \"d57d8daf-9039-45b2-a295-18a24463c3bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.429169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.428973 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a64ba593-a393-4481-8b7d-71adabdea606-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-sr44t\" (UID: \"a64ba593-a393-4481-8b7d-71adabdea606\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.429169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429025 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:57.429169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429075 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-snapshots\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.429169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429112 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-trusted-ca-bundle\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.429169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429136 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-serving-cert\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.429169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvz98\" (UniqueName: \"kubernetes.io/projected/a64ba593-a393-4481-8b7d-71adabdea606-kube-api-access-vvz98\") pod \"service-ca-operator-6bc5ff68f5-sr44t\" (UID: \"a64ba593-a393-4481-8b7d-71adabdea606\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.429465 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:57.429178 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:34:57.429465 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429188 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh2mg\" (UniqueName: \"kubernetes.io/projected/13b42da2-bc96-4e3e-a072-29f0119aed46-kube-api-access-mh2mg\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:57.429465 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429239 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-tmp\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.429465 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:57.429249 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls podName:13b42da2-bc96-4e3e-a072-29f0119aed46 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:57.929229504 +0000 UTC m=+205.443377568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rjkw5" (UID: "13b42da2-bc96-4e3e-a072-29f0119aed46") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:34:57.429465 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429420 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-service-ca-bundle\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.429704 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429528 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a64ba593-a393-4481-8b7d-71adabdea606-config\") pod \"service-ca-operator-6bc5ff68f5-sr44t\" (UID: \"a64ba593-a393-4481-8b7d-71adabdea606\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.429704 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429587 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13b42da2-bc96-4e3e-a072-29f0119aed46-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:57.430102 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429897 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-snapshots\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.430102 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.429942 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-trusted-ca-bundle\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.431484 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.431463 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a64ba593-a393-4481-8b7d-71adabdea606-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-sr44t\" (UID: \"a64ba593-a393-4481-8b7d-71adabdea606\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.431609 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.431595 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-serving-cert\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.446305 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.446277 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5wwd\" (UniqueName: \"kubernetes.io/projected/6fbd7ff6-c8e4-4284-9534-83bb1c63c731-kube-api-access-k5wwd\") pod \"insights-operator-896549976-fnvcd\" (UID: \"6fbd7ff6-c8e4-4284-9534-83bb1c63c731\") " pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.446484 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.446465 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvz98\" (UniqueName: \"kubernetes.io/projected/a64ba593-a393-4481-8b7d-71adabdea606-kube-api-access-vvz98\") pod \"service-ca-operator-6bc5ff68f5-sr44t\" (UID: \"a64ba593-a393-4481-8b7d-71adabdea606\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.450372 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.450355 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh2mg\" (UniqueName: \"kubernetes.io/projected/13b42da2-bc96-4e3e-a072-29f0119aed46-kube-api-access-mh2mg\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:57.456911 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.456891 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8"] Jun 09 12:34:57.459460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.459443 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8" Jun 09 12:34:57.464358 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.464324 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nslms\"" Jun 09 12:34:57.464864 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.464837 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l"] Jun 09 12:34:57.466888 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.466873 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:34:57.469188 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.469167 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 12:34:57.469272 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.469227 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hbbql\"" Jun 09 12:34:57.469414 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.469399 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 12:34:57.473458 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.473438 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8"] Jun 09 12:34:57.479089 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.479064 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l"] Jun 09 12:34:57.530312 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.530232 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d57d8daf-9039-45b2-a295-18a24463c3bd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jdc5v\" (UID: \"d57d8daf-9039-45b2-a295-18a24463c3bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.530312 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.530267 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:34:57.530312 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.530288 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trrrn\" (UniqueName: \"kubernetes.io/projected/d57d8daf-9039-45b2-a295-18a24463c3bd-kube-api-access-trrrn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jdc5v\" (UID: \"d57d8daf-9039-45b2-a295-18a24463c3bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.530573 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.530420 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d57d8daf-9039-45b2-a295-18a24463c3bd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jdc5v\" (UID: \"d57d8daf-9039-45b2-a295-18a24463c3bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.530573 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.530469 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/43afa927-47d9-4912-8f71-aaf254512973-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:34:57.530573 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.530555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cm4p\" (UniqueName: \"kubernetes.io/projected/0b876d57-f677-4c41-a1aa-0d37b76a5e0a-kube-api-access-8cm4p\") pod \"network-check-source-dbd9cf844-chsm8\" (UID: \"0b876d57-f677-4c41-a1aa-0d37b76a5e0a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8" Jun 09 12:34:57.530918 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.530899 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d57d8daf-9039-45b2-a295-18a24463c3bd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jdc5v\" (UID: \"d57d8daf-9039-45b2-a295-18a24463c3bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.532581 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.532563 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d57d8daf-9039-45b2-a295-18a24463c3bd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jdc5v\" (UID: \"d57d8daf-9039-45b2-a295-18a24463c3bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.540843 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.540819 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trrrn\" (UniqueName: \"kubernetes.io/projected/d57d8daf-9039-45b2-a295-18a24463c3bd-kube-api-access-trrrn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jdc5v\" (UID: \"d57d8daf-9039-45b2-a295-18a24463c3bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.577555 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.577531 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" Jun 09 12:34:57.583466 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.583445 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-fnvcd" Jun 09 12:34:57.631963 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:57.631578 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 12:34:57.631963 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:57.631658 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert podName:43afa927-47d9-4912-8f71-aaf254512973 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:58.131636149 +0000 UTC m=+205.645784232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pzw2l" (UID: "43afa927-47d9-4912-8f71-aaf254512973") : secret "networking-console-plugin-cert" not found Jun 09 12:34:57.633199 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.632178 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:34:57.633199 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.632263 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/43afa927-47d9-4912-8f71-aaf254512973-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:34:57.633199 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.632343 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cm4p\" (UniqueName: \"kubernetes.io/projected/0b876d57-f677-4c41-a1aa-0d37b76a5e0a-kube-api-access-8cm4p\") pod \"network-check-source-dbd9cf844-chsm8\" (UID: \"0b876d57-f677-4c41-a1aa-0d37b76a5e0a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8" Jun 09 12:34:57.633406 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.633367 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/43afa927-47d9-4912-8f71-aaf254512973-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:34:57.643402 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.643164 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cm4p\" (UniqueName: \"kubernetes.io/projected/0b876d57-f677-4c41-a1aa-0d37b76a5e0a-kube-api-access-8cm4p\") pod \"network-check-source-dbd9cf844-chsm8\" (UID: \"0b876d57-f677-4c41-a1aa-0d37b76a5e0a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8" Jun 09 12:34:57.674340 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.674298 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" Jun 09 12:34:57.710224 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.710123 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t"] Jun 09 12:34:57.712852 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:34:57.712830 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64ba593_a393_4481_8b7d_71adabdea606.slice/crio-028c7fc5bf9bdf68ea844a9aff37a42cd604ad427682dd87e6b5405ef2d043f2 WatchSource:0}: Error finding container 028c7fc5bf9bdf68ea844a9aff37a42cd604ad427682dd87e6b5405ef2d043f2: Status 404 returned error can't find the container with id 028c7fc5bf9bdf68ea844a9aff37a42cd604ad427682dd87e6b5405ef2d043f2 Jun 09 12:34:57.729684 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.729607 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-fnvcd"] Jun 09 12:34:57.731633 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:34:57.731609 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbd7ff6_c8e4_4284_9534_83bb1c63c731.slice/crio-e98022af686ac5894bdcd26fc5d219d1539b87bbba9f4db4096524ddb59eebbf WatchSource:0}: Error finding container e98022af686ac5894bdcd26fc5d219d1539b87bbba9f4db4096524ddb59eebbf: Status 404 returned error can't find the container with id e98022af686ac5894bdcd26fc5d219d1539b87bbba9f4db4096524ddb59eebbf Jun 09 12:34:57.768273 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.768243 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8" Jun 09 12:34:57.807055 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.806966 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v"] Jun 09 12:34:57.809601 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:34:57.809573 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57d8daf_9039_45b2_a295_18a24463c3bd.slice/crio-361a980b9b8085b8eba4095a14c0d07cd2713323b41f8bff1807e775d555b5b0 WatchSource:0}: Error finding container 361a980b9b8085b8eba4095a14c0d07cd2713323b41f8bff1807e775d555b5b0: Status 404 returned error can't find the container with id 361a980b9b8085b8eba4095a14c0d07cd2713323b41f8bff1807e775d555b5b0 Jun 09 12:34:57.890099 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.890066 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8"] Jun 09 12:34:57.892925 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:34:57.892901 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b876d57_f677_4c41_a1aa_0d37b76a5e0a.slice/crio-e89ee629980378f549b7874b80c544fff7b5787c2e2667e7eeb264434e85d697 WatchSource:0}: Error finding container e89ee629980378f549b7874b80c544fff7b5787c2e2667e7eeb264434e85d697: Status 404 returned error can't find the container with id e89ee629980378f549b7874b80c544fff7b5787c2e2667e7eeb264434e85d697 Jun 09 12:34:57.934959 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:57.934933 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:57.935105 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:57.935080 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:34:57.935172 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:57.935144 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls podName:13b42da2-bc96-4e3e-a072-29f0119aed46 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:58.935129031 +0000 UTC m=+206.449277100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rjkw5" (UID: "13b42da2-bc96-4e3e-a072-29f0119aed46") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:34:58.136128 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:58.136100 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:34:58.136287 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:58.136257 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 12:34:58.136335 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:58.136324 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert podName:43afa927-47d9-4912-8f71-aaf254512973 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:59.136304232 +0000 UTC m=+206.650452327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pzw2l" (UID: "43afa927-47d9-4912-8f71-aaf254512973") : secret "networking-console-plugin-cert" not found Jun 09 12:34:58.582285 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:58.582191 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8" event={"ID":"0b876d57-f677-4c41-a1aa-0d37b76a5e0a","Type":"ContainerStarted","Data":"779d6127f3424a07ec9d3a50ec911570e89381574bd10ebdf9e7a64ee76c8b00"} Jun 09 12:34:58.582285 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:58.582259 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8" event={"ID":"0b876d57-f677-4c41-a1aa-0d37b76a5e0a","Type":"ContainerStarted","Data":"e89ee629980378f549b7874b80c544fff7b5787c2e2667e7eeb264434e85d697"} Jun 09 12:34:58.583972 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:58.583924 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" event={"ID":"d57d8daf-9039-45b2-a295-18a24463c3bd","Type":"ContainerStarted","Data":"361a980b9b8085b8eba4095a14c0d07cd2713323b41f8bff1807e775d555b5b0"} Jun 09 12:34:58.585361 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:58.585300 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fnvcd" event={"ID":"6fbd7ff6-c8e4-4284-9534-83bb1c63c731","Type":"ContainerStarted","Data":"e98022af686ac5894bdcd26fc5d219d1539b87bbba9f4db4096524ddb59eebbf"} Jun 09 12:34:58.587330 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:58.587278 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" event={"ID":"a64ba593-a393-4481-8b7d-71adabdea606","Type":"ContainerStarted","Data":"028c7fc5bf9bdf68ea844a9aff37a42cd604ad427682dd87e6b5405ef2d043f2"} Jun 09 12:34:58.601139 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:58.601091 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-chsm8" podStartSLOduration=1.601077537 podStartE2EDuration="1.601077537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:34:58.599894391 +0000 UTC m=+206.114042478" watchObservedRunningTime="2026-06-09 12:34:58.601077537 +0000 UTC m=+206.115225623" Jun 09 12:34:58.944228 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:58.944197 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:34:58.944398 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:58.944341 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:34:58.944398 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:58.944389 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls podName:13b42da2-bc96-4e3e-a072-29f0119aed46 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:00.944376805 +0000 UTC m=+208.458524868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rjkw5" (UID: "13b42da2-bc96-4e3e-a072-29f0119aed46") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:34:59.145824 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:34:59.145784 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:34:59.146031 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:59.145972 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 12:34:59.146124 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:34:59.146083 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert podName:43afa927-47d9-4912-8f71-aaf254512973 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:01.146059985 +0000 UTC m=+208.660208054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pzw2l" (UID: "43afa927-47d9-4912-8f71-aaf254512973") : secret "networking-console-plugin-cert" not found Jun 09 12:35:00.963367 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:00.963326 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:35:00.963831 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:00.963635 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:35:00.963831 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:00.963733 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls podName:13b42da2-bc96-4e3e-a072-29f0119aed46 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:04.963712295 +0000 UTC m=+212.477860380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rjkw5" (UID: "13b42da2-bc96-4e3e-a072-29f0119aed46") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:35:01.165693 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:01.165663 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:35:01.165846 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:01.165826 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 12:35:01.165919 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:01.165908 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert podName:43afa927-47d9-4912-8f71-aaf254512973 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:05.165886944 +0000 UTC m=+212.680035014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pzw2l" (UID: "43afa927-47d9-4912-8f71-aaf254512973") : secret "networking-console-plugin-cert" not found Jun 09 12:35:01.599540 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:01.599503 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" event={"ID":"d57d8daf-9039-45b2-a295-18a24463c3bd","Type":"ContainerStarted","Data":"ac92f3edaa8457af37fa5db8b3385120e4b925dcc5e158478971686f37769672"} Jun 09 12:35:01.601150 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:01.601120 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fnvcd" event={"ID":"6fbd7ff6-c8e4-4284-9534-83bb1c63c731","Type":"ContainerStarted","Data":"ce9b1b43e93e817245dbaafd7ae7e6a32465598bbaf122353f596b7812e20469"} Jun 09 12:35:01.602540 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:01.602518 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" event={"ID":"a64ba593-a393-4481-8b7d-71adabdea606","Type":"ContainerStarted","Data":"34a9735cdff9abc2ad6e892d3b904a2ebf791466be683f5ec0c973ddc42b7d06"} Jun 09 12:35:01.664563 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:01.664494 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" podStartSLOduration=1.330193387 podStartE2EDuration="4.664471916s" totalImagesPullingTime="3.334278529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:01.626464842 +0000 UTC m=+209.140612927" watchObservedRunningTime="2026-06-09 12:35:01.664471916 +0000 UTC m=+209.178620003" Jun 09 12:35:01.665508 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:01.665473 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" podStartSLOduration=1.230446335 podStartE2EDuration="4.665462538s" totalImagesPullingTime="3.435016203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:01.664383997 +0000 UTC m=+209.178532084" watchObservedRunningTime="2026-06-09 12:35:01.665462538 +0000 UTC m=+209.179610629" Jun 09 12:35:01.692520 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:01.692453 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-fnvcd" podStartSLOduration=1.275159445 podStartE2EDuration="4.692431822s" totalImagesPullingTime="3.417272377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:01.691858639 +0000 UTC m=+209.206006722" watchObservedRunningTime="2026-06-09 12:35:01.692431822 +0000 UTC m=+209.206579911" Jun 09 12:35:02.875334 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:02.875302 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m"] Jun 09 12:35:02.877891 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:02.877873 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m" Jun 09 12:35:02.885560 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:02.885532 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"migrator-955ffdf5f-n6w2m\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="5273a8a9-bbf6-467f-bf61-a6cc0120f3f6" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m" Jun 09 12:35:02.885659 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:02.885594 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-storage-version-migrator-sa-dockercfg-vkhd6\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vkhd6\"" type="*v1.Secret" Jun 09 12:35:02.886081 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:02.886051 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 09 12:35:02.887350 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:02.887328 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 09 12:35:02.915575 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:02.915543 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m"] Jun 09 12:35:02.980764 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:02.980735 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glchx\" (UniqueName: \"kubernetes.io/projected/5273a8a9-bbf6-467f-bf61-a6cc0120f3f6-kube-api-access-glchx\") pod \"migrator-955ffdf5f-n6w2m\" (UID: \"5273a8a9-bbf6-467f-bf61-a6cc0120f3f6\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m" Jun 09 12:35:03.082060 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:03.082024 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glchx\" (UniqueName: \"kubernetes.io/projected/5273a8a9-bbf6-467f-bf61-a6cc0120f3f6-kube-api-access-glchx\") pod \"migrator-955ffdf5f-n6w2m\" (UID: \"5273a8a9-bbf6-467f-bf61-a6cc0120f3f6\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m" Jun 09 12:35:03.720912 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:03.720877 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 12:35:03.997177 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:03.997085 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 12:35:04.008866 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.008836 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glchx\" (UniqueName: \"kubernetes.io/projected/5273a8a9-bbf6-467f-bf61-a6cc0120f3f6-kube-api-access-glchx\") pod \"migrator-955ffdf5f-n6w2m\" (UID: \"5273a8a9-bbf6-467f-bf61-a6cc0120f3f6\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m" Jun 09 12:35:04.413328 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.413304 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5262_90eff6cf-05c0-47be-a6f2-40f689890444/dns-node-resolver/0.log" Jun 09 12:35:04.448736 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.448711 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vkhd6\"" Jun 09 12:35:04.456539 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.456520 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m" Jun 09 12:35:04.590146 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.590111 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m"] Jun 09 12:35:04.592972 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:04.592944 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5273a8a9_bbf6_467f_bf61_a6cc0120f3f6.slice/crio-887c01eebfadedea7496bf90a8232659397b1ae96484e0f75a3eb81405486dbe WatchSource:0}: Error finding container 887c01eebfadedea7496bf90a8232659397b1ae96484e0f75a3eb81405486dbe: Status 404 returned error can't find the container with id 887c01eebfadedea7496bf90a8232659397b1ae96484e0f75a3eb81405486dbe Jun 09 12:35:04.612122 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.612091 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m" event={"ID":"5273a8a9-bbf6-467f-bf61-a6cc0120f3f6","Type":"ContainerStarted","Data":"887c01eebfadedea7496bf90a8232659397b1ae96484e0f75a3eb81405486dbe"} Jun 09 12:35:04.835485 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.835403 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-nhqpr"] Jun 09 12:35:04.838396 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.838377 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:04.849756 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.849737 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 12:35:04.850872 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.850848 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jvwkg\"" Jun 09 12:35:04.850872 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.850857 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 12:35:04.851044 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.850857 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 12:35:04.851044 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.850988 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 12:35:04.868847 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.868824 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-nhqpr"] Jun 09 12:35:04.896746 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.896710 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e179baa3-d80d-4b3d-bbb8-42af5488d120-signing-key\") pod \"service-ca-7d74d578b8-nhqpr\" (UID: \"e179baa3-d80d-4b3d-bbb8-42af5488d120\") " pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:04.896913 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.896789 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e179baa3-d80d-4b3d-bbb8-42af5488d120-signing-cabundle\") pod \"service-ca-7d74d578b8-nhqpr\" (UID: \"e179baa3-d80d-4b3d-bbb8-42af5488d120\") " pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:04.896913 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.896812 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6lv6\" (UniqueName: \"kubernetes.io/projected/e179baa3-d80d-4b3d-bbb8-42af5488d120-kube-api-access-b6lv6\") pod \"service-ca-7d74d578b8-nhqpr\" (UID: \"e179baa3-d80d-4b3d-bbb8-42af5488d120\") " pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:04.997566 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.997530 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e179baa3-d80d-4b3d-bbb8-42af5488d120-signing-cabundle\") pod \"service-ca-7d74d578b8-nhqpr\" (UID: \"e179baa3-d80d-4b3d-bbb8-42af5488d120\") " pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:04.997566 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.997567 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6lv6\" (UniqueName: \"kubernetes.io/projected/e179baa3-d80d-4b3d-bbb8-42af5488d120-kube-api-access-b6lv6\") pod \"service-ca-7d74d578b8-nhqpr\" (UID: \"e179baa3-d80d-4b3d-bbb8-42af5488d120\") " pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:04.998079 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.997589 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:35:04.998079 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.997628 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e179baa3-d80d-4b3d-bbb8-42af5488d120-signing-key\") pod \"service-ca-7d74d578b8-nhqpr\" (UID: \"e179baa3-d80d-4b3d-bbb8-42af5488d120\") " pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:04.998079 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:04.997733 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:35:04.998079 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:04.997813 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls podName:13b42da2-bc96-4e3e-a072-29f0119aed46 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:12.997791445 +0000 UTC m=+220.511939518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rjkw5" (UID: "13b42da2-bc96-4e3e-a072-29f0119aed46") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:35:04.998284 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:04.998264 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e179baa3-d80d-4b3d-bbb8-42af5488d120-signing-cabundle\") pod \"service-ca-7d74d578b8-nhqpr\" (UID: \"e179baa3-d80d-4b3d-bbb8-42af5488d120\") " pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:05.000134 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:05.000117 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e179baa3-d80d-4b3d-bbb8-42af5488d120-signing-key\") pod \"service-ca-7d74d578b8-nhqpr\" (UID: \"e179baa3-d80d-4b3d-bbb8-42af5488d120\") " pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:05.008241 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:05.008218 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6lv6\" (UniqueName: \"kubernetes.io/projected/e179baa3-d80d-4b3d-bbb8-42af5488d120-kube-api-access-b6lv6\") pod \"service-ca-7d74d578b8-nhqpr\" (UID: \"e179baa3-d80d-4b3d-bbb8-42af5488d120\") " pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:05.014583 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:05.014534 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjbzc_defc77c1-b17f-4f7e-b81d-fe817b6423f4/node-ca/0.log" Jun 09 12:35:05.147488 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:05.147453 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" Jun 09 12:35:05.200256 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:05.200106 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:35:05.200484 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:05.200316 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 12:35:05.200484 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:05.200389 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert podName:43afa927-47d9-4912-8f71-aaf254512973 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:13.200368472 +0000 UTC m=+220.714516536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pzw2l" (UID: "43afa927-47d9-4912-8f71-aaf254512973") : secret "networking-console-plugin-cert" not found Jun 09 12:35:05.306133 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:05.306102 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-nhqpr"] Jun 09 12:35:05.308927 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:05.308895 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode179baa3_d80d_4b3d_bbb8_42af5488d120.slice/crio-3eff64a77855a1309e8d25fd676cfe7829d4da1a59eb0ea46f8b9fd702a7402f WatchSource:0}: Error finding container 3eff64a77855a1309e8d25fd676cfe7829d4da1a59eb0ea46f8b9fd702a7402f: Status 404 returned error can't find the container with id 3eff64a77855a1309e8d25fd676cfe7829d4da1a59eb0ea46f8b9fd702a7402f Jun 09 12:35:05.617373 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:05.617340 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" event={"ID":"e179baa3-d80d-4b3d-bbb8-42af5488d120","Type":"ContainerStarted","Data":"8ff1d68c000fd986eca7fb041a8a232ffe31e6c50c0d8b873e85dcb086402de0"} Jun 09 12:35:05.617535 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:05.617391 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" event={"ID":"e179baa3-d80d-4b3d-bbb8-42af5488d120","Type":"ContainerStarted","Data":"3eff64a77855a1309e8d25fd676cfe7829d4da1a59eb0ea46f8b9fd702a7402f"} Jun 09 12:35:05.639118 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:05.638938 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-nhqpr" podStartSLOduration=1.638921464 podStartE2EDuration="1.638921464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:05.638896654 +0000 UTC m=+213.153044742" watchObservedRunningTime="2026-06-09 12:35:05.638921464 +0000 UTC m=+213.153069549" Jun 09 12:35:06.020445 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:06.020364 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lhhw2_2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217/serve-healthcheck-canary/0.log" Jun 09 12:35:06.622621 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:06.622527 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m" event={"ID":"5273a8a9-bbf6-467f-bf61-a6cc0120f3f6","Type":"ContainerStarted","Data":"9a9e0e6ddcfb7ca1e09e1b80967403b40146904039b1218fe73e8c487d4058ec"} Jun 09 12:35:06.622621 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:06.622586 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m" event={"ID":"5273a8a9-bbf6-467f-bf61-a6cc0120f3f6","Type":"ContainerStarted","Data":"5e3af9b3f76dda77ae5498fe24bf62d7328b0bcf3138b1a320f0496608601670"} Jun 09 12:35:13.069333 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:13.069294 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:35:13.069738 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:13.069445 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:35:13.069738 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:13.069516 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls podName:13b42da2-bc96-4e3e-a072-29f0119aed46 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:29.069496664 +0000 UTC m=+236.583644770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rjkw5" (UID: "13b42da2-bc96-4e3e-a072-29f0119aed46") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:35:13.271615 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:13.271578 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:35:13.271800 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:13.271737 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 12:35:13.271856 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:13.271805 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert podName:43afa927-47d9-4912-8f71-aaf254512973 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:29.271790546 +0000 UTC m=+236.785938609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pzw2l" (UID: "43afa927-47d9-4912-8f71-aaf254512973") : secret "networking-console-plugin-cert" not found Jun 09 12:35:28.800542 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.800485 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n6w2m" podStartSLOduration=25.751365715 podStartE2EDuration="26.800465093s" totalImagesPullingTime="1.049099378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:06.660979774 +0000 UTC m=+214.175127861" watchObservedRunningTime="2026-06-09 12:35:28.800465093 +0000 UTC m=+236.314613182" Jun 09 12:35:28.800914 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.800778 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g6rf4"] Jun 09 12:35:28.804131 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.804111 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:28.810657 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.810584 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2pflr\"" Jun 09 12:35:28.810740 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.810667 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 12:35:28.810823 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.810806 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 12:35:28.821052 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.821029 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g6rf4"] Jun 09 12:35:28.902607 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.902576 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/124d515e-085d-49c0-9f7d-20504773847e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:28.902765 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.902633 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/124d515e-085d-49c0-9f7d-20504773847e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:28.902765 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.902671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/124d515e-085d-49c0-9f7d-20504773847e-data-volume\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:28.902765 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.902721 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/124d515e-085d-49c0-9f7d-20504773847e-crio-socket\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:28.902765 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:28.902746 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27rgh\" (UniqueName: \"kubernetes.io/projected/124d515e-085d-49c0-9f7d-20504773847e-kube-api-access-27rgh\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.004117 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.004087 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/124d515e-085d-49c0-9f7d-20504773847e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.004275 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.004134 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/124d515e-085d-49c0-9f7d-20504773847e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.004275 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.004176 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/124d515e-085d-49c0-9f7d-20504773847e-data-volume\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.004275 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.004212 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/124d515e-085d-49c0-9f7d-20504773847e-crio-socket\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.004275 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.004227 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27rgh\" (UniqueName: \"kubernetes.io/projected/124d515e-085d-49c0-9f7d-20504773847e-kube-api-access-27rgh\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.004460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.004316 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/124d515e-085d-49c0-9f7d-20504773847e-crio-socket\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.004611 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.004590 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/124d515e-085d-49c0-9f7d-20504773847e-data-volume\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.004724 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.004706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/124d515e-085d-49c0-9f7d-20504773847e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.006507 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.006488 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/124d515e-085d-49c0-9f7d-20504773847e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.021507 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.021482 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27rgh\" (UniqueName: \"kubernetes.io/projected/124d515e-085d-49c0-9f7d-20504773847e-kube-api-access-27rgh\") pod \"insights-runtime-extractor-g6rf4\" (UID: \"124d515e-085d-49c0-9f7d-20504773847e\") " pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.105043 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.104994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:35:29.107292 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.107270 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13b42da2-bc96-4e3e-a072-29f0119aed46-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rjkw5\" (UID: \"13b42da2-bc96-4e3e-a072-29f0119aed46\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:35:29.113241 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.113223 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g6rf4" Jun 09 12:35:29.283707 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.283677 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g6rf4"] Jun 09 12:35:29.286832 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:29.286809 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124d515e_085d_49c0_9f7d_20504773847e.slice/crio-906056cc0ddf4d03e985e09abdcadc709e2d937c4ee2e6148c60fb558b8067d7 WatchSource:0}: Error finding container 906056cc0ddf4d03e985e09abdcadc709e2d937c4ee2e6148c60fb558b8067d7: Status 404 returned error can't find the container with id 906056cc0ddf4d03e985e09abdcadc709e2d937c4ee2e6148c60fb558b8067d7 Jun 09 12:35:29.308046 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.308024 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:35:29.310315 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.310290 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43afa927-47d9-4912-8f71-aaf254512973-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pzw2l\" (UID: \"43afa927-47d9-4912-8f71-aaf254512973\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:35:29.388183 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.388105 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" Jun 09 12:35:29.521569 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.521532 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5"] Jun 09 12:35:29.524902 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:29.524872 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b42da2_bc96_4e3e_a072_29f0119aed46.slice/crio-815043c948b74296f6b5b5df12a0523ab968591b4dccf010dcc3bfcb7e69d7a8 WatchSource:0}: Error finding container 815043c948b74296f6b5b5df12a0523ab968591b4dccf010dcc3bfcb7e69d7a8: Status 404 returned error can't find the container with id 815043c948b74296f6b5b5df12a0523ab968591b4dccf010dcc3bfcb7e69d7a8 Jun 09 12:35:29.575109 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.575077 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" Jun 09 12:35:29.694312 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.694273 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" event={"ID":"13b42da2-bc96-4e3e-a072-29f0119aed46","Type":"ContainerStarted","Data":"815043c948b74296f6b5b5df12a0523ab968591b4dccf010dcc3bfcb7e69d7a8"} Jun 09 12:35:29.695607 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.695585 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6rf4" event={"ID":"124d515e-085d-49c0-9f7d-20504773847e","Type":"ContainerStarted","Data":"331244b2d7231c7b94d7736a111ecb5eb6009fbe10544347ddef87dea63d6e2c"} Jun 09 12:35:29.695697 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.695632 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6rf4" event={"ID":"124d515e-085d-49c0-9f7d-20504773847e","Type":"ContainerStarted","Data":"906056cc0ddf4d03e985e09abdcadc709e2d937c4ee2e6148c60fb558b8067d7"} Jun 09 12:35:29.701417 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:29.701391 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l"] Jun 09 12:35:29.703525 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:29.703504 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43afa927_47d9_4912_8f71_aaf254512973.slice/crio-7a6355aaa202618de2d1c7142d737fd9df33a9297e3065b676104265b3951ad1 WatchSource:0}: Error finding container 7a6355aaa202618de2d1c7142d737fd9df33a9297e3065b676104265b3951ad1: Status 404 returned error can't find the container with id 7a6355aaa202618de2d1c7142d737fd9df33a9297e3065b676104265b3951ad1 Jun 09 12:35:30.703897 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:30.703863 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" event={"ID":"43afa927-47d9-4912-8f71-aaf254512973","Type":"ContainerStarted","Data":"7a6355aaa202618de2d1c7142d737fd9df33a9297e3065b676104265b3951ad1"} Jun 09 12:35:30.706374 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:30.706335 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6rf4" event={"ID":"124d515e-085d-49c0-9f7d-20504773847e","Type":"ContainerStarted","Data":"5c48e2faf19ffd0a74a5595b914c38aedd0c24899f32d659ff7359cec43b4393"} Jun 09 12:35:31.711080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:31.711042 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" event={"ID":"43afa927-47d9-4912-8f71-aaf254512973","Type":"ContainerStarted","Data":"56a9c4a57fb191967de3d3f3da96fc49b661a45d3965e0e303411d3c70f6f0fb"} Jun 09 12:35:31.733082 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:31.733029 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pzw2l" podStartSLOduration=33.495893741 podStartE2EDuration="34.732991271s" totalImagesPullingTime="1.23709753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:31.732533323 +0000 UTC m=+239.246681409" watchObservedRunningTime="2026-06-09 12:35:31.732991271 +0000 UTC m=+239.247139402" Jun 09 12:35:32.716568 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:32.716531 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" event={"ID":"13b42da2-bc96-4e3e-a072-29f0119aed46","Type":"ContainerStarted","Data":"616ce17b88f5243e719890a2e92c67946ded66beae81f174da1c3979ffdee7ab"} Jun 09 12:35:32.718955 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:32.718928 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6rf4" event={"ID":"124d515e-085d-49c0-9f7d-20504773847e","Type":"ContainerStarted","Data":"ad34697da6247b1218fd34cd827585b3b1961331534464b68b7231527d23db08"} Jun 09 12:35:32.785816 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:32.785759 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g6rf4" podStartSLOduration=1.9228058730000002 podStartE2EDuration="4.785738779s" totalImagesPullingTime="2.862932906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:35:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:32.784905879 +0000 UTC m=+240.299053965" watchObservedRunningTime="2026-06-09 12:35:32.785738779 +0000 UTC m=+240.299886866" Jun 09 12:35:32.786414 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:32.786385 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rjkw5" podStartSLOduration=33.042647662 podStartE2EDuration="35.786376394s" totalImagesPullingTime="2.743728732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:32.747884126 +0000 UTC m=+240.262032212" watchObservedRunningTime="2026-06-09 12:35:32.786376394 +0000 UTC m=+240.300524481" Jun 09 12:35:32.943867 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:32.943829 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf"] Jun 09 12:35:32.949519 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:32.949495 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" Jun 09 12:35:32.952927 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:32.952901 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 12:35:32.953063 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:32.952990 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tbcg8\"" Jun 09 12:35:32.963538 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:32.963515 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf"] Jun 09 12:35:33.037395 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:33.037302 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/874b7331-81de-4c95-8783-48fc879b50dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xbldf\" (UID: \"874b7331-81de-4c95-8783-48fc879b50dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" Jun 09 12:35:33.137962 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:33.137920 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/874b7331-81de-4c95-8783-48fc879b50dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xbldf\" (UID: \"874b7331-81de-4c95-8783-48fc879b50dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" Jun 09 12:35:33.138180 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:33.138099 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 09 12:35:33.138248 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:33.138190 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874b7331-81de-4c95-8783-48fc879b50dc-tls-certificates podName:874b7331-81de-4c95-8783-48fc879b50dc nodeName:}" failed. No retries permitted until 2026-06-09 12:35:33.638167829 +0000 UTC m=+241.152315899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/874b7331-81de-4c95-8783-48fc879b50dc-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-xbldf" (UID: "874b7331-81de-4c95-8783-48fc879b50dc") : secret "prometheus-operator-admission-webhook-tls" not found Jun 09 12:35:33.641711 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:33.641675 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/874b7331-81de-4c95-8783-48fc879b50dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xbldf\" (UID: \"874b7331-81de-4c95-8783-48fc879b50dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" Jun 09 12:35:33.644320 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:33.644297 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/874b7331-81de-4c95-8783-48fc879b50dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xbldf\" (UID: \"874b7331-81de-4c95-8783-48fc879b50dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" Jun 09 12:35:33.858825 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:33.858786 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" Jun 09 12:35:33.992569 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:33.992520 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf"] Jun 09 12:35:33.994968 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:33.994943 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod874b7331_81de_4c95_8783_48fc879b50dc.slice/crio-8810a84bbedcd850624dccef6907f972aa9464513da856580b6aede3ca722c5f WatchSource:0}: Error finding container 8810a84bbedcd850624dccef6907f972aa9464513da856580b6aede3ca722c5f: Status 404 returned error can't find the container with id 8810a84bbedcd850624dccef6907f972aa9464513da856580b6aede3ca722c5f Jun 09 12:35:34.728426 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:34.728387 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" event={"ID":"874b7331-81de-4c95-8783-48fc879b50dc","Type":"ContainerStarted","Data":"8810a84bbedcd850624dccef6907f972aa9464513da856580b6aede3ca722c5f"} Jun 09 12:35:36.737251 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:36.737208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" event={"ID":"874b7331-81de-4c95-8783-48fc879b50dc","Type":"ContainerStarted","Data":"d88341ede7d4f79a08363f026b347adac3ec35c866ca8111f9ac08bfdbaa2aec"} Jun 09 12:35:36.737632 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:36.737388 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" Jun 09 12:35:36.741981 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:36.741947 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" Jun 09 12:35:36.759095 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:36.759042 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xbldf" podStartSLOduration=3.098522277 podStartE2EDuration="4.75902849s" totalImagesPullingTime="1.660506213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:36.758706414 +0000 UTC m=+244.272854500" watchObservedRunningTime="2026-06-09 12:35:36.75902849 +0000 UTC m=+244.273176572" Jun 09 12:35:37.060454 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.060375 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6"] Jun 09 12:35:37.062523 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.062507 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.065994 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.065971 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 12:35:37.066339 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.066318 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ld2g4\"" Jun 09 12:35:37.066423 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.066352 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 12:35:37.067632 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.067614 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 12:35:37.083071 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.083040 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6"] Jun 09 12:35:37.169104 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.169065 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.169291 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.169118 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.169291 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.169188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.169291 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.169276 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46lvf\" (UniqueName: \"kubernetes.io/projected/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-kube-api-access-46lvf\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.270092 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.270054 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46lvf\" (UniqueName: \"kubernetes.io/projected/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-kube-api-access-46lvf\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.270293 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.270128 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.270293 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.270182 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.270293 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.270218 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.270293 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:37.270266 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 09 12:35:37.270493 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:37.270343 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-prometheus-operator-tls podName:41eab9ac-7e6a-44d5-b9e9-44d003064cf6 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:37.77032399 +0000 UTC m=+245.284472072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-7v2l6" (UID: "41eab9ac-7e6a-44d5-b9e9-44d003064cf6") : secret "prometheus-operator-tls" not found Jun 09 12:35:37.270913 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.270891 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.272929 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.272906 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.280118 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.280094 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46lvf\" (UniqueName: \"kubernetes.io/projected/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-kube-api-access-46lvf\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.773334 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.773295 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.775751 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.775729 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41eab9ac-7e6a-44d5-b9e9-44d003064cf6-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7v2l6\" (UID: \"41eab9ac-7e6a-44d5-b9e9-44d003064cf6\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:37.971642 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:37.971591 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" Jun 09 12:35:38.098673 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:38.098648 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6"] Jun 09 12:35:38.100823 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:38.100795 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41eab9ac_7e6a_44d5_b9e9_44d003064cf6.slice/crio-8fb3e5dfb26dbbc68f9e25874183751ef76437d3f3947d13c360d501161d509a WatchSource:0}: Error finding container 8fb3e5dfb26dbbc68f9e25874183751ef76437d3f3947d13c360d501161d509a: Status 404 returned error can't find the container with id 8fb3e5dfb26dbbc68f9e25874183751ef76437d3f3947d13c360d501161d509a Jun 09 12:35:38.745904 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:38.745868 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" event={"ID":"41eab9ac-7e6a-44d5-b9e9-44d003064cf6","Type":"ContainerStarted","Data":"8fb3e5dfb26dbbc68f9e25874183751ef76437d3f3947d13c360d501161d509a"} Jun 09 12:35:39.750554 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:39.750453 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" event={"ID":"41eab9ac-7e6a-44d5-b9e9-44d003064cf6","Type":"ContainerStarted","Data":"26a838f5749b8ed0a11e324a031840fc6299226f369f0cf677a8b2fc1ad393c5"} Jun 09 12:35:39.750554 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:39.750511 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" event={"ID":"41eab9ac-7e6a-44d5-b9e9-44d003064cf6","Type":"ContainerStarted","Data":"ae2b6a99035e69f969c2754ab6643904dd09b717f927763b4401c8ac1eb6c2ba"} Jun 09 12:35:39.771786 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:39.771736 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7v2l6" podStartSLOduration=1.48116401 podStartE2EDuration="2.771717424s" totalImagesPullingTime="1.290553414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:39.770219599 +0000 UTC m=+247.284367684" watchObservedRunningTime="2026-06-09 12:35:39.771717424 +0000 UTC m=+247.285865512" Jun 09 12:35:41.506347 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.506313 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v"] Jun 09 12:35:41.508624 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.508604 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.515416 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.515395 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 12:35:41.516704 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.516684 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 12:35:41.516805 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.516694 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 12:35:41.516805 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.516691 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9ns4c\"" Jun 09 12:35:41.532119 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.532096 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qg2qt"] Jun 09 12:35:41.534297 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.534282 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.538725 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.538703 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 12:35:41.538872 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.538831 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f9plm\"" Jun 09 12:35:41.538975 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.538710 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 12:35:41.538975 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.538765 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 12:35:41.548386 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.548363 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v"] Jun 09 12:35:41.605067 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605038 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/39609855-c635-4538-a8ed-5e79210ee7d6-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.605233 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605079 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-tls\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.605233 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605097 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39609855-c635-4538-a8ed-5e79210ee7d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.605233 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605116 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a66e5190-05fc-49ca-9ab6-853c7b0586d9-root\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.605233 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605153 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-wtmp\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.605233 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605198 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.605233 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605223 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39609855-c635-4538-a8ed-5e79210ee7d6-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.605452 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605255 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-textfile\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.605452 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605307 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbzsb\" (UniqueName: \"kubernetes.io/projected/39609855-c635-4538-a8ed-5e79210ee7d6-kube-api-access-sbzsb\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.605452 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a66e5190-05fc-49ca-9ab6-853c7b0586d9-metrics-client-ca\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.605452 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605363 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39609855-c635-4538-a8ed-5e79210ee7d6-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.605452 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605389 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/39609855-c635-4538-a8ed-5e79210ee7d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.605452 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605417 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.605452 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605443 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mpds\" (UniqueName: \"kubernetes.io/projected/a66e5190-05fc-49ca-9ab6-853c7b0586d9-kube-api-access-4mpds\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.605687 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.605498 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a66e5190-05fc-49ca-9ab6-853c7b0586d9-sys\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.706839 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.706783 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a66e5190-05fc-49ca-9ab6-853c7b0586d9-sys\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707058 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.706887 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/39609855-c635-4538-a8ed-5e79210ee7d6-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.707058 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.706907 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a66e5190-05fc-49ca-9ab6-853c7b0586d9-sys\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707058 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.706936 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-tls\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707058 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.706961 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39609855-c635-4538-a8ed-5e79210ee7d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.707058 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.706987 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a66e5190-05fc-49ca-9ab6-853c7b0586d9-root\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707058 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707037 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-wtmp\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707062 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707089 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a66e5190-05fc-49ca-9ab6-853c7b0586d9-root\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707088 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39609855-c635-4538-a8ed-5e79210ee7d6-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707143 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-textfile\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707179 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbzsb\" (UniqueName: \"kubernetes.io/projected/39609855-c635-4538-a8ed-5e79210ee7d6-kube-api-access-sbzsb\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707183 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-wtmp\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707206 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a66e5190-05fc-49ca-9ab6-853c7b0586d9-metrics-client-ca\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707268 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39609855-c635-4538-a8ed-5e79210ee7d6-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707295 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/39609855-c635-4538-a8ed-5e79210ee7d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707323 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707336 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/39609855-c635-4538-a8ed-5e79210ee7d6-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.707377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707349 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mpds\" (UniqueName: \"kubernetes.io/projected/a66e5190-05fc-49ca-9ab6-853c7b0586d9-kube-api-access-4mpds\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.707910 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-textfile\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.708026 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.707986 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39609855-c635-4538-a8ed-5e79210ee7d6-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.708104 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.708066 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a66e5190-05fc-49ca-9ab6-853c7b0586d9-metrics-client-ca\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.708234 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.708215 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.708454 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.708431 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/39609855-c635-4538-a8ed-5e79210ee7d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.709717 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.709695 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39609855-c635-4538-a8ed-5e79210ee7d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.709798 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.709782 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39609855-c635-4538-a8ed-5e79210ee7d6-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.710242 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.710224 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.710343 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.710327 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a66e5190-05fc-49ca-9ab6-853c7b0586d9-node-exporter-tls\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.725695 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.725668 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mpds\" (UniqueName: \"kubernetes.io/projected/a66e5190-05fc-49ca-9ab6-853c7b0586d9-kube-api-access-4mpds\") pod \"node-exporter-qg2qt\" (UID: \"a66e5190-05fc-49ca-9ab6-853c7b0586d9\") " pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.725963 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.725943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbzsb\" (UniqueName: \"kubernetes.io/projected/39609855-c635-4538-a8ed-5e79210ee7d6-kube-api-access-sbzsb\") pod \"kube-state-metrics-57bbf8bfb5-5tx8v\" (UID: \"39609855-c635-4538-a8ed-5e79210ee7d6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.817742 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.817641 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" Jun 09 12:35:41.842401 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.842360 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qg2qt" Jun 09 12:35:41.855165 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:41.855124 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66e5190_05fc_49ca_9ab6_853c7b0586d9.slice/crio-8d1568441b7febefa2720873feb3606de381f132ab87a45df9cd8d923c1ba497 WatchSource:0}: Error finding container 8d1568441b7febefa2720873feb3606de381f132ab87a45df9cd8d923c1ba497: Status 404 returned error can't find the container with id 8d1568441b7febefa2720873feb3606de381f132ab87a45df9cd8d923c1ba497 Jun 09 12:35:41.959748 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:41.959722 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v"] Jun 09 12:35:41.961889 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:41.961865 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39609855_c635_4538_a8ed_5e79210ee7d6.slice/crio-6e447426c88c0577607b139b800e18a0bb1f56292a795756f42f0705d437302a WatchSource:0}: Error finding container 6e447426c88c0577607b139b800e18a0bb1f56292a795756f42f0705d437302a: Status 404 returned error can't find the container with id 6e447426c88c0577607b139b800e18a0bb1f56292a795756f42f0705d437302a Jun 09 12:35:42.584519 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.584483 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:35:42.587866 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.587779 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.597978 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.596735 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 12:35:42.597978 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.597019 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 12:35:42.597978 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.597203 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 12:35:42.597978 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.597421 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 12:35:42.599252 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.598288 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 12:35:42.599252 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.598539 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 12:35:42.599252 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.598652 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9gv2n\"" Jun 09 12:35:42.599252 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.598747 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 12:35:42.600248 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.599836 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 12:35:42.600248 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.599841 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 12:35:42.618303 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618195 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:35:42.618506 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618483 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-out\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.618569 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618528 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.618627 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618596 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.618681 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.618681 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.619137 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618693 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.619137 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618718 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.619137 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618750 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-web-config\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.619137 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618818 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.619137 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.619137 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618889 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.619137 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk2m8\" (UniqueName: \"kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-kube-api-access-rk2m8\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.619137 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.618946 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.719991 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.719950 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720163 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720040 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-out\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720163 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720076 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720163 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720136 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720163 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720161 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720417 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720198 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720417 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720226 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720417 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720251 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720417 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720283 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-web-config\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720417 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720343 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720417 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720417 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720409 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.720734 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.720433 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk2m8\" (UniqueName: \"kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-kube-api-access-rk2m8\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.727381 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:42.726411 2555 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 09 12:35:42.727381 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:35:42.726490 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-main-tls podName:ce5d65c0-e821-409c-9b0d-33f6b41924c2 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:43.226467652 +0000 UTC m=+250.740615731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2") : secret "alertmanager-main-tls" not found Jun 09 12:35:42.727381 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.726505 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.727381 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.727101 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.730307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.730281 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.730550 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.730526 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.731318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.731292 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.731955 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.731900 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.732708 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.732686 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.733900 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.733845 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.734355 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.734313 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-web-config\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.734982 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.734940 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-out\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.738284 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.738257 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.742941 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.742908 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk2m8\" (UniqueName: \"kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-kube-api-access-rk2m8\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:42.763234 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.763138 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" event={"ID":"39609855-c635-4538-a8ed-5e79210ee7d6","Type":"ContainerStarted","Data":"6e447426c88c0577607b139b800e18a0bb1f56292a795756f42f0705d437302a"} Jun 09 12:35:42.764696 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:42.764669 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qg2qt" event={"ID":"a66e5190-05fc-49ca-9ab6-853c7b0586d9","Type":"ContainerStarted","Data":"8d1568441b7febefa2720873feb3606de381f132ab87a45df9cd8d923c1ba497"} Jun 09 12:35:43.228859 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.228777 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:43.231778 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.231742 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:43.504218 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.504139 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:35:43.592639 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.592604 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b7869645b-wzvft"] Jun 09 12:35:43.596390 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.596370 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.599662 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.599639 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 12:35:43.599832 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.599798 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 12:35:43.600096 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.600076 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 12:35:43.600332 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.600164 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 12:35:43.600464 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.600442 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-asrogvndl29kv\"" Jun 09 12:35:43.600579 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.600416 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 12:35:43.600640 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.600374 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8vrj9\"" Jun 09 12:35:43.632480 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.628223 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b7869645b-wzvft"] Jun 09 12:35:43.633709 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.632972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-grpc-tls\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.633709 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.633109 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.633709 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.633174 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-tls\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.633709 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.633232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.633709 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.633260 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-metrics-client-ca\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.633709 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.633291 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28824\" (UniqueName: \"kubernetes.io/projected/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-kube-api-access-28824\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.633709 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.633387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.633709 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.633423 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.668858 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.668833 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:35:43.671517 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:43.671489 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5d65c0_e821_409c_9b0d_33f6b41924c2.slice/crio-5f228debfce8d43af8cbfab9928b8ae806baf7e368621175f2b78f1dfd888559 WatchSource:0}: Error finding container 5f228debfce8d43af8cbfab9928b8ae806baf7e368621175f2b78f1dfd888559: Status 404 returned error can't find the container with id 5f228debfce8d43af8cbfab9928b8ae806baf7e368621175f2b78f1dfd888559 Jun 09 12:35:43.734412 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.734383 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.734532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.734426 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-tls\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.734532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.734451 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.734532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.734477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-metrics-client-ca\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.734532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.734503 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28824\" (UniqueName: \"kubernetes.io/projected/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-kube-api-access-28824\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.734740 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.734544 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:35:43.734740 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.734590 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.735090 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.734905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.735090 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.735017 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-grpc-tls\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.735626 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.735601 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-metrics-client-ca\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.737902 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.737874 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.738554 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.738330 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4-metrics-certs\") pod \"network-metrics-daemon-7sknt\" (UID: \"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4\") " pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:35:43.738554 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.738370 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.738554 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.738372 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-tls\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.738554 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.738503 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.738554 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.738530 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.738841 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.738558 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-secret-grpc-tls\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.744339 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.744311 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28824\" (UniqueName: \"kubernetes.io/projected/a0316c1f-b6cb-48b6-a998-3f84ba4a5131-kube-api-access-28824\") pod \"thanos-querier-7b7869645b-wzvft\" (UID: \"a0316c1f-b6cb-48b6-a998-3f84ba4a5131\") " pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.762281 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.762030 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4k8hn\"" Jun 09 12:35:43.769187 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.769163 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sknt" Jun 09 12:35:43.769718 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.769694 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerStarted","Data":"5f228debfce8d43af8cbfab9928b8ae806baf7e368621175f2b78f1dfd888559"} Jun 09 12:35:43.771883 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.771847 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" event={"ID":"39609855-c635-4538-a8ed-5e79210ee7d6","Type":"ContainerStarted","Data":"991ee87f75cfe2026c4f769162b6bbef2891e7581fcbf1520b9b13e61b1cfca6"} Jun 09 12:35:43.771950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.771907 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" event={"ID":"39609855-c635-4538-a8ed-5e79210ee7d6","Type":"ContainerStarted","Data":"3bc000f421cdf408c119e07abdd07b94abbc34d8896f3a35fc93471718a5f691"} Jun 09 12:35:43.771950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.771938 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" event={"ID":"39609855-c635-4538-a8ed-5e79210ee7d6","Type":"ContainerStarted","Data":"6142339934ed888a5734262b8f72b2eec396b9e46bcbe8107d8d175b53daa28b"} Jun 09 12:35:43.773638 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.773613 2555 generic.go:356] "Generic (PLEG): container finished" podID="a66e5190-05fc-49ca-9ab6-853c7b0586d9" containerID="69b0174d7ac7a45612f42ca55b8076fe14989e27a8339a2a3faaec48b280afe8" exitCode=0 Jun 09 12:35:43.773753 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.773670 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qg2qt" event={"ID":"a66e5190-05fc-49ca-9ab6-853c7b0586d9","Type":"ContainerDied","Data":"69b0174d7ac7a45612f42ca55b8076fe14989e27a8339a2a3faaec48b280afe8"} Jun 09 12:35:43.797116 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.797071 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5tx8v" podStartSLOduration=1.487422092 podStartE2EDuration="2.797054221s" totalImagesPullingTime="1.309632129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:43.795569133 +0000 UTC m=+251.309717243" watchObservedRunningTime="2026-06-09 12:35:43.797054221 +0000 UTC m=+251.311202306" Jun 09 12:35:43.908804 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.908779 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:43.908873 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:43.908848 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7sknt"] Jun 09 12:35:43.911101 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:43.911080 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4373d2a_4fa4_4a0a_a9a4_80b1c4debda4.slice/crio-551d68713079611a63253a4948ea551093328db72c19f47955c7ae508324d34a WatchSource:0}: Error finding container 551d68713079611a63253a4948ea551093328db72c19f47955c7ae508324d34a: Status 404 returned error can't find the container with id 551d68713079611a63253a4948ea551093328db72c19f47955c7ae508324d34a Jun 09 12:35:44.046447 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:44.046424 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b7869645b-wzvft"] Jun 09 12:35:44.048528 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:35:44.048498 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0316c1f_b6cb_48b6_a998_3f84ba4a5131.slice/crio-dd1c7e3ded43fcb1ac752caf03dd4daddaea7d7e4aea59665fee986e62681662 WatchSource:0}: Error finding container dd1c7e3ded43fcb1ac752caf03dd4daddaea7d7e4aea59665fee986e62681662: Status 404 returned error can't find the container with id dd1c7e3ded43fcb1ac752caf03dd4daddaea7d7e4aea59665fee986e62681662 Jun 09 12:35:44.780317 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:44.780268 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" event={"ID":"a0316c1f-b6cb-48b6-a998-3f84ba4a5131","Type":"ContainerStarted","Data":"dd1c7e3ded43fcb1ac752caf03dd4daddaea7d7e4aea59665fee986e62681662"} Jun 09 12:35:44.783277 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:44.783246 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qg2qt" event={"ID":"a66e5190-05fc-49ca-9ab6-853c7b0586d9","Type":"ContainerStarted","Data":"7ca19ed7d651fcbd8114c0d178580f638e68063bbe2fbe14b0649ee8ec648b40"} Jun 09 12:35:44.783390 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:44.783311 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qg2qt" event={"ID":"a66e5190-05fc-49ca-9ab6-853c7b0586d9","Type":"ContainerStarted","Data":"1c564402d5072d12a9e1a7d7d1d4faccbb9359d28ae7be02c8dadac8ce11dd31"} Jun 09 12:35:44.786068 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:44.785421 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7sknt" event={"ID":"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4","Type":"ContainerStarted","Data":"551d68713079611a63253a4948ea551093328db72c19f47955c7ae508324d34a"} Jun 09 12:35:44.827320 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:44.826562 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qg2qt" podStartSLOduration=2.7979897620000003 podStartE2EDuration="3.826539095s" totalImagesPullingTime="945.212732ms" totalInitContainerRuntime="83.336601ms" isStatefulPod=true podCreationTimestamp="2026-06-09 12:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:44.825183745 +0000 UTC m=+252.339331823" watchObservedRunningTime="2026-06-09 12:35:44.826539095 +0000 UTC m=+252.340687182" Jun 09 12:35:45.792683 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:45.792647 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7sknt" event={"ID":"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4","Type":"ContainerStarted","Data":"5e7f9fcff6040e2f026114ba4bd286061ee96b8438e971154f82fa45392711d4"} Jun 09 12:35:45.793173 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:45.792711 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7sknt" event={"ID":"f4373d2a-4fa4-4a0a-a9a4-80b1c4debda4","Type":"ContainerStarted","Data":"e2b151635e29dc395f80629c9d5a8cf692fbd8fbaef16f961e9e50b1129f89ca"} Jun 09 12:35:45.794409 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:45.794384 2555 generic.go:356] "Generic (PLEG): container finished" podID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerID="e3db9de0c9a23dad460f2aedca58031973d0293a37258a785cb7759f69c7320c" exitCode=0 Jun 09 12:35:45.794526 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:45.794413 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerDied","Data":"e3db9de0c9a23dad460f2aedca58031973d0293a37258a785cb7759f69c7320c"} Jun 09 12:35:45.817615 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:45.817560 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7sknt" podStartSLOduration=251.623265746 podStartE2EDuration="4m12.817542134s" totalImagesPullingTime="1.194276388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:45.816270003 +0000 UTC m=+253.330418115" watchObservedRunningTime="2026-06-09 12:35:45.817542134 +0000 UTC m=+253.331690219" Jun 09 12:35:46.802563 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:46.802520 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" event={"ID":"a0316c1f-b6cb-48b6-a998-3f84ba4a5131","Type":"ContainerStarted","Data":"123a376d23fa06734ba1f0c9d4575608ee7e178ec6366562801a2eb952a50d21"} Jun 09 12:35:46.802957 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:46.802626 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" event={"ID":"a0316c1f-b6cb-48b6-a998-3f84ba4a5131","Type":"ContainerStarted","Data":"8e03cd85b2c08359f2605884c03f73a66a608d54ac052a4e5e8974934b259f62"} Jun 09 12:35:46.802957 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:46.802657 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" event={"ID":"a0316c1f-b6cb-48b6-a998-3f84ba4a5131","Type":"ContainerStarted","Data":"3ae4606fa43752118abdb6560ab00dda96fa6ffa37285d07f3adef38fdb1146a"} Jun 09 12:35:47.810297 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:47.810265 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerStarted","Data":"53e308ed171ea17b750e238b72154b522a5b16aefe8affe79d671b9392818cf7"} Jun 09 12:35:47.810691 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:47.810337 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerStarted","Data":"a833f48b3d86d86064e9a15c8a8401125539a8615ced329095f82e163de8bb98"} Jun 09 12:35:47.810691 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:47.810371 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerStarted","Data":"10697d47832c6a116d1e1640756ef64bb70abf7926c4fc2336e82b98b5edfa29"} Jun 09 12:35:47.813551 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:47.813511 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" event={"ID":"a0316c1f-b6cb-48b6-a998-3f84ba4a5131","Type":"ContainerStarted","Data":"3e84f956c6faf319d000f45556baf6ecac7e6a86eaba89419d889507a65a7d60"} Jun 09 12:35:47.813652 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:47.813583 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" event={"ID":"a0316c1f-b6cb-48b6-a998-3f84ba4a5131","Type":"ContainerStarted","Data":"08603bf56ff26c9b05ce916414c2a7c5486155c80d0f734fbe3118e686114385"} Jun 09 12:35:47.813652 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:47.813629 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" event={"ID":"a0316c1f-b6cb-48b6-a998-3f84ba4a5131","Type":"ContainerStarted","Data":"818a30935b5984d229cdd5541e2c36e0cff79e3584823b1479e6a1029563392b"} Jun 09 12:35:47.813757 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:47.813705 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:35:47.844653 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:47.844598 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" podStartSLOduration=2.194407342 podStartE2EDuration="4.844579472s" totalImagesPullingTime="2.65017213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:47.842859297 +0000 UTC m=+255.357007382" watchObservedRunningTime="2026-06-09 12:35:47.844579472 +0000 UTC m=+255.358727562" Jun 09 12:35:48.821009 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:48.820976 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerStarted","Data":"f7ac195570efa6a44a749c55cd62907f17c80f654ce57e010568e2315590bbed"} Jun 09 12:35:48.821374 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:48.821062 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerStarted","Data":"5c01c53a722b41292b63b3dae4150674a39e7ad04e165903e27b111959ccaf91"} Jun 09 12:35:48.821374 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:48.821104 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerStarted","Data":"2867f9ddf66b5f1cd7ba33fc98e6f99f44fe6ba62a547ee2fc1dd4ce041a51e2"} Jun 09 12:35:48.868996 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:48.868943 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.940814261 podStartE2EDuration="6.868927071s" totalImagesPullingTime="2.907318295s" totalInitContainerRuntime="20.794515ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:48.867928079 +0000 UTC m=+256.382076164" watchObservedRunningTime="2026-06-09 12:35:48.868927071 +0000 UTC m=+256.383075156" Jun 09 12:35:53.826722 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:35:53.826652 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b7869645b-wzvft" Jun 09 12:36:11.911038 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:11.910985 2555 generic.go:356] "Generic (PLEG): container finished" podID="d57d8daf-9039-45b2-a295-18a24463c3bd" containerID="ac92f3edaa8457af37fa5db8b3385120e4b925dcc5e158478971686f37769672" exitCode=0 Jun 09 12:36:11.911519 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:11.911033 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" event={"ID":"d57d8daf-9039-45b2-a295-18a24463c3bd","Type":"ContainerDied","Data":"ac92f3edaa8457af37fa5db8b3385120e4b925dcc5e158478971686f37769672"} Jun 09 12:36:11.911519 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:11.911414 2555 scope.go:117] "RemoveContainer" containerID="ac92f3edaa8457af37fa5db8b3385120e4b925dcc5e158478971686f37769672" Jun 09 12:36:11.912722 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:11.912699 2555 generic.go:356] "Generic (PLEG): container finished" podID="a64ba593-a393-4481-8b7d-71adabdea606" containerID="34a9735cdff9abc2ad6e892d3b904a2ebf791466be683f5ec0c973ddc42b7d06" exitCode=0 Jun 09 12:36:11.912917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:11.912769 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" event={"ID":"a64ba593-a393-4481-8b7d-71adabdea606","Type":"ContainerDied","Data":"34a9735cdff9abc2ad6e892d3b904a2ebf791466be683f5ec0c973ddc42b7d06"} Jun 09 12:36:11.913099 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:11.913082 2555 scope.go:117] "RemoveContainer" containerID="34a9735cdff9abc2ad6e892d3b904a2ebf791466be683f5ec0c973ddc42b7d06" Jun 09 12:36:12.918616 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:12.918572 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jdc5v" event={"ID":"d57d8daf-9039-45b2-a295-18a24463c3bd","Type":"ContainerStarted","Data":"b320aae9b44b4ccb2e69c95ab56cac08ae0fb8ecaa7252c2086a48c306a9b547"} Jun 09 12:36:12.920325 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:12.920297 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-sr44t" event={"ID":"a64ba593-a393-4481-8b7d-71adabdea606","Type":"ContainerStarted","Data":"2288ea47b3c4edf8384afea7d0077bbee65be08c9d66aa4c588424d985d134c7"} Jun 09 12:36:13.466827 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:36:13.466784 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" podUID="1717328b-1111-46ff-937a-5cff6b493665" Jun 09 12:36:13.466827 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:36:13.466803 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pgcb7" podUID="58e7cc69-6586-4fe2-8051-01ff87f28b2b" Jun 09 12:36:13.925372 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:13.925341 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgcb7" Jun 09 12:36:13.925810 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:13.925341 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:36:17.346495 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.346450 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:36:17.346964 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.346553 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:36:17.348912 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.348882 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58e7cc69-6586-4fe2-8051-01ff87f28b2b-metrics-tls\") pod \"dns-default-pgcb7\" (UID: \"58e7cc69-6586-4fe2-8051-01ff87f28b2b\") " pod="openshift-dns/dns-default-pgcb7" Jun 09 12:36:17.349023 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.348968 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"image-registry-6c5c7c7f74-5kbxc\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:36:17.530460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.530430 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b8l29\"" Jun 09 12:36:17.530460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.530430 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n2brk\"" Jun 09 12:36:17.536854 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.536834 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgcb7" Jun 09 12:36:17.536936 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.536872 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:36:17.680204 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.680172 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pgcb7"] Jun 09 12:36:17.686521 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:36:17.686493 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e7cc69_6586_4fe2_8051_01ff87f28b2b.slice/crio-3014d82e5edd02dd9a39a66c3140eacdaa47f9367c74f38171dccf1f507c33db WatchSource:0}: Error finding container 3014d82e5edd02dd9a39a66c3140eacdaa47f9367c74f38171dccf1f507c33db: Status 404 returned error can't find the container with id 3014d82e5edd02dd9a39a66c3140eacdaa47f9367c74f38171dccf1f507c33db Jun 09 12:36:17.703733 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.703712 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5c7c7f74-5kbxc"] Jun 09 12:36:17.705622 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:36:17.705599 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1717328b_1111_46ff_937a_5cff6b493665.slice/crio-69fabeb471dae94993276d5ff8b1e3b81fccf1ec92453820f3439e9692c410a6 WatchSource:0}: Error finding container 69fabeb471dae94993276d5ff8b1e3b81fccf1ec92453820f3439e9692c410a6: Status 404 returned error can't find the container with id 69fabeb471dae94993276d5ff8b1e3b81fccf1ec92453820f3439e9692c410a6 Jun 09 12:36:17.942853 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.942765 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" event={"ID":"1717328b-1111-46ff-937a-5cff6b493665","Type":"ContainerStarted","Data":"43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e"} Jun 09 12:36:17.942853 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.942813 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" event={"ID":"1717328b-1111-46ff-937a-5cff6b493665","Type":"ContainerStarted","Data":"69fabeb471dae94993276d5ff8b1e3b81fccf1ec92453820f3439e9692c410a6"} Jun 09 12:36:17.943115 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.942852 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:36:17.944094 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:17.944072 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgcb7" event={"ID":"58e7cc69-6586-4fe2-8051-01ff87f28b2b","Type":"ContainerStarted","Data":"3014d82e5edd02dd9a39a66c3140eacdaa47f9367c74f38171dccf1f507c33db"} Jun 09 12:36:20.962184 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:20.962149 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgcb7" event={"ID":"58e7cc69-6586-4fe2-8051-01ff87f28b2b","Type":"ContainerStarted","Data":"07b47e0ac47d390879ebcc1a01dac314d430b9f8bacfe27383f3746f32af3108"} Jun 09 12:36:20.962573 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:20.962212 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgcb7" event={"ID":"58e7cc69-6586-4fe2-8051-01ff87f28b2b","Type":"ContainerStarted","Data":"0ddd8c612097b0a1c3245fee445201ce22d936e74f552cf50a80531813abbed7"} Jun 09 12:36:20.962573 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:20.962240 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pgcb7" Jun 09 12:36:20.978380 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:20.978321 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" podStartSLOduration=287.978306795 podStartE2EDuration="4m47.978306795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:36:17.965269487 +0000 UTC m=+285.479417584" watchObservedRunningTime="2026-06-09 12:36:20.978306795 +0000 UTC m=+288.492454881" Jun 09 12:36:20.978966 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:20.978937 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pgcb7" podStartSLOduration=251.445667911 podStartE2EDuration="4m13.978924802s" totalImagesPullingTime="2.533256891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:36:20.978261842 +0000 UTC m=+288.492409931" watchObservedRunningTime="2026-06-09 12:36:20.978924802 +0000 UTC m=+288.493072889" Jun 09 12:36:26.984320 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:26.984279 2555 generic.go:356] "Generic (PLEG): container finished" podID="6fbd7ff6-c8e4-4284-9534-83bb1c63c731" containerID="ce9b1b43e93e817245dbaafd7ae7e6a32465598bbaf122353f596b7812e20469" exitCode=0 Jun 09 12:36:26.984820 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:26.984352 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fnvcd" event={"ID":"6fbd7ff6-c8e4-4284-9534-83bb1c63c731","Type":"ContainerDied","Data":"ce9b1b43e93e817245dbaafd7ae7e6a32465598bbaf122353f596b7812e20469"} Jun 09 12:36:26.984820 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:26.984775 2555 scope.go:117] "RemoveContainer" containerID="ce9b1b43e93e817245dbaafd7ae7e6a32465598bbaf122353f596b7812e20469" Jun 09 12:36:27.990856 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:27.990816 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fnvcd" event={"ID":"6fbd7ff6-c8e4-4284-9534-83bb1c63c731","Type":"ContainerStarted","Data":"f5d39b89e50dd32e95c1e01291141edaf5387fda172c80f7f5fa03b2e166dcfe"} Jun 09 12:36:29.996709 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:29.996679 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce5d65c0-e821-409c-9b0d-33f6b41924c2/init-config-reloader/0.log" Jun 09 12:36:30.196208 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:30.196175 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce5d65c0-e821-409c-9b0d-33f6b41924c2/alertmanager/0.log" Jun 09 12:36:30.403216 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:30.403188 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce5d65c0-e821-409c-9b0d-33f6b41924c2/config-reloader/0.log" Jun 09 12:36:30.597021 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:30.596984 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce5d65c0-e821-409c-9b0d-33f6b41924c2/kube-rbac-proxy-web/0.log" Jun 09 12:36:30.799312 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:30.799241 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce5d65c0-e821-409c-9b0d-33f6b41924c2/kube-rbac-proxy/0.log" Jun 09 12:36:30.965265 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:30.965176 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pgcb7" Jun 09 12:36:31.003655 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:31.003165 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce5d65c0-e821-409c-9b0d-33f6b41924c2/kube-rbac-proxy-metric/0.log" Jun 09 12:36:31.195839 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:31.195807 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce5d65c0-e821-409c-9b0d-33f6b41924c2/prom-label-proxy/0.log" Jun 09 12:36:31.397958 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:31.397923 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-rjkw5_13b42da2-bc96-4e3e-a072-29f0119aed46/cluster-monitoring-operator/0.log" Jun 09 12:36:31.596207 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:31.596177 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5tx8v_39609855-c635-4538-a8ed-5e79210ee7d6/kube-state-metrics/0.log" Jun 09 12:36:31.796284 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:31.796259 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5tx8v_39609855-c635-4538-a8ed-5e79210ee7d6/kube-rbac-proxy-main/0.log" Jun 09 12:36:31.996172 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:31.996102 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5tx8v_39609855-c635-4538-a8ed-5e79210ee7d6/kube-rbac-proxy-self/0.log" Jun 09 12:36:32.912400 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:32.912374 2555 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 12:36:33.800296 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:33.800269 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qg2qt_a66e5190-05fc-49ca-9ab6-853c7b0586d9/init-textfile/0.log" Jun 09 12:36:33.997205 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:33.997178 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qg2qt_a66e5190-05fc-49ca-9ab6-853c7b0586d9/node-exporter/0.log" Jun 09 12:36:34.196775 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:34.196746 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qg2qt_a66e5190-05fc-49ca-9ab6-853c7b0586d9/kube-rbac-proxy/0.log" Jun 09 12:36:36.402717 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:36.402691 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7v2l6_41eab9ac-7e6a-44d5-b9e9-44d003064cf6/prometheus-operator/0.log" Jun 09 12:36:36.596664 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:36.596633 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7v2l6_41eab9ac-7e6a-44d5-b9e9-44d003064cf6/kube-rbac-proxy/0.log" Jun 09 12:36:36.800063 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:36.799961 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-xbldf_874b7331-81de-4c95-8783-48fc879b50dc/prometheus-operator-admission-webhook/0.log" Jun 09 12:36:36.996704 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:36.996675 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/thanos-query/0.log" Jun 09 12:36:37.202566 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:37.202539 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/kube-rbac-proxy-web/0.log" Jun 09 12:36:37.407263 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:37.407234 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/kube-rbac-proxy/0.log" Jun 09 12:36:37.541657 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:37.541580 2555 patch_prober.go:28] interesting pod/image-registry-6c5c7c7f74-5kbxc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:36:37.541657 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:37.541631 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" podUID="1717328b-1111-46ff-937a-5cff6b493665" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:36:37.600204 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:37.600179 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/prom-label-proxy/0.log" Jun 09 12:36:37.797192 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:37.797125 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/kube-rbac-proxy-rules/0.log" Jun 09 12:36:37.998577 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:37.998546 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/kube-rbac-proxy-metrics/0.log" Jun 09 12:36:38.196742 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:38.196712 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-pzw2l_43afa927-47d9-4912-8f71-aaf254512973/networking-console-plugin/0.log" Jun 09 12:36:38.952971 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:38.952944 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:36:39.395567 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:39.395537 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgcb7_58e7cc69-6586-4fe2-8051-01ff87f28b2b/dns/0.log" Jun 09 12:36:39.596806 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:39.596776 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgcb7_58e7cc69-6586-4fe2-8051-01ff87f28b2b/kube-rbac-proxy/0.log" Jun 09 12:36:40.995892 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:40.995863 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5262_90eff6cf-05c0-47be-a6f2-40f689890444/dns-node-resolver/0.log" Jun 09 12:36:41.196105 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:41.196059 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c5c7c7f74-5kbxc_1717328b-1111-46ff-937a-5cff6b493665/registry/0.log" Jun 09 12:36:41.595821 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:41.595794 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjbzc_defc77c1-b17f-4f7e-b81d-fe817b6423f4/node-ca/0.log" Jun 09 12:36:42.599882 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:42.599852 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lhhw2_2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217/serve-healthcheck-canary/0.log" Jun 09 12:36:56.809565 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:36:56.809530 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c5c7c7f74-5kbxc"] Jun 09 12:37:01.912517 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:01.912481 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:37:01.913049 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:01.912767 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="alertmanager" containerID="cri-o://10697d47832c6a116d1e1640756ef64bb70abf7926c4fc2336e82b98b5edfa29" gracePeriod=120 Jun 09 12:37:01.913049 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:01.912834 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy-metric" containerID="cri-o://5c01c53a722b41292b63b3dae4150674a39e7ad04e165903e27b111959ccaf91" gracePeriod=120 Jun 09 12:37:01.913049 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:01.912899 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="prom-label-proxy" containerID="cri-o://f7ac195570efa6a44a749c55cd62907f17c80f654ce57e010568e2315590bbed" gracePeriod=120 Jun 09 12:37:01.913049 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:01.912880 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy-web" containerID="cri-o://53e308ed171ea17b750e238b72154b522a5b16aefe8affe79d671b9392818cf7" gracePeriod=120 Jun 09 12:37:01.913049 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:01.912941 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy" containerID="cri-o://2867f9ddf66b5f1cd7ba33fc98e6f99f44fe6ba62a547ee2fc1dd4ce041a51e2" gracePeriod=120 Jun 09 12:37:01.913049 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:01.912880 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="config-reloader" containerID="cri-o://a833f48b3d86d86064e9a15c8a8401125539a8615ced329095f82e163de8bb98" gracePeriod=120 Jun 09 12:37:02.138811 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:02.138782 2555 generic.go:356] "Generic (PLEG): container finished" podID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerID="f7ac195570efa6a44a749c55cd62907f17c80f654ce57e010568e2315590bbed" exitCode=0 Jun 09 12:37:02.138811 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:02.138804 2555 generic.go:356] "Generic (PLEG): container finished" podID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerID="2867f9ddf66b5f1cd7ba33fc98e6f99f44fe6ba62a547ee2fc1dd4ce041a51e2" exitCode=0 Jun 09 12:37:02.138811 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:02.138810 2555 generic.go:356] "Generic (PLEG): container finished" podID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerID="a833f48b3d86d86064e9a15c8a8401125539a8615ced329095f82e163de8bb98" exitCode=0 Jun 09 12:37:02.138811 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:02.138815 2555 generic.go:356] "Generic (PLEG): container finished" podID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerID="10697d47832c6a116d1e1640756ef64bb70abf7926c4fc2336e82b98b5edfa29" exitCode=0 Jun 09 12:37:02.139080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:02.138850 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerDied","Data":"f7ac195570efa6a44a749c55cd62907f17c80f654ce57e010568e2315590bbed"} Jun 09 12:37:02.139080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:02.138909 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerDied","Data":"2867f9ddf66b5f1cd7ba33fc98e6f99f44fe6ba62a547ee2fc1dd4ce041a51e2"} Jun 09 12:37:02.139080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:02.138934 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerDied","Data":"a833f48b3d86d86064e9a15c8a8401125539a8615ced329095f82e163de8bb98"} Jun 09 12:37:02.139080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:02.138959 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerDied","Data":"10697d47832c6a116d1e1640756ef64bb70abf7926c4fc2336e82b98b5edfa29"} Jun 09 12:37:03.146307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.146281 2555 generic.go:356] "Generic (PLEG): container finished" podID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerID="5c01c53a722b41292b63b3dae4150674a39e7ad04e165903e27b111959ccaf91" exitCode=0 Jun 09 12:37:03.146307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.146301 2555 generic.go:356] "Generic (PLEG): container finished" podID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerID="53e308ed171ea17b750e238b72154b522a5b16aefe8affe79d671b9392818cf7" exitCode=0 Jun 09 12:37:03.146664 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.146364 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerDied","Data":"5c01c53a722b41292b63b3dae4150674a39e7ad04e165903e27b111959ccaf91"} Jun 09 12:37:03.146664 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.146454 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerDied","Data":"53e308ed171ea17b750e238b72154b522a5b16aefe8affe79d671b9392818cf7"} Jun 09 12:37:03.146664 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.146500 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce5d65c0-e821-409c-9b0d-33f6b41924c2","Type":"ContainerDied","Data":"5f228debfce8d43af8cbfab9928b8ae806baf7e368621175f2b78f1dfd888559"} Jun 09 12:37:03.146664 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.146534 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f228debfce8d43af8cbfab9928b8ae806baf7e368621175f2b78f1dfd888559" Jun 09 12:37:03.158032 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.157989 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:03.234477 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234448 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-out\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.234659 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234486 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-main-db\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.234659 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234513 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk2m8\" (UniqueName: \"kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-kube-api-access-rk2m8\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.234659 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234544 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-metrics-client-ca\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.234659 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234563 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.234659 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234580 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-main-tls\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.234659 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234600 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-volume\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.234659 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234628 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-trusted-ca-bundle\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.235048 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234807 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-tls-assets\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.235048 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234836 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:37:03.235048 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234917 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-web-config\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.235048 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234958 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.235048 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234992 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-cluster-tls-config\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.235048 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.234994 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:03.235048 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.235040 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\" (UID: \"ce5d65c0-e821-409c-9b0d-33f6b41924c2\") " Jun 09 12:37:03.235411 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.235310 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-metrics-client-ca\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.235411 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.235328 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-main-db\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.236515 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.235975 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:03.238034 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.237971 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-out" (OuterVolumeSpecName: "config-out") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:37:03.238149 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.238076 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:37:03.238214 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.238185 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:03.238214 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.238192 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-kube-api-access-rk2m8" (OuterVolumeSpecName: "kube-api-access-rk2m8") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "kube-api-access-rk2m8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:37:03.238563 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.238540 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:03.238967 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.238935 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:03.239234 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.239204 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:03.239670 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.239642 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-volume" (OuterVolumeSpecName: "config-volume") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:03.243858 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.243798 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:03.250844 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.250823 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-web-config" (OuterVolumeSpecName: "web-config") pod "ce5d65c0-e821-409c-9b0d-33f6b41924c2" (UID: "ce5d65c0-e821-409c-9b0d-33f6b41924c2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:03.336347 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336305 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d65c0-e821-409c-9b0d-33f6b41924c2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.336347 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336343 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-tls-assets\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.336347 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336356 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-web-config\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.336532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336370 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.336532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336383 2555 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-cluster-tls-config\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.336532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336392 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.336532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336402 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-out\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.336532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336410 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk2m8\" (UniqueName: \"kubernetes.io/projected/ce5d65c0-e821-409c-9b0d-33f6b41924c2-kube-api-access-rk2m8\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.336532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336418 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.336532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336427 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-secret-alertmanager-main-tls\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:03.336532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:03.336434 2555 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce5d65c0-e821-409c-9b0d-33f6b41924c2-config-volume\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:04.150316 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.150279 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.174504 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.174477 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:37:04.182600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.182573 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:37:04.212808 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.212782 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:37:04.213128 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213112 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="init-config-reloader" Jun 09 12:37:04.213189 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213132 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="init-config-reloader" Jun 09 12:37:04.213189 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213148 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="alertmanager" Jun 09 12:37:04.213189 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213155 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="alertmanager" Jun 09 12:37:04.213189 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213161 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="config-reloader" Jun 09 12:37:04.213189 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213167 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="config-reloader" Jun 09 12:37:04.213189 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213175 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy-web" Jun 09 12:37:04.213189 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213180 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy-web" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213196 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy-metric" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213205 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy-metric" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213215 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="prom-label-proxy" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213220 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="prom-label-proxy" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213228 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213232 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213279 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="prom-label-proxy" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213289 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy-metric" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213297 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="config-reloader" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213304 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy-web" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213310 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="kube-rbac-proxy" Jun 09 12:37:04.213391 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.213315 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" containerName="alertmanager" Jun 09 12:37:04.218147 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.218126 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.220963 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.220942 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 12:37:04.220963 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.220957 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 12:37:04.221193 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.221175 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 12:37:04.221253 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.221236 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 12:37:04.221313 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.221256 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9gv2n\"" Jun 09 12:37:04.221313 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.221267 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 12:37:04.221409 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.221316 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 12:37:04.221409 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.221372 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 12:37:04.221597 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.221579 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 12:37:04.227763 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.227746 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 12:37:04.235988 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.235966 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:37:04.243838 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.243818 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e06d88e-f0be-4fca-81b7-d47ff01cf046-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.243940 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.243856 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.243940 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.243876 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e06d88e-f0be-4fca-81b7-d47ff01cf046-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.243940 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.243903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.244067 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.243958 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.244067 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.243995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.244132 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.244065 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.244132 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.244105 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e06d88e-f0be-4fca-81b7-d47ff01cf046-config-out\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.244132 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.244120 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e06d88e-f0be-4fca-81b7-d47ff01cf046-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.244224 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.244134 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5plww\" (UniqueName: \"kubernetes.io/projected/2e06d88e-f0be-4fca-81b7-d47ff01cf046-kube-api-access-5plww\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.244224 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.244153 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.244224 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.244204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-web-config\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.244224 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.244219 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e06d88e-f0be-4fca-81b7-d47ff01cf046-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.345510 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345481 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-web-config\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.345687 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e06d88e-f0be-4fca-81b7-d47ff01cf046-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.345687 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345535 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e06d88e-f0be-4fca-81b7-d47ff01cf046-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.345687 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345570 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.345687 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345588 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e06d88e-f0be-4fca-81b7-d47ff01cf046-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.345687 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345610 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.345687 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345626 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.345687 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345651 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.346093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345689 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.346093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345732 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e06d88e-f0be-4fca-81b7-d47ff01cf046-config-out\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.346093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e06d88e-f0be-4fca-81b7-d47ff01cf046-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.346093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345777 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5plww\" (UniqueName: \"kubernetes.io/projected/2e06d88e-f0be-4fca-81b7-d47ff01cf046-kube-api-access-5plww\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.346093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.345800 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.346093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.346042 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e06d88e-f0be-4fca-81b7-d47ff01cf046-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.347175 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.346852 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e06d88e-f0be-4fca-81b7-d47ff01cf046-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.347281 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.347229 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e06d88e-f0be-4fca-81b7-d47ff01cf046-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.348654 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.348632 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e06d88e-f0be-4fca-81b7-d47ff01cf046-config-out\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.349066 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.349014 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.349252 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.349216 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-web-config\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.349387 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.349366 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e06d88e-f0be-4fca-81b7-d47ff01cf046-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.349467 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.349446 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.349570 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.349555 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.350227 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.350205 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.350367 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.350351 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.350570 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.350553 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e06d88e-f0be-4fca-81b7-d47ff01cf046-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.354961 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.354943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5plww\" (UniqueName: \"kubernetes.io/projected/2e06d88e-f0be-4fca-81b7-d47ff01cf046-kube-api-access-5plww\") pod \"alertmanager-main-0\" (UID: \"2e06d88e-f0be-4fca-81b7-d47ff01cf046\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.529512 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.529476 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:37:04.666376 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.666350 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:37:04.668205 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:37:04.668180 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e06d88e_f0be_4fca_81b7_d47ff01cf046.slice/crio-e892171db23d879a621a898d33fb9499a64f01f04bbc8e3a83c7885c03a85767 WatchSource:0}: Error finding container e892171db23d879a621a898d33fb9499a64f01f04bbc8e3a83c7885c03a85767: Status 404 returned error can't find the container with id e892171db23d879a621a898d33fb9499a64f01f04bbc8e3a83c7885c03a85767 Jun 09 12:37:04.963041 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:04.962937 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce5d65c0-e821-409c-9b0d-33f6b41924c2" path="/var/lib/kubelet/pods/ce5d65c0-e821-409c-9b0d-33f6b41924c2/volumes" Jun 09 12:37:05.155257 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.155220 2555 generic.go:356] "Generic (PLEG): container finished" podID="2e06d88e-f0be-4fca-81b7-d47ff01cf046" containerID="1d863815b02ebd2b44e0c53a65ccfdc01dd4c4699ab55ee2866d7ebba6bf1d81" exitCode=0 Jun 09 12:37:05.155678 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.155311 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e06d88e-f0be-4fca-81b7-d47ff01cf046","Type":"ContainerDied","Data":"1d863815b02ebd2b44e0c53a65ccfdc01dd4c4699ab55ee2866d7ebba6bf1d81"} Jun 09 12:37:05.155678 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.155376 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e06d88e-f0be-4fca-81b7-d47ff01cf046","Type":"ContainerStarted","Data":"e892171db23d879a621a898d33fb9499a64f01f04bbc8e3a83c7885c03a85767"} Jun 09 12:37:05.984214 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.984181 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-dd5c68d4-vqxck"] Jun 09 12:37:05.987654 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.987633 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:05.991016 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.990968 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 12:37:05.991142 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.991031 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 12:37:05.991142 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.991038 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qdhtj\"" Jun 09 12:37:05.991142 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.991120 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 12:37:05.991307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.991159 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 12:37:05.991307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.991249 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 12:37:05.996286 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:05.996267 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 12:37:06.003898 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.003874 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dd5c68d4-vqxck"] Jun 09 12:37:06.061980 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.061940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.061980 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.061985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f25845-9f76-407f-8e23-647e4d51282a-metrics-client-ca\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.062229 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.062034 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-secret-telemeter-client\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.062229 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.062100 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f25845-9f76-407f-8e23-647e4d51282a-serving-certs-ca-bundle\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.062229 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.062140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-federate-client-tls\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.062229 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.062161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f25845-9f76-407f-8e23-647e4d51282a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.062229 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.062177 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc9mv\" (UniqueName: \"kubernetes.io/projected/70f25845-9f76-407f-8e23-647e4d51282a-kube-api-access-vc9mv\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.062396 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.062291 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-telemeter-client-tls\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.162812 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.162781 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-telemeter-client-tls\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.163299 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.162827 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.163299 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.162870 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f25845-9f76-407f-8e23-647e4d51282a-metrics-client-ca\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.163299 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.162899 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-secret-telemeter-client\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.163299 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.162962 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f25845-9f76-407f-8e23-647e4d51282a-serving-certs-ca-bundle\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.163299 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.162985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-federate-client-tls\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.163299 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.163037 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f25845-9f76-407f-8e23-647e4d51282a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.163299 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.163060 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc9mv\" (UniqueName: \"kubernetes.io/projected/70f25845-9f76-407f-8e23-647e4d51282a-kube-api-access-vc9mv\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.164290 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.163848 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f25845-9f76-407f-8e23-647e4d51282a-metrics-client-ca\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.164290 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.164199 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f25845-9f76-407f-8e23-647e4d51282a-serving-certs-ca-bundle\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.164876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.164495 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e06d88e-f0be-4fca-81b7-d47ff01cf046","Type":"ContainerStarted","Data":"a3469169258aa1ced13cdfdb828f1451808bbe0b2008bea79c135f04b249daf3"} Jun 09 12:37:06.164876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.164572 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e06d88e-f0be-4fca-81b7-d47ff01cf046","Type":"ContainerStarted","Data":"b5d52c52b83c550ef593d2c7598f7d79c3e96afdce84467cb4a166e145b5c643"} Jun 09 12:37:06.164876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.164613 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e06d88e-f0be-4fca-81b7-d47ff01cf046","Type":"ContainerStarted","Data":"9e79d107df9726b2b0746e62b0d5923567e92eb1067613792b5bf7101a534295"} Jun 09 12:37:06.164876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.164658 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e06d88e-f0be-4fca-81b7-d47ff01cf046","Type":"ContainerStarted","Data":"8dab3c2013e8a76daf8655a9347a20641be80df6deacddbe20d11fbd32337614"} Jun 09 12:37:06.164876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.164696 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e06d88e-f0be-4fca-81b7-d47ff01cf046","Type":"ContainerStarted","Data":"8b20994dcb0db6e9111800c6fb4621d35462a317bc535ce37a207b6ea3a9f0b7"} Jun 09 12:37:06.164876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.164739 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e06d88e-f0be-4fca-81b7-d47ff01cf046","Type":"ContainerStarted","Data":"c4370b57a2b536ecb1f9c157a5603a90f7fab5359d252f53dcec0aab0e15f09b"} Jun 09 12:37:06.164876 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.164693 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f25845-9f76-407f-8e23-647e4d51282a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.165925 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.165899 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-telemeter-client-tls\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.166033 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.165953 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.166087 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.166044 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-secret-telemeter-client\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.166686 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.166669 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70f25845-9f76-407f-8e23-647e4d51282a-federate-client-tls\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.172308 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.172286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc9mv\" (UniqueName: \"kubernetes.io/projected/70f25845-9f76-407f-8e23-647e4d51282a-kube-api-access-vc9mv\") pod \"telemeter-client-dd5c68d4-vqxck\" (UID: \"70f25845-9f76-407f-8e23-647e4d51282a\") " pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.192407 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.192359 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.180634528 podStartE2EDuration="2.192339756s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.705228ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:37:06.190758149 +0000 UTC m=+333.704906236" watchObservedRunningTime="2026-06-09 12:37:06.192339756 +0000 UTC m=+333.706487843" Jun 09 12:37:06.310390 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.310296 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" Jun 09 12:37:06.472850 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.472818 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dd5c68d4-vqxck"] Jun 09 12:37:06.477546 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:37:06.477515 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f25845_9f76_407f_8e23_647e4d51282a.slice/crio-71585ce5cd1aaed62fae97ddcd88b7b77704c616b6d4c5d3e06dcef388b5e33d WatchSource:0}: Error finding container 71585ce5cd1aaed62fae97ddcd88b7b77704c616b6d4c5d3e06dcef388b5e33d: Status 404 returned error can't find the container with id 71585ce5cd1aaed62fae97ddcd88b7b77704c616b6d4c5d3e06dcef388b5e33d Jun 09 12:37:06.479196 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:06.479177 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:37:07.170329 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:07.170293 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" event={"ID":"70f25845-9f76-407f-8e23-647e4d51282a","Type":"ContainerStarted","Data":"71585ce5cd1aaed62fae97ddcd88b7b77704c616b6d4c5d3e06dcef388b5e33d"} Jun 09 12:37:09.188067 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:09.188035 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" event={"ID":"70f25845-9f76-407f-8e23-647e4d51282a","Type":"ContainerStarted","Data":"77636b60ed820fe27824444192a7c994a0ce921855c697684913b99ec64b7852"} Jun 09 12:37:09.188517 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:09.188103 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" event={"ID":"70f25845-9f76-407f-8e23-647e4d51282a","Type":"ContainerStarted","Data":"a5a3fe2e7a42be64b9597d2efb6d6086ccf18704b83be4ed3ad3b27aec0f9d96"} Jun 09 12:37:09.188517 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:09.188133 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" event={"ID":"70f25845-9f76-407f-8e23-647e4d51282a","Type":"ContainerStarted","Data":"7c47d4a8cd2d0e522b5530979379283fe343d24921b4e0bd987cfe0ebbaf1edc"} Jun 09 12:37:09.217753 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:09.217698 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-dd5c68d4-vqxck" podStartSLOduration=2.148571848 podStartE2EDuration="4.217683454s" totalImagesPullingTime="2.069111606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:37:09.216556027 +0000 UTC m=+336.730704112" watchObservedRunningTime="2026-06-09 12:37:09.217683454 +0000 UTC m=+336.731831541" Jun 09 12:37:21.829982 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:21.829877 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" podUID="1717328b-1111-46ff-937a-5cff6b493665" containerName="registry" containerID="cri-o://43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e" gracePeriod=30 Jun 09 12:37:22.083839 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.083780 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:37:22.208513 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.208476 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-image-registry-private-configuration\") pod \"1717328b-1111-46ff-937a-5cff6b493665\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " Jun 09 12:37:22.208513 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.208515 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-installation-pull-secrets\") pod \"1717328b-1111-46ff-937a-5cff6b493665\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " Jun 09 12:37:22.208748 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.208542 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlrnk\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-kube-api-access-mlrnk\") pod \"1717328b-1111-46ff-937a-5cff6b493665\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " Jun 09 12:37:22.208748 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.208591 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-trusted-ca\") pod \"1717328b-1111-46ff-937a-5cff6b493665\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " Jun 09 12:37:22.208748 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.208613 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-registry-certificates\") pod \"1717328b-1111-46ff-937a-5cff6b493665\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " Jun 09 12:37:22.208748 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.208630 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1717328b-1111-46ff-937a-5cff6b493665-ca-trust-extracted\") pod \"1717328b-1111-46ff-937a-5cff6b493665\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " Jun 09 12:37:22.208748 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.208686 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") pod \"1717328b-1111-46ff-937a-5cff6b493665\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " Jun 09 12:37:22.208748 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.208715 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-bound-sa-token\") pod \"1717328b-1111-46ff-937a-5cff6b493665\" (UID: \"1717328b-1111-46ff-937a-5cff6b493665\") " Jun 09 12:37:22.209187 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.209155 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1717328b-1111-46ff-937a-5cff6b493665" (UID: "1717328b-1111-46ff-937a-5cff6b493665"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:22.209600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.209522 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1717328b-1111-46ff-937a-5cff6b493665" (UID: "1717328b-1111-46ff-937a-5cff6b493665"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:22.211303 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.211259 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1717328b-1111-46ff-937a-5cff6b493665" (UID: "1717328b-1111-46ff-937a-5cff6b493665"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:37:22.211405 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.211340 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1717328b-1111-46ff-937a-5cff6b493665" (UID: "1717328b-1111-46ff-937a-5cff6b493665"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:22.211503 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.211478 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-kube-api-access-mlrnk" (OuterVolumeSpecName: "kube-api-access-mlrnk") pod "1717328b-1111-46ff-937a-5cff6b493665" (UID: "1717328b-1111-46ff-937a-5cff6b493665"). InnerVolumeSpecName "kube-api-access-mlrnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:37:22.211621 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.211567 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1717328b-1111-46ff-937a-5cff6b493665" (UID: "1717328b-1111-46ff-937a-5cff6b493665"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:37:22.211747 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.211721 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1717328b-1111-46ff-937a-5cff6b493665" (UID: "1717328b-1111-46ff-937a-5cff6b493665"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:22.217283 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.217257 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1717328b-1111-46ff-937a-5cff6b493665-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1717328b-1111-46ff-937a-5cff6b493665" (UID: "1717328b-1111-46ff-937a-5cff6b493665"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:37:22.243770 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.243741 2555 generic.go:356] "Generic (PLEG): container finished" podID="1717328b-1111-46ff-937a-5cff6b493665" containerID="43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e" exitCode=0 Jun 09 12:37:22.243886 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.243788 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" Jun 09 12:37:22.243886 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.243804 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" event={"ID":"1717328b-1111-46ff-937a-5cff6b493665","Type":"ContainerDied","Data":"43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e"} Jun 09 12:37:22.243886 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.243844 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5c7c7f74-5kbxc" event={"ID":"1717328b-1111-46ff-937a-5cff6b493665","Type":"ContainerDied","Data":"69fabeb471dae94993276d5ff8b1e3b81fccf1ec92453820f3439e9692c410a6"} Jun 09 12:37:22.243886 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.243862 2555 scope.go:117] "RemoveContainer" containerID="43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e" Jun 09 12:37:22.253027 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.252982 2555 scope.go:117] "RemoveContainer" containerID="43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e" Jun 09 12:37:22.253262 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:37:22.253246 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e\": container with ID starting with 43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e not found: ID does not exist" containerID="43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e" Jun 09 12:37:22.253318 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.253269 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e"} err="failed to get container status \"43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e\": rpc error: code = NotFound desc = could not find container \"43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e\": container with ID starting with 43609d18f60c7e6c6479d604d10c4a1f973221f9f6a06975d4fed06a292e745e not found: ID does not exist" Jun 09 12:37:22.266187 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.266166 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c5c7c7f74-5kbxc"] Jun 09 12:37:22.270195 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.270178 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c5c7c7f74-5kbxc"] Jun 09 12:37:22.309439 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.309414 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-trusted-ca\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:22.309439 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.309437 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1717328b-1111-46ff-937a-5cff6b493665-registry-certificates\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:22.309567 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.309447 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1717328b-1111-46ff-937a-5cff6b493665-ca-trust-extracted\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:22.309567 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.309457 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-registry-tls\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:22.309567 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.309466 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-bound-sa-token\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:22.309567 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.309475 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-image-registry-private-configuration\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:22.309567 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.309484 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1717328b-1111-46ff-937a-5cff6b493665-installation-pull-secrets\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:22.309567 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.309493 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlrnk\" (UniqueName: \"kubernetes.io/projected/1717328b-1111-46ff-937a-5cff6b493665-kube-api-access-mlrnk\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:37:22.964073 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:37:22.964041 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1717328b-1111-46ff-937a-5cff6b493665" path="/var/lib/kubelet/pods/1717328b-1111-46ff-937a-5cff6b493665/volumes" Jun 09 12:40:06.507854 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.507818 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5"] Jun 09 12:40:06.508347 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.508166 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1717328b-1111-46ff-937a-5cff6b493665" containerName="registry" Jun 09 12:40:06.508347 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.508177 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1717328b-1111-46ff-937a-5cff6b493665" containerName="registry" Jun 09 12:40:06.508347 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.508237 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1717328b-1111-46ff-937a-5cff6b493665" containerName="registry" Jun 09 12:40:06.511039 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.511019 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" Jun 09 12:40:06.514513 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.514483 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 12:40:06.514640 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.514494 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:40:06.514640 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.514530 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gms62\"" Jun 09 12:40:06.529563 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.528292 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5"] Jun 09 12:40:06.599877 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.599833 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20dcd618-f011-4b9d-b394-7a13821edfce-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7mrg5\" (UID: \"20dcd618-f011-4b9d-b394-7a13821edfce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" Jun 09 12:40:06.600093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.599898 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26wvx\" (UniqueName: \"kubernetes.io/projected/20dcd618-f011-4b9d-b394-7a13821edfce-kube-api-access-26wvx\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7mrg5\" (UID: \"20dcd618-f011-4b9d-b394-7a13821edfce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" Jun 09 12:40:06.700767 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.700731 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20dcd618-f011-4b9d-b394-7a13821edfce-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7mrg5\" (UID: \"20dcd618-f011-4b9d-b394-7a13821edfce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" Jun 09 12:40:06.700917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.700787 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26wvx\" (UniqueName: \"kubernetes.io/projected/20dcd618-f011-4b9d-b394-7a13821edfce-kube-api-access-26wvx\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7mrg5\" (UID: \"20dcd618-f011-4b9d-b394-7a13821edfce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" Jun 09 12:40:06.701146 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.701124 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20dcd618-f011-4b9d-b394-7a13821edfce-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7mrg5\" (UID: \"20dcd618-f011-4b9d-b394-7a13821edfce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" Jun 09 12:40:06.709966 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.709932 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26wvx\" (UniqueName: \"kubernetes.io/projected/20dcd618-f011-4b9d-b394-7a13821edfce-kube-api-access-26wvx\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7mrg5\" (UID: \"20dcd618-f011-4b9d-b394-7a13821edfce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" Jun 09 12:40:06.819917 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.819830 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" Jun 09 12:40:06.968879 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:06.968849 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5"] Jun 09 12:40:06.971242 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:40:06.971209 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20dcd618_f011_4b9d_b394_7a13821edfce.slice/crio-825198087cf6a5df3ecd0ec579f0868f82c82a1f5bdf9f136412dba5e22dbe7e WatchSource:0}: Error finding container 825198087cf6a5df3ecd0ec579f0868f82c82a1f5bdf9f136412dba5e22dbe7e: Status 404 returned error can't find the container with id 825198087cf6a5df3ecd0ec579f0868f82c82a1f5bdf9f136412dba5e22dbe7e Jun 09 12:40:07.928782 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:07.928749 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" event={"ID":"20dcd618-f011-4b9d-b394-7a13821edfce","Type":"ContainerStarted","Data":"825198087cf6a5df3ecd0ec579f0868f82c82a1f5bdf9f136412dba5e22dbe7e"} Jun 09 12:40:10.946089 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:10.946050 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" event={"ID":"20dcd618-f011-4b9d-b394-7a13821edfce","Type":"ContainerStarted","Data":"0e73cb59a081544dc7951bb70510b2bf65f698be517bcd6fdb3f0ceb79fa86c8"} Jun 09 12:40:10.994390 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:10.994340 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7mrg5" podStartSLOduration=1.662364246 podStartE2EDuration="4.994323888s" totalImagesPullingTime="3.331959642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:40:10.990993529 +0000 UTC m=+518.505141616" watchObservedRunningTime="2026-06-09 12:40:10.994323888 +0000 UTC m=+518.508471973" Jun 09 12:40:12.690265 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.690229 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4"] Jun 09 12:40:12.694011 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.693982 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" Jun 09 12:40:12.697663 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.697643 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rtlzt\"" Jun 09 12:40:12.697927 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.697912 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 12:40:12.698905 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.698882 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 12:40:12.707362 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.707323 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4"] Jun 09 12:40:12.749256 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.749224 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nrbt4\" (UID: \"b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" Jun 09 12:40:12.749256 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.749257 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7kxl\" (UniqueName: \"kubernetes.io/projected/b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0-kube-api-access-f7kxl\") pod \"cert-manager-webhook-7dc76cbb94-nrbt4\" (UID: \"b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" Jun 09 12:40:12.850314 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.850279 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nrbt4\" (UID: \"b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" Jun 09 12:40:12.850314 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.850325 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7kxl\" (UniqueName: \"kubernetes.io/projected/b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0-kube-api-access-f7kxl\") pod \"cert-manager-webhook-7dc76cbb94-nrbt4\" (UID: \"b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" Jun 09 12:40:12.865490 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.865467 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nrbt4\" (UID: \"b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" Jun 09 12:40:12.865685 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:12.865662 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7kxl\" (UniqueName: \"kubernetes.io/projected/b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0-kube-api-access-f7kxl\") pod \"cert-manager-webhook-7dc76cbb94-nrbt4\" (UID: \"b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" Jun 09 12:40:13.017470 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:13.017385 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" Jun 09 12:40:13.166501 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:13.166472 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4"] Jun 09 12:40:13.168431 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:40:13.168396 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb38bf665_c6a7_4a3c_8192_fef1d7b8d7b0.slice/crio-620ad6dec13df707fb2a81515d393558242daa86e4d631591a6d44168fed61f0 WatchSource:0}: Error finding container 620ad6dec13df707fb2a81515d393558242daa86e4d631591a6d44168fed61f0: Status 404 returned error can't find the container with id 620ad6dec13df707fb2a81515d393558242daa86e4d631591a6d44168fed61f0 Jun 09 12:40:13.962745 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:13.962711 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" event={"ID":"b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0","Type":"ContainerStarted","Data":"620ad6dec13df707fb2a81515d393558242daa86e4d631591a6d44168fed61f0"} Jun 09 12:40:15.973023 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:15.972967 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" event={"ID":"b38bf665-c6a7-4a3c-8192-fef1d7b8d7b0","Type":"ContainerStarted","Data":"5ed925220ba7daf9669136d69ad24a32e93ad4c56acc845d1b7001b4b2060391"} Jun 09 12:40:15.973385 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:15.973100 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" Jun 09 12:40:16.004501 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:16.004444 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" podStartSLOduration=1.302304313 podStartE2EDuration="4.004429091s" totalImagesPullingTime="2.702124778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:40:16.003131326 +0000 UTC m=+523.517279411" watchObservedRunningTime="2026-06-09 12:40:16.004429091 +0000 UTC m=+523.518577176" Jun 09 12:40:18.970760 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:18.970720 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr"] Jun 09 12:40:18.974326 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:18.974303 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" Jun 09 12:40:18.977264 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:18.977239 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-k2lfw\"" Jun 09 12:40:18.983438 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:18.983415 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr"] Jun 09 12:40:19.009622 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:19.009589 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73a5e7ae-3135-4c2f-a8bd-2556de61e0f3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lv7cr\" (UID: \"73a5e7ae-3135-4c2f-a8bd-2556de61e0f3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" Jun 09 12:40:19.009788 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:19.009760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cc4f\" (UniqueName: \"kubernetes.io/projected/73a5e7ae-3135-4c2f-a8bd-2556de61e0f3-kube-api-access-6cc4f\") pod \"cert-manager-cainjector-5d99449ffd-lv7cr\" (UID: \"73a5e7ae-3135-4c2f-a8bd-2556de61e0f3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" Jun 09 12:40:19.110241 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:19.110199 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cc4f\" (UniqueName: \"kubernetes.io/projected/73a5e7ae-3135-4c2f-a8bd-2556de61e0f3-kube-api-access-6cc4f\") pod \"cert-manager-cainjector-5d99449ffd-lv7cr\" (UID: \"73a5e7ae-3135-4c2f-a8bd-2556de61e0f3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" Jun 09 12:40:19.110420 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:19.110266 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73a5e7ae-3135-4c2f-a8bd-2556de61e0f3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lv7cr\" (UID: \"73a5e7ae-3135-4c2f-a8bd-2556de61e0f3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" Jun 09 12:40:19.122626 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:19.122587 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cc4f\" (UniqueName: \"kubernetes.io/projected/73a5e7ae-3135-4c2f-a8bd-2556de61e0f3-kube-api-access-6cc4f\") pod \"cert-manager-cainjector-5d99449ffd-lv7cr\" (UID: \"73a5e7ae-3135-4c2f-a8bd-2556de61e0f3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" Jun 09 12:40:19.122965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:19.122931 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73a5e7ae-3135-4c2f-a8bd-2556de61e0f3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lv7cr\" (UID: \"73a5e7ae-3135-4c2f-a8bd-2556de61e0f3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" Jun 09 12:40:19.284111 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:19.284023 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" Jun 09 12:40:19.424565 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:19.424540 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr"] Jun 09 12:40:19.427063 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:40:19.427034 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73a5e7ae_3135_4c2f_a8bd_2556de61e0f3.slice/crio-bf224c643628018077b08b887d9525d0c3c16d8d6f0a354c6ed9f8f62e77c1be WatchSource:0}: Error finding container bf224c643628018077b08b887d9525d0c3c16d8d6f0a354c6ed9f8f62e77c1be: Status 404 returned error can't find the container with id bf224c643628018077b08b887d9525d0c3c16d8d6f0a354c6ed9f8f62e77c1be Jun 09 12:40:19.994518 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:19.994484 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" event={"ID":"73a5e7ae-3135-4c2f-a8bd-2556de61e0f3","Type":"ContainerStarted","Data":"dbc5d6c0252acba7570cd46b1b004263f0bc388e70ae1a96f385174762e42a22"} Jun 09 12:40:19.994518 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:19.994521 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" event={"ID":"73a5e7ae-3135-4c2f-a8bd-2556de61e0f3","Type":"ContainerStarted","Data":"bf224c643628018077b08b887d9525d0c3c16d8d6f0a354c6ed9f8f62e77c1be"} Jun 09 12:40:20.019996 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:20.019935 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lv7cr" podStartSLOduration=2.019916477 podStartE2EDuration="2.019916477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:40:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:40:20.019381705 +0000 UTC m=+527.533529820" watchObservedRunningTime="2026-06-09 12:40:20.019916477 +0000 UTC m=+527.534064565" Jun 09 12:40:21.980522 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:21.980486 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nrbt4" Jun 09 12:40:31.566611 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.566575 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-h6dmn"] Jun 09 12:40:31.569844 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.569823 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-h6dmn" Jun 09 12:40:31.572557 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.572537 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-28v6r\"" Jun 09 12:40:31.582491 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.582469 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-h6dmn"] Jun 09 12:40:31.624825 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.624786 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53ec656c-6de5-4c43-b8be-1640a5f5f434-bound-sa-token\") pod \"cert-manager-59c77684cc-h6dmn\" (UID: \"53ec656c-6de5-4c43-b8be-1640a5f5f434\") " pod="cert-manager/cert-manager-59c77684cc-h6dmn" Jun 09 12:40:31.624825 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.624821 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4nk4\" (UniqueName: \"kubernetes.io/projected/53ec656c-6de5-4c43-b8be-1640a5f5f434-kube-api-access-t4nk4\") pod \"cert-manager-59c77684cc-h6dmn\" (UID: \"53ec656c-6de5-4c43-b8be-1640a5f5f434\") " pod="cert-manager/cert-manager-59c77684cc-h6dmn" Jun 09 12:40:31.725874 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.725839 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53ec656c-6de5-4c43-b8be-1640a5f5f434-bound-sa-token\") pod \"cert-manager-59c77684cc-h6dmn\" (UID: \"53ec656c-6de5-4c43-b8be-1640a5f5f434\") " pod="cert-manager/cert-manager-59c77684cc-h6dmn" Jun 09 12:40:31.725874 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.725875 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4nk4\" (UniqueName: \"kubernetes.io/projected/53ec656c-6de5-4c43-b8be-1640a5f5f434-kube-api-access-t4nk4\") pod \"cert-manager-59c77684cc-h6dmn\" (UID: \"53ec656c-6de5-4c43-b8be-1640a5f5f434\") " pod="cert-manager/cert-manager-59c77684cc-h6dmn" Jun 09 12:40:31.739776 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.739746 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53ec656c-6de5-4c43-b8be-1640a5f5f434-bound-sa-token\") pod \"cert-manager-59c77684cc-h6dmn\" (UID: \"53ec656c-6de5-4c43-b8be-1640a5f5f434\") " pod="cert-manager/cert-manager-59c77684cc-h6dmn" Jun 09 12:40:31.743032 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.742989 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4nk4\" (UniqueName: \"kubernetes.io/projected/53ec656c-6de5-4c43-b8be-1640a5f5f434-kube-api-access-t4nk4\") pod \"cert-manager-59c77684cc-h6dmn\" (UID: \"53ec656c-6de5-4c43-b8be-1640a5f5f434\") " pod="cert-manager/cert-manager-59c77684cc-h6dmn" Jun 09 12:40:31.879751 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:31.879716 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-h6dmn" Jun 09 12:40:32.016585 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:32.016558 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-h6dmn"] Jun 09 12:40:32.018907 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:40:32.018873 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53ec656c_6de5_4c43_b8be_1640a5f5f434.slice/crio-63e1679b19c4150c5822f3442f493205f2d650611ac1eccc6c588ab94819ccd4 WatchSource:0}: Error finding container 63e1679b19c4150c5822f3442f493205f2d650611ac1eccc6c588ab94819ccd4: Status 404 returned error can't find the container with id 63e1679b19c4150c5822f3442f493205f2d650611ac1eccc6c588ab94819ccd4 Jun 09 12:40:32.050498 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:32.050403 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-h6dmn" event={"ID":"53ec656c-6de5-4c43-b8be-1640a5f5f434","Type":"ContainerStarted","Data":"63e1679b19c4150c5822f3442f493205f2d650611ac1eccc6c588ab94819ccd4"} Jun 09 12:40:33.056733 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:33.056696 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-h6dmn" event={"ID":"53ec656c-6de5-4c43-b8be-1640a5f5f434","Type":"ContainerStarted","Data":"3ddda000da08b1d3ec823c08c9263d75a3fbbc890b46105b92f2e50ff443114e"} Jun 09 12:40:33.086988 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:33.086931 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-h6dmn" podStartSLOduration=2.086912888 podStartE2EDuration="2.086912888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:40:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:40:33.086386713 +0000 UTC m=+540.600534799" watchObservedRunningTime="2026-06-09 12:40:33.086912888 +0000 UTC m=+540.601060974" Jun 09 12:40:42.260911 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.260875 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn"] Jun 09 12:40:42.267363 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.267343 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.285023 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.284970 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 12:40:42.285132 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.285023 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 12:40:42.285132 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.285064 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 12:40:42.286156 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.286140 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 12:40:42.286342 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.286144 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2wp74\"" Jun 09 12:40:42.321465 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.321435 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn"] Jun 09 12:40:42.428311 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.428275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.428311 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.428314 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-tmp\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.428543 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.428419 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-manifests\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.428543 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.428459 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2tnn\" (UniqueName: \"kubernetes.io/projected/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-kube-api-access-b2tnn\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.428543 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.428506 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.529877 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.529784 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-manifests\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.529877 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.529831 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tnn\" (UniqueName: \"kubernetes.io/projected/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-kube-api-access-b2tnn\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.529877 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.529868 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.530191 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.529911 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.530191 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.529936 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-tmp\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.530344 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.530306 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-manifests\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.532444 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.532412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-tmp\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.532593 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.532574 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.532717 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.532697 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.542618 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.542596 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2tnn\" (UniqueName: \"kubernetes.io/projected/db1e4702-b20a-4e5d-98cd-76684cdaa9fc-kube-api-access-b2tnn\") pod \"opendatahub-operator-controller-manager-6b4c856db4-54whn\" (UID: \"db1e4702-b20a-4e5d-98cd-76684cdaa9fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.577614 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.577579 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:42.739107 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:42.739079 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn"] Jun 09 12:40:42.741096 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:40:42.741071 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1e4702_b20a_4e5d_98cd_76684cdaa9fc.slice/crio-926c80d6f33be510133c49ac4ad92c1f171c3facc6fd629e67a21a83680429f5 WatchSource:0}: Error finding container 926c80d6f33be510133c49ac4ad92c1f171c3facc6fd629e67a21a83680429f5: Status 404 returned error can't find the container with id 926c80d6f33be510133c49ac4ad92c1f171c3facc6fd629e67a21a83680429f5 Jun 09 12:40:43.105881 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:43.105842 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" event={"ID":"db1e4702-b20a-4e5d-98cd-76684cdaa9fc","Type":"ContainerStarted","Data":"926c80d6f33be510133c49ac4ad92c1f171c3facc6fd629e67a21a83680429f5"} Jun 09 12:40:46.124089 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:46.124052 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" event={"ID":"db1e4702-b20a-4e5d-98cd-76684cdaa9fc","Type":"ContainerStarted","Data":"366a7d3a08e838895e176f48bde7f1b23f48c443359ed7c9eb09d37ae85ded78"} Jun 09 12:40:47.130270 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:47.130235 2555 generic.go:356] "Generic (PLEG): container finished" podID="db1e4702-b20a-4e5d-98cd-76684cdaa9fc" containerID="366a7d3a08e838895e176f48bde7f1b23f48c443359ed7c9eb09d37ae85ded78" exitCode=0 Jun 09 12:40:47.130678 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:47.130307 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" event={"ID":"db1e4702-b20a-4e5d-98cd-76684cdaa9fc","Type":"ContainerDied","Data":"366a7d3a08e838895e176f48bde7f1b23f48c443359ed7c9eb09d37ae85ded78"} Jun 09 12:40:48.137804 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:48.137765 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" event={"ID":"db1e4702-b20a-4e5d-98cd-76684cdaa9fc","Type":"ContainerStarted","Data":"9da7062282f2761ec58a08bedfa6a955dd1f6d5a5ff62dc805f3acedba1118f4"} Jun 09 12:40:48.138221 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:48.137891 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:40:48.166853 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:48.166801 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" podStartSLOduration=1.914077715 podStartE2EDuration="6.166780251s" totalImagesPullingTime="3.257795126s" totalInitContainerRuntime="994.90741ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:40:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:40:48.163773226 +0000 UTC m=+555.677921311" watchObservedRunningTime="2026-06-09 12:40:48.166780251 +0000 UTC m=+555.680928338" Jun 09 12:40:59.145262 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:40:59.145232 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-54whn" Jun 09 12:41:04.742864 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.742822 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4"] Jun 09 12:41:04.746588 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.746565 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.749311 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.749288 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 12:41:04.750283 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.750261 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-njs8q\"" Jun 09 12:41:04.750388 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.750316 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 12:41:04.750388 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.750320 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 12:41:04.750388 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.750352 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:04.750388 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.750374 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 12:41:04.770042 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.769995 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4"] Jun 09 12:41:04.830062 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.829992 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f8177db-d999-42dc-aea5-706f63092da3-metrics-cert\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.830247 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.830132 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl8p2\" (UniqueName: \"kubernetes.io/projected/8f8177db-d999-42dc-aea5-706f63092da3-kube-api-access-xl8p2\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.830247 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.830181 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f8177db-d999-42dc-aea5-706f63092da3-cert\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.830247 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.830212 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f8177db-d999-42dc-aea5-706f63092da3-manager-config\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.931550 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.931497 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl8p2\" (UniqueName: \"kubernetes.io/projected/8f8177db-d999-42dc-aea5-706f63092da3-kube-api-access-xl8p2\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.931550 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.931556 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f8177db-d999-42dc-aea5-706f63092da3-cert\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.931777 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.931683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f8177db-d999-42dc-aea5-706f63092da3-manager-config\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.931777 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.931764 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f8177db-d999-42dc-aea5-706f63092da3-metrics-cert\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.932362 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.932337 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f8177db-d999-42dc-aea5-706f63092da3-manager-config\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.934258 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.934231 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f8177db-d999-42dc-aea5-706f63092da3-metrics-cert\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.934356 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.934267 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f8177db-d999-42dc-aea5-706f63092da3-cert\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:04.940894 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:04.940873 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl8p2\" (UniqueName: \"kubernetes.io/projected/8f8177db-d999-42dc-aea5-706f63092da3-kube-api-access-xl8p2\") pod \"lws-controller-manager-b48576bd-lbgz4\" (UID: \"8f8177db-d999-42dc-aea5-706f63092da3\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:05.056519 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:05.056437 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:05.208490 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:05.208464 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4"] Jun 09 12:41:05.211114 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:41:05.211087 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8177db_d999_42dc_aea5_706f63092da3.slice/crio-246f794c8fb954dc14388ea111e550bf488d445159b77c35db597b3d63781c0f WatchSource:0}: Error finding container 246f794c8fb954dc14388ea111e550bf488d445159b77c35db597b3d63781c0f: Status 404 returned error can't find the container with id 246f794c8fb954dc14388ea111e550bf488d445159b77c35db597b3d63781c0f Jun 09 12:41:05.222031 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:05.221981 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" event={"ID":"8f8177db-d999-42dc-aea5-706f63092da3","Type":"ContainerStarted","Data":"246f794c8fb954dc14388ea111e550bf488d445159b77c35db597b3d63781c0f"} Jun 09 12:41:08.241248 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:08.241213 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" event={"ID":"8f8177db-d999-42dc-aea5-706f63092da3","Type":"ContainerStarted","Data":"6737a338a9af46a8c094e5ea76d533b7aaae147fafb55406d179f6c05e2be2d2"} Jun 09 12:41:08.241715 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:08.241276 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:08.266231 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:08.266165 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" podStartSLOduration=1.805112021 podStartE2EDuration="4.266147119s" totalImagesPullingTime="2.461035098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:08.265631775 +0000 UTC m=+575.779779866" watchObservedRunningTime="2026-06-09 12:41:08.266147119 +0000 UTC m=+575.780295205" Jun 09 12:41:19.247782 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:19.247750 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b48576bd-lbgz4" Jun 09 12:41:32.261765 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.261726 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5fd759c44c-9fvmw"] Jun 09 12:41:32.270327 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.270306 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" Jun 09 12:41:32.274246 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.274211 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rbmrz\"" Jun 09 12:41:32.274575 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.274552 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 12:41:32.278428 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.278404 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5fd759c44c-9fvmw"] Jun 09 12:41:32.293869 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.293839 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j9qq\" (UniqueName: \"kubernetes.io/projected/3e3af169-5542-40ca-ae0d-b7237764b66b-kube-api-access-2j9qq\") pod \"dashboard-redirect-5fd759c44c-9fvmw\" (UID: \"3e3af169-5542-40ca-ae0d-b7237764b66b\") " pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" Jun 09 12:41:32.294061 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.293891 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3e3af169-5542-40ca-ae0d-b7237764b66b-redirect-config\") pod \"dashboard-redirect-5fd759c44c-9fvmw\" (UID: \"3e3af169-5542-40ca-ae0d-b7237764b66b\") " pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" Jun 09 12:41:32.395160 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.395119 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3e3af169-5542-40ca-ae0d-b7237764b66b-redirect-config\") pod \"dashboard-redirect-5fd759c44c-9fvmw\" (UID: \"3e3af169-5542-40ca-ae0d-b7237764b66b\") " pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" Jun 09 12:41:32.395332 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.395224 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j9qq\" (UniqueName: \"kubernetes.io/projected/3e3af169-5542-40ca-ae0d-b7237764b66b-kube-api-access-2j9qq\") pod \"dashboard-redirect-5fd759c44c-9fvmw\" (UID: \"3e3af169-5542-40ca-ae0d-b7237764b66b\") " pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" Jun 09 12:41:32.395793 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.395773 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3e3af169-5542-40ca-ae0d-b7237764b66b-redirect-config\") pod \"dashboard-redirect-5fd759c44c-9fvmw\" (UID: \"3e3af169-5542-40ca-ae0d-b7237764b66b\") " pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" Jun 09 12:41:32.404033 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.403978 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j9qq\" (UniqueName: \"kubernetes.io/projected/3e3af169-5542-40ca-ae0d-b7237764b66b-kube-api-access-2j9qq\") pod \"dashboard-redirect-5fd759c44c-9fvmw\" (UID: \"3e3af169-5542-40ca-ae0d-b7237764b66b\") " pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" Jun 09 12:41:32.583554 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.583477 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" Jun 09 12:41:32.730221 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:41:32.730193 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3af169_5542_40ca_ae0d_b7237764b66b.slice/crio-b723ec6bac48b76833705d29721c9b7c0f7a29cd2dc14cc0a944f0452fb59918 WatchSource:0}: Error finding container b723ec6bac48b76833705d29721c9b7c0f7a29cd2dc14cc0a944f0452fb59918: Status 404 returned error can't find the container with id b723ec6bac48b76833705d29721c9b7c0f7a29cd2dc14cc0a944f0452fb59918 Jun 09 12:41:32.730407 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:32.730384 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5fd759c44c-9fvmw"] Jun 09 12:41:33.371897 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:33.371855 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" event={"ID":"3e3af169-5542-40ca-ae0d-b7237764b66b","Type":"ContainerStarted","Data":"b723ec6bac48b76833705d29721c9b7c0f7a29cd2dc14cc0a944f0452fb59918"} Jun 09 12:41:36.391804 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:36.391769 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" event={"ID":"3e3af169-5542-40ca-ae0d-b7237764b66b","Type":"ContainerStarted","Data":"ee7885202f27878e5383f76ac0038708c4c12dd28b20b7d6be133bb185ec7be4"} Jun 09 12:41:36.410226 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:36.410170 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5fd759c44c-9fvmw" podStartSLOduration=1.370910968 podStartE2EDuration="4.41015645s" totalImagesPullingTime="3.039245482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:36.408846305 +0000 UTC m=+603.922994404" watchObservedRunningTime="2026-06-09 12:41:36.41015645 +0000 UTC m=+603.924304536" Jun 09 12:41:52.629160 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.629071 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5"] Jun 09 12:41:52.632780 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.632761 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.635754 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.635721 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 12:41:52.635754 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.635746 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qsfz6\"" Jun 09 12:41:52.635950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.635731 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 12:41:52.635950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.635848 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 12:41:52.650044 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.649988 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.650203 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.650051 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d28b518-3f0d-4971-a800-44002bde7a7d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.650203 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.650072 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.650203 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.650096 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.650203 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.650112 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l5cr\" (UniqueName: \"kubernetes.io/projected/7d28b518-3f0d-4971-a800-44002bde7a7d-kube-api-access-5l5cr\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.650203 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.650195 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.650459 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.650239 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.650459 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.650274 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.650459 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.650317 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.651078 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.651042 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5"] Jun 09 12:41:52.751791 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.751743 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.751791 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.751788 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d28b518-3f0d-4971-a800-44002bde7a7d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.751816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.751848 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.751874 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l5cr\" (UniqueName: \"kubernetes.io/projected/7d28b518-3f0d-4971-a800-44002bde7a7d-kube-api-access-5l5cr\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.751925 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.751974 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.752042 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752383 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.752112 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752383 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.752341 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752556 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.752533 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752626 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.752597 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752626 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.752611 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.752710 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.752645 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d28b518-3f0d-4971-a800-44002bde7a7d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.754695 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.754673 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.754774 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.754704 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.760890 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.760861 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l5cr\" (UniqueName: \"kubernetes.io/projected/7d28b518-3f0d-4971-a800-44002bde7a7d-kube-api-access-5l5cr\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.760974 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.760906 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d28b518-3f0d-4971-a800-44002bde7a7d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5\" (UID: \"7d28b518-3f0d-4971-a800-44002bde7a7d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:52.943799 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:52.943706 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:53.096970 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:53.096945 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5"] Jun 09 12:41:53.099245 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:41:53.099217 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d28b518_3f0d_4971_a800_44002bde7a7d.slice/crio-b0083b45c7b691a9e1610fb6b27abefc498845ef1bb7780bda553f32dfc39f0a WatchSource:0}: Error finding container b0083b45c7b691a9e1610fb6b27abefc498845ef1bb7780bda553f32dfc39f0a: Status 404 returned error can't find the container with id b0083b45c7b691a9e1610fb6b27abefc498845ef1bb7780bda553f32dfc39f0a Jun 09 12:41:53.475827 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:53.475787 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" event={"ID":"7d28b518-3f0d-4971-a800-44002bde7a7d","Type":"ContainerStarted","Data":"b0083b45c7b691a9e1610fb6b27abefc498845ef1bb7780bda553f32dfc39f0a"} Jun 09 12:41:56.219585 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:56.219551 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 09 12:41:56.219837 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:56.219632 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 09 12:41:56.219837 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:56.219662 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 09 12:41:56.494460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:56.494383 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" event={"ID":"7d28b518-3f0d-4971-a800-44002bde7a7d","Type":"ContainerStarted","Data":"d84663de35517632014f92df18f20ba572f3ab3ec32a1bdc16c46d2fc8028818"} Jun 09 12:41:56.519129 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:56.519064 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" podStartSLOduration=1.40113984 podStartE2EDuration="4.519041899s" totalImagesPullingTime="3.117902059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:56.515561149 +0000 UTC m=+624.029709234" watchObservedRunningTime="2026-06-09 12:41:56.519041899 +0000 UTC m=+624.033189986" Jun 09 12:41:56.944822 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:56.944788 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:57.949155 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:57.949127 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:58.505544 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:58.505513 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:41:58.506522 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:41:58.506498 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5" Jun 09 12:42:03.036297 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.036263 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvjr8"] Jun 09 12:42:03.039776 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.039757 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" Jun 09 12:42:03.045716 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.045657 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:42:03.047440 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.047388 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:42:03.047585 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.047468 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rsqck\"" Jun 09 12:42:03.055037 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.054977 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvjr8"] Jun 09 12:42:03.145140 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.145103 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82njh\" (UniqueName: \"kubernetes.io/projected/d0045804-4e37-4f98-b836-c9a9271017ae-kube-api-access-82njh\") pod \"kuadrant-operator-catalog-lvjr8\" (UID: \"d0045804-4e37-4f98-b836-c9a9271017ae\") " pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" Jun 09 12:42:03.245832 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.245790 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82njh\" (UniqueName: \"kubernetes.io/projected/d0045804-4e37-4f98-b836-c9a9271017ae-kube-api-access-82njh\") pod \"kuadrant-operator-catalog-lvjr8\" (UID: \"d0045804-4e37-4f98-b836-c9a9271017ae\") " pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" Jun 09 12:42:03.267664 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.267629 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82njh\" (UniqueName: \"kubernetes.io/projected/d0045804-4e37-4f98-b836-c9a9271017ae-kube-api-access-82njh\") pod \"kuadrant-operator-catalog-lvjr8\" (UID: \"d0045804-4e37-4f98-b836-c9a9271017ae\") " pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" Jun 09 12:42:03.350738 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.350704 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" Jun 09 12:42:03.380788 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.380755 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvjr8"] Jun 09 12:42:03.492685 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.492649 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvjr8"] Jun 09 12:42:03.496095 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:42:03.496057 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0045804_4e37_4f98_b836_c9a9271017ae.slice/crio-00692990b72cd2927a9b021312f62935a008e80e8bcafcfc6f40001b5f170adb WatchSource:0}: Error finding container 00692990b72cd2927a9b021312f62935a008e80e8bcafcfc6f40001b5f170adb: Status 404 returned error can't find the container with id 00692990b72cd2927a9b021312f62935a008e80e8bcafcfc6f40001b5f170adb Jun 09 12:42:03.531246 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.531213 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" event={"ID":"d0045804-4e37-4f98-b836-c9a9271017ae","Type":"ContainerStarted","Data":"00692990b72cd2927a9b021312f62935a008e80e8bcafcfc6f40001b5f170adb"} Jun 09 12:42:03.593369 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.593333 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgb8k"] Jun 09 12:42:03.598411 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.598372 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" Jun 09 12:42:03.605657 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.605581 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgb8k"] Jun 09 12:42:03.648677 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.648630 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w65fv\" (UniqueName: \"kubernetes.io/projected/751c18bb-ff7d-48e5-936a-e00803de6e31-kube-api-access-w65fv\") pod \"kuadrant-operator-catalog-jgb8k\" (UID: \"751c18bb-ff7d-48e5-936a-e00803de6e31\") " pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" Jun 09 12:42:03.750140 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.750093 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w65fv\" (UniqueName: \"kubernetes.io/projected/751c18bb-ff7d-48e5-936a-e00803de6e31-kube-api-access-w65fv\") pod \"kuadrant-operator-catalog-jgb8k\" (UID: \"751c18bb-ff7d-48e5-936a-e00803de6e31\") " pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" Jun 09 12:42:03.762342 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.762308 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w65fv\" (UniqueName: \"kubernetes.io/projected/751c18bb-ff7d-48e5-936a-e00803de6e31-kube-api-access-w65fv\") pod \"kuadrant-operator-catalog-jgb8k\" (UID: \"751c18bb-ff7d-48e5-936a-e00803de6e31\") " pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" Jun 09 12:42:03.910360 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:03.910268 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" Jun 09 12:42:04.057163 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:04.057139 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgb8k"] Jun 09 12:42:04.099286 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:42:04.099246 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751c18bb_ff7d_48e5_936a_e00803de6e31.slice/crio-ab2769fd8c4d72166aeb76a9e5244673a3fd896346a5a63018e2e33927e5ad84 WatchSource:0}: Error finding container ab2769fd8c4d72166aeb76a9e5244673a3fd896346a5a63018e2e33927e5ad84: Status 404 returned error can't find the container with id ab2769fd8c4d72166aeb76a9e5244673a3fd896346a5a63018e2e33927e5ad84 Jun 09 12:42:04.536910 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:04.536869 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" event={"ID":"751c18bb-ff7d-48e5-936a-e00803de6e31","Type":"ContainerStarted","Data":"ab2769fd8c4d72166aeb76a9e5244673a3fd896346a5a63018e2e33927e5ad84"} Jun 09 12:42:06.549492 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:06.549456 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" event={"ID":"d0045804-4e37-4f98-b836-c9a9271017ae","Type":"ContainerStarted","Data":"8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580"} Jun 09 12:42:06.549985 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:06.549534 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" podUID="d0045804-4e37-4f98-b836-c9a9271017ae" containerName="registry-server" containerID="cri-o://8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580" gracePeriod=2 Jun 09 12:42:06.551362 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:06.551339 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" event={"ID":"751c18bb-ff7d-48e5-936a-e00803de6e31","Type":"ContainerStarted","Data":"c2093d967107ad96ec5de12214da20c0858bd2683624537154da0ef964457131"} Jun 09 12:42:06.587294 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:06.587236 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" podStartSLOduration=1.176711706 podStartE2EDuration="3.587220634s" totalImagesPullingTime="2.410508928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:06.586182291 +0000 UTC m=+634.100330376" watchObservedRunningTime="2026-06-09 12:42:06.587220634 +0000 UTC m=+634.101368720" Jun 09 12:42:06.621282 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:06.621225 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" podStartSLOduration=1.818522325 podStartE2EDuration="3.621210172s" totalImagesPullingTime="1.802687847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:06.620844127 +0000 UTC m=+634.134992212" watchObservedRunningTime="2026-06-09 12:42:06.621210172 +0000 UTC m=+634.135358257" Jun 09 12:42:06.796492 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:06.796469 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" Jun 09 12:42:06.880963 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:06.880923 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82njh\" (UniqueName: \"kubernetes.io/projected/d0045804-4e37-4f98-b836-c9a9271017ae-kube-api-access-82njh\") pod \"d0045804-4e37-4f98-b836-c9a9271017ae\" (UID: \"d0045804-4e37-4f98-b836-c9a9271017ae\") " Jun 09 12:42:06.883279 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:06.883254 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0045804-4e37-4f98-b836-c9a9271017ae-kube-api-access-82njh" (OuterVolumeSpecName: "kube-api-access-82njh") pod "d0045804-4e37-4f98-b836-c9a9271017ae" (UID: "d0045804-4e37-4f98-b836-c9a9271017ae"). InnerVolumeSpecName "kube-api-access-82njh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:06.981735 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:06.981706 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82njh\" (UniqueName: \"kubernetes.io/projected/d0045804-4e37-4f98-b836-c9a9271017ae-kube-api-access-82njh\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:42:07.557449 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:07.557414 2555 generic.go:356] "Generic (PLEG): container finished" podID="d0045804-4e37-4f98-b836-c9a9271017ae" containerID="8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580" exitCode=0 Jun 09 12:42:07.557950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:07.557468 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" Jun 09 12:42:07.557950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:07.557507 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" event={"ID":"d0045804-4e37-4f98-b836-c9a9271017ae","Type":"ContainerDied","Data":"8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580"} Jun 09 12:42:07.557950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:07.557602 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvjr8" event={"ID":"d0045804-4e37-4f98-b836-c9a9271017ae","Type":"ContainerDied","Data":"00692990b72cd2927a9b021312f62935a008e80e8bcafcfc6f40001b5f170adb"} Jun 09 12:42:07.557950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:07.557632 2555 scope.go:117] "RemoveContainer" containerID="8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580" Jun 09 12:42:07.567389 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:07.567368 2555 scope.go:117] "RemoveContainer" containerID="8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580" Jun 09 12:42:07.567661 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:07.567642 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580\": container with ID starting with 8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580 not found: ID does not exist" containerID="8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580" Jun 09 12:42:07.567714 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:07.567671 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580"} err="failed to get container status \"8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580\": rpc error: code = NotFound desc = could not find container \"8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580\": container with ID starting with 8ef52854283c1dabc4e4c451b4417b5ca295409c0b8db08ce697b1d461d50580 not found: ID does not exist" Jun 09 12:42:07.589601 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:07.589568 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvjr8"] Jun 09 12:42:07.593532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:07.593502 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvjr8"] Jun 09 12:42:08.963892 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:08.963858 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0045804-4e37-4f98-b836-c9a9271017ae" path="/var/lib/kubelet/pods/d0045804-4e37-4f98-b836-c9a9271017ae/volumes" Jun 09 12:42:13.910647 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:13.910617 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" Jun 09 12:42:13.911186 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:13.910717 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" Jun 09 12:42:13.933503 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:13.933477 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" Jun 09 12:42:14.617881 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:14.617853 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jgb8k" Jun 09 12:42:31.740623 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:31.740589 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47"] Jun 09 12:42:31.741096 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:31.740983 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0045804-4e37-4f98-b836-c9a9271017ae" containerName="registry-server" Jun 09 12:42:31.741096 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:31.740994 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0045804-4e37-4f98-b836-c9a9271017ae" containerName="registry-server" Jun 09 12:42:31.741096 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:31.741088 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0045804-4e37-4f98-b836-c9a9271017ae" containerName="registry-server" Jun 09 12:42:31.751289 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:31.751264 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:31.755154 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:31.755129 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pc67l\"" Jun 09 12:42:31.763968 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:31.763943 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47"] Jun 09 12:42:31.912495 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:31.912460 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e25203ab-cd92-4ade-9236-e7d97486b207-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" (UID: \"e25203ab-cd92-4ade-9236-e7d97486b207\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:31.912495 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:31.912503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcfht\" (UniqueName: \"kubernetes.io/projected/e25203ab-cd92-4ade-9236-e7d97486b207-kube-api-access-pcfht\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" (UID: \"e25203ab-cd92-4ade-9236-e7d97486b207\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:32.014072 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.013953 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e25203ab-cd92-4ade-9236-e7d97486b207-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" (UID: \"e25203ab-cd92-4ade-9236-e7d97486b207\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:32.014072 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.013993 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcfht\" (UniqueName: \"kubernetes.io/projected/e25203ab-cd92-4ade-9236-e7d97486b207-kube-api-access-pcfht\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" (UID: \"e25203ab-cd92-4ade-9236-e7d97486b207\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:32.014354 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.014332 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e25203ab-cd92-4ade-9236-e7d97486b207-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" (UID: \"e25203ab-cd92-4ade-9236-e7d97486b207\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:32.026563 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.026534 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcfht\" (UniqueName: \"kubernetes.io/projected/e25203ab-cd92-4ade-9236-e7d97486b207-kube-api-access-pcfht\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" (UID: \"e25203ab-cd92-4ade-9236-e7d97486b207\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:32.062540 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.062506 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:32.216070 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.215996 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47"] Jun 09 12:42:32.218716 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:42:32.218678 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25203ab_cd92_4ade_9236_e7d97486b207.slice/crio-667ae961c1d2a868a951e47f987092b207eab577ff0598aadfacd43c0f4a5336 WatchSource:0}: Error finding container 667ae961c1d2a868a951e47f987092b207eab577ff0598aadfacd43c0f4a5336: Status 404 returned error can't find the container with id 667ae961c1d2a868a951e47f987092b207eab577ff0598aadfacd43c0f4a5336 Jun 09 12:42:32.221198 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.221179 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:42:32.689624 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.689591 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" event={"ID":"e25203ab-cd92-4ade-9236-e7d97486b207","Type":"ContainerStarted","Data":"667ae961c1d2a868a951e47f987092b207eab577ff0598aadfacd43c0f4a5336"} Jun 09 12:42:32.939859 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.939776 2555 scope.go:117] "RemoveContainer" containerID="2867f9ddf66b5f1cd7ba33fc98e6f99f44fe6ba62a547ee2fc1dd4ce041a51e2" Jun 09 12:42:32.948310 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.948291 2555 scope.go:117] "RemoveContainer" containerID="f7ac195570efa6a44a749c55cd62907f17c80f654ce57e010568e2315590bbed" Jun 09 12:42:32.956523 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.956503 2555 scope.go:117] "RemoveContainer" containerID="5c01c53a722b41292b63b3dae4150674a39e7ad04e165903e27b111959ccaf91" Jun 09 12:42:32.966924 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.966903 2555 scope.go:117] "RemoveContainer" containerID="a833f48b3d86d86064e9a15c8a8401125539a8615ced329095f82e163de8bb98" Jun 09 12:42:32.975926 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.975905 2555 scope.go:117] "RemoveContainer" containerID="e3db9de0c9a23dad460f2aedca58031973d0293a37258a785cb7759f69c7320c" Jun 09 12:42:32.986059 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.985983 2555 scope.go:117] "RemoveContainer" containerID="53e308ed171ea17b750e238b72154b522a5b16aefe8affe79d671b9392818cf7" Jun 09 12:42:32.994844 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:32.994825 2555 scope.go:117] "RemoveContainer" containerID="10697d47832c6a116d1e1640756ef64bb70abf7926c4fc2336e82b98b5edfa29" Jun 09 12:42:36.676973 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:36.676930 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks"] Jun 09 12:42:36.685687 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:36.685660 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks" Jun 09 12:42:36.689623 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:36.689584 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 12:42:36.689809 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:36.689646 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5xcwf\"" Jun 09 12:42:36.700773 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:36.700746 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks"] Jun 09 12:42:36.856528 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:36.856484 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb7zk\" (UniqueName: \"kubernetes.io/projected/0507a932-4b95-494c-a398-a96b62533d3a-kube-api-access-cb7zk\") pod \"dns-operator-controller-manager-864dd78c4c-6ffks\" (UID: \"0507a932-4b95-494c-a398-a96b62533d3a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks" Jun 09 12:42:36.957364 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:36.957261 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb7zk\" (UniqueName: \"kubernetes.io/projected/0507a932-4b95-494c-a398-a96b62533d3a-kube-api-access-cb7zk\") pod \"dns-operator-controller-manager-864dd78c4c-6ffks\" (UID: \"0507a932-4b95-494c-a398-a96b62533d3a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks" Jun 09 12:42:36.969674 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:36.969648 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb7zk\" (UniqueName: \"kubernetes.io/projected/0507a932-4b95-494c-a398-a96b62533d3a-kube-api-access-cb7zk\") pod \"dns-operator-controller-manager-864dd78c4c-6ffks\" (UID: \"0507a932-4b95-494c-a398-a96b62533d3a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks" Jun 09 12:42:36.999248 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:36.999213 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks" Jun 09 12:42:37.181813 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:37.181790 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks"] Jun 09 12:42:37.183020 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:42:37.182974 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0507a932_4b95_494c_a398_a96b62533d3a.slice/crio-e5779fe659e8a65815f6b67829f893ee21f62af5780c6eacca7e2f1cfc583f4e WatchSource:0}: Error finding container e5779fe659e8a65815f6b67829f893ee21f62af5780c6eacca7e2f1cfc583f4e: Status 404 returned error can't find the container with id e5779fe659e8a65815f6b67829f893ee21f62af5780c6eacca7e2f1cfc583f4e Jun 09 12:42:37.717506 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:37.717462 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks" event={"ID":"0507a932-4b95-494c-a398-a96b62533d3a","Type":"ContainerStarted","Data":"e5779fe659e8a65815f6b67829f893ee21f62af5780c6eacca7e2f1cfc583f4e"} Jun 09 12:42:39.186612 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.186533 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np"] Jun 09 12:42:39.190443 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.190419 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:39.193533 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.193512 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-txl59\"" Jun 09 12:42:39.210731 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.210695 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np"] Jun 09 12:42:39.280527 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.280493 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwt6r\" (UniqueName: \"kubernetes.io/projected/f2920994-7cd2-4784-9443-9f954b01dd58-kube-api-access-wwt6r\") pod \"limitador-operator-controller-manager-859d7b78bd-6m9np\" (UID: \"f2920994-7cd2-4784-9443-9f954b01dd58\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:39.381923 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.381886 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwt6r\" (UniqueName: \"kubernetes.io/projected/f2920994-7cd2-4784-9443-9f954b01dd58-kube-api-access-wwt6r\") pod \"limitador-operator-controller-manager-859d7b78bd-6m9np\" (UID: \"f2920994-7cd2-4784-9443-9f954b01dd58\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:39.398490 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.398456 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwt6r\" (UniqueName: \"kubernetes.io/projected/f2920994-7cd2-4784-9443-9f954b01dd58-kube-api-access-wwt6r\") pod \"limitador-operator-controller-manager-859d7b78bd-6m9np\" (UID: \"f2920994-7cd2-4784-9443-9f954b01dd58\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:39.508830 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.508745 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:39.698704 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.698662 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np"] Jun 09 12:42:39.699879 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:42:39.699854 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2920994_7cd2_4784_9443_9f954b01dd58.slice/crio-1debeeca2740581f88044844ac2bb24575d90da09f0f08a1a0399d2d3a0908d9 WatchSource:0}: Error finding container 1debeeca2740581f88044844ac2bb24575d90da09f0f08a1a0399d2d3a0908d9: Status 404 returned error can't find the container with id 1debeeca2740581f88044844ac2bb24575d90da09f0f08a1a0399d2d3a0908d9 Jun 09 12:42:39.734649 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.734614 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" event={"ID":"f2920994-7cd2-4784-9443-9f954b01dd58","Type":"ContainerStarted","Data":"1debeeca2740581f88044844ac2bb24575d90da09f0f08a1a0399d2d3a0908d9"} Jun 09 12:42:39.736111 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.736079 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" event={"ID":"e25203ab-cd92-4ade-9236-e7d97486b207","Type":"ContainerStarted","Data":"396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0"} Jun 09 12:42:39.736254 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.736235 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:39.784393 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:39.784268 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" podStartSLOduration=2.139453623 podStartE2EDuration="8.784249727s" totalImagesPullingTime="6.644796104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:39.776027457 +0000 UTC m=+667.290175534" watchObservedRunningTime="2026-06-09 12:42:39.784249727 +0000 UTC m=+667.298397813" Jun 09 12:42:41.749138 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:41.748964 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks" event={"ID":"0507a932-4b95-494c-a398-a96b62533d3a","Type":"ContainerStarted","Data":"000aeda0fc1553b5d477bf82ce42fea5334d541c9f10b1dfb5b805a76dc8112f"} Jun 09 12:42:41.749562 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:41.749138 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks" Jun 09 12:42:41.750677 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:41.750648 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" event={"ID":"f2920994-7cd2-4784-9443-9f954b01dd58","Type":"ContainerStarted","Data":"6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2"} Jun 09 12:42:41.750822 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:41.750703 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:41.790377 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:41.790325 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks" podStartSLOduration=1.981582347 podStartE2EDuration="5.790307642s" totalImagesPullingTime="3.808725295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:41.789070054 +0000 UTC m=+669.303218141" watchObservedRunningTime="2026-06-09 12:42:41.790307642 +0000 UTC m=+669.304455741" Jun 09 12:42:50.745161 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:50.745123 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:50.772544 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:50.772489 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" podStartSLOduration=10.026738129 podStartE2EDuration="11.772471709s" totalImagesPullingTime="1.74573358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:41.833037371 +0000 UTC m=+669.347185459" watchObservedRunningTime="2026-06-09 12:42:50.772471709 +0000 UTC m=+678.286619796" Jun 09 12:42:52.485080 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.485042 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47"] Jun 09 12:42:52.485514 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.485236 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" containerName="manager" containerID="cri-o://396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0" gracePeriod=2 Jun 09 12:42:52.491598 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.491568 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47"] Jun 09 12:42:52.502033 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.501991 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np"] Jun 09 12:42:52.502255 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.502211 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" containerName="manager" containerID="cri-o://6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2" gracePeriod=2 Jun 09 12:42:52.504768 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.504640 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.504768 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.504660 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.522334 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.522280 2555 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f2920994-7cd2-4784-9443-9f954b01dd58\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-6m9np\": pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.522628 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.522486 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np"] Jun 09 12:42:52.525522 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.525487 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.525692 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.525672 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd"] Jun 09 12:42:52.526097 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.526083 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" containerName="manager" Jun 09 12:42:52.526157 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.526098 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" containerName="manager" Jun 09 12:42:52.526157 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.526110 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" containerName="manager" Jun 09 12:42:52.526157 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.526125 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" containerName="manager" Jun 09 12:42:52.526262 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.526199 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" containerName="manager" Jun 09 12:42:52.526262 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.526212 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" containerName="manager" Jun 09 12:42:52.527440 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.527407 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.529939 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.529925 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:42:52.548911 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.548882 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm"] Jun 09 12:42:52.552829 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.552809 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm" Jun 09 12:42:52.571302 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.571272 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd"] Jun 09 12:42:52.576347 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.576318 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm"] Jun 09 12:42:52.596503 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.596475 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw"] Jun 09 12:42:52.599734 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.599713 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" Jun 09 12:42:52.602360 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.602334 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb9th\" (UniqueName: \"kubernetes.io/projected/22dea84a-f758-41c5-95cc-335b46657af6-kube-api-access-bb9th\") pod \"kuadrant-operator-controller-manager-8684c9ff49-df5fd\" (UID: \"22dea84a-f758-41c5-95cc-335b46657af6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:42:52.602455 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.602437 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22dea84a-f758-41c5-95cc-335b46657af6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-df5fd\" (UID: \"22dea84a-f758-41c5-95cc-335b46657af6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:42:52.602499 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.602478 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dstsk\" (UniqueName: \"kubernetes.io/projected/891c0a93-cea1-49cd-a121-b107a2d1fe66-kube-api-access-dstsk\") pod \"limitador-operator-controller-manager-859d7b78bd-gfghm\" (UID: \"891c0a93-cea1-49cd-a121-b107a2d1fe66\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm" Jun 09 12:42:52.607691 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.607656 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.614285 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.614249 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.625993 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.625954 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.628279 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.628250 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw"] Jun 09 12:42:52.630096 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.629535 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.703817 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.703526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb9th\" (UniqueName: \"kubernetes.io/projected/22dea84a-f758-41c5-95cc-335b46657af6-kube-api-access-bb9th\") pod \"kuadrant-operator-controller-manager-8684c9ff49-df5fd\" (UID: \"22dea84a-f758-41c5-95cc-335b46657af6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:42:52.703817 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.703578 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrj7\" (UniqueName: \"kubernetes.io/projected/ca11da56-9bee-4d70-a6da-796881e3690f-kube-api-access-8zrj7\") pod \"kuadrant-operator-controller-manager-86878c769f-fg8qw\" (UID: \"ca11da56-9bee-4d70-a6da-796881e3690f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" Jun 09 12:42:52.703817 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.703606 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca11da56-9bee-4d70-a6da-796881e3690f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fg8qw\" (UID: \"ca11da56-9bee-4d70-a6da-796881e3690f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" Jun 09 12:42:52.703817 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.703625 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22dea84a-f758-41c5-95cc-335b46657af6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-df5fd\" (UID: \"22dea84a-f758-41c5-95cc-335b46657af6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:42:52.703817 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.703648 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dstsk\" (UniqueName: \"kubernetes.io/projected/891c0a93-cea1-49cd-a121-b107a2d1fe66-kube-api-access-dstsk\") pod \"limitador-operator-controller-manager-859d7b78bd-gfghm\" (UID: \"891c0a93-cea1-49cd-a121-b107a2d1fe66\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm" Jun 09 12:42:52.704358 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.704295 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22dea84a-f758-41c5-95cc-335b46657af6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-df5fd\" (UID: \"22dea84a-f758-41c5-95cc-335b46657af6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:42:52.713819 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.713775 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dstsk\" (UniqueName: \"kubernetes.io/projected/891c0a93-cea1-49cd-a121-b107a2d1fe66-kube-api-access-dstsk\") pod \"limitador-operator-controller-manager-859d7b78bd-gfghm\" (UID: \"891c0a93-cea1-49cd-a121-b107a2d1fe66\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm" Jun 09 12:42:52.713933 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.713819 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb9th\" (UniqueName: \"kubernetes.io/projected/22dea84a-f758-41c5-95cc-335b46657af6-kube-api-access-bb9th\") pod \"kuadrant-operator-controller-manager-8684c9ff49-df5fd\" (UID: \"22dea84a-f758-41c5-95cc-335b46657af6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:42:52.748656 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.748627 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.750943 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.750927 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.752585 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.752557 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.757532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.757511 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6ffks" Jun 09 12:42:52.758328 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.758307 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.761121 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.761103 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.786207 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.786172 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.804530 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.804505 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcfht\" (UniqueName: \"kubernetes.io/projected/e25203ab-cd92-4ade-9236-e7d97486b207-kube-api-access-pcfht\") pod \"e25203ab-cd92-4ade-9236-e7d97486b207\" (UID: \"e25203ab-cd92-4ade-9236-e7d97486b207\") " Jun 09 12:42:52.804675 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.804557 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwt6r\" (UniqueName: \"kubernetes.io/projected/f2920994-7cd2-4784-9443-9f954b01dd58-kube-api-access-wwt6r\") pod \"f2920994-7cd2-4784-9443-9f954b01dd58\" (UID: \"f2920994-7cd2-4784-9443-9f954b01dd58\") " Jun 09 12:42:52.804675 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.804608 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e25203ab-cd92-4ade-9236-e7d97486b207-extensions-socket-volume\") pod \"e25203ab-cd92-4ade-9236-e7d97486b207\" (UID: \"e25203ab-cd92-4ade-9236-e7d97486b207\") " Jun 09 12:42:52.805580 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.804849 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrj7\" (UniqueName: \"kubernetes.io/projected/ca11da56-9bee-4d70-a6da-796881e3690f-kube-api-access-8zrj7\") pod \"kuadrant-operator-controller-manager-86878c769f-fg8qw\" (UID: \"ca11da56-9bee-4d70-a6da-796881e3690f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" Jun 09 12:42:52.805580 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.804910 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca11da56-9bee-4d70-a6da-796881e3690f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fg8qw\" (UID: \"ca11da56-9bee-4d70-a6da-796881e3690f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" Jun 09 12:42:52.805580 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.805529 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25203ab-cd92-4ade-9236-e7d97486b207-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e25203ab-cd92-4ade-9236-e7d97486b207" (UID: "e25203ab-cd92-4ade-9236-e7d97486b207"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:42:52.805789 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.805586 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca11da56-9bee-4d70-a6da-796881e3690f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fg8qw\" (UID: \"ca11da56-9bee-4d70-a6da-796881e3690f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" Jun 09 12:42:52.807178 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.807122 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2920994-7cd2-4784-9443-9f954b01dd58-kube-api-access-wwt6r" (OuterVolumeSpecName: "kube-api-access-wwt6r") pod "f2920994-7cd2-4784-9443-9f954b01dd58" (UID: "f2920994-7cd2-4784-9443-9f954b01dd58"). InnerVolumeSpecName "kube-api-access-wwt6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:52.807518 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.807495 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e25203ab-cd92-4ade-9236-e7d97486b207-kube-api-access-pcfht" (OuterVolumeSpecName: "kube-api-access-pcfht") pod "e25203ab-cd92-4ade-9236-e7d97486b207" (UID: "e25203ab-cd92-4ade-9236-e7d97486b207"). InnerVolumeSpecName "kube-api-access-pcfht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:52.810085 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.810057 2555 generic.go:356] "Generic (PLEG): container finished" podID="e25203ab-cd92-4ade-9236-e7d97486b207" containerID="396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0" exitCode=0 Jun 09 12:42:52.810222 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.810102 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.810222 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.810170 2555 scope.go:117] "RemoveContainer" containerID="396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0" Jun 09 12:42:52.812156 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.812131 2555 generic.go:356] "Generic (PLEG): container finished" podID="f2920994-7cd2-4784-9443-9f954b01dd58" containerID="6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2" exitCode=0 Jun 09 12:42:52.812272 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.812192 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.813799 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.813770 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.816541 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.816518 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.818592 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.818562 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.819125 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.819106 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrj7\" (UniqueName: \"kubernetes.io/projected/ca11da56-9bee-4d70-a6da-796881e3690f-kube-api-access-8zrj7\") pod \"kuadrant-operator-controller-manager-86878c769f-fg8qw\" (UID: \"ca11da56-9bee-4d70-a6da-796881e3690f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" Jun 09 12:42:52.820705 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.820675 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.821471 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.821452 2555 scope.go:117] "RemoveContainer" containerID="396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0" Jun 09 12:42:52.821768 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.821742 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0\": container with ID starting with 396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0 not found: ID does not exist" containerID="396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0" Jun 09 12:42:52.821862 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.821781 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0"} err="failed to get container status \"396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0\": rpc error: code = NotFound desc = could not find container \"396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0\": container with ID starting with 396d80660f9e02a1f5871ae31923487543f9e3ec4b484173771e583185dd38f0 not found: ID does not exist" Jun 09 12:42:52.821862 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.821806 2555 scope.go:117] "RemoveContainer" containerID="6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2" Jun 09 12:42:52.828329 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.828307 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.830984 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.830964 2555 scope.go:117] "RemoveContainer" containerID="6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2" Jun 09 12:42:52.831271 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.831246 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.831356 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.831300 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2\": container with ID starting with 6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2 not found: ID does not exist" containerID="6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2" Jun 09 12:42:52.831356 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.831326 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2"} err="failed to get container status \"6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2\": rpc error: code = NotFound desc = could not find container \"6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2\": container with ID starting with 6c66f5d5741c307f3bfa3da9ff277ba41f23c2e4e9d6fef42d9caa252d4ebed2 not found: ID does not exist" Jun 09 12:42:52.834991 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.834967 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:52.838559 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.838526 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.905511 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.905477 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcfht\" (UniqueName: \"kubernetes.io/projected/e25203ab-cd92-4ade-9236-e7d97486b207-kube-api-access-pcfht\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:42:52.905511 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.905505 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwt6r\" (UniqueName: \"kubernetes.io/projected/f2920994-7cd2-4784-9443-9f954b01dd58-kube-api-access-wwt6r\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:42:52.905511 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.905517 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e25203ab-cd92-4ade-9236-e7d97486b207-extensions-socket-volume\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:42:52.916385 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.916357 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:42:52.924273 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.924253 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm" Jun 09 12:42:52.933645 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.933621 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" Jun 09 12:42:52.965818 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.964744 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6m9np\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6m9np" Jun 09 12:42:52.965818 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.965526 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" path="/var/lib/kubelet/pods/e25203ab-cd92-4ade-9236-e7d97486b207/volumes" Jun 09 12:42:52.966105 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:52.965988 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2920994-7cd2-4784-9443-9f954b01dd58" path="/var/lib/kubelet/pods/f2920994-7cd2-4784-9443-9f954b01dd58/volumes" Jun 09 12:42:52.967094 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:42:52.967065 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58s47\" is forbidden: User \"system:node:ip-10-0-135-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-164.ec2.internal' and this object" podUID="e25203ab-cd92-4ade-9236-e7d97486b207" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58s47" Jun 09 12:42:53.102712 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:42:53.102677 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22dea84a_f758_41c5_95cc_335b46657af6.slice/crio-e7213a05872391347534eb7f89bed9706fb8dd163130325bd4241073e1d5c4bf WatchSource:0}: Error finding container e7213a05872391347534eb7f89bed9706fb8dd163130325bd4241073e1d5c4bf: Status 404 returned error can't find the container with id e7213a05872391347534eb7f89bed9706fb8dd163130325bd4241073e1d5c4bf Jun 09 12:42:53.103433 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.103409 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd"] Jun 09 12:42:53.130282 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.130257 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm"] Jun 09 12:42:53.131369 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:42:53.131339 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891c0a93_cea1_49cd_a121_b107a2d1fe66.slice/crio-57b80f6e55c875ffe3b2d5244e675e7275bc5bcf85abe0aa2176e24246190b89 WatchSource:0}: Error finding container 57b80f6e55c875ffe3b2d5244e675e7275bc5bcf85abe0aa2176e24246190b89: Status 404 returned error can't find the container with id 57b80f6e55c875ffe3b2d5244e675e7275bc5bcf85abe0aa2176e24246190b89 Jun 09 12:42:53.154527 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.154501 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw"] Jun 09 12:42:53.166369 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:42:53.166340 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca11da56_9bee_4d70_a6da_796881e3690f.slice/crio-24b33f02850225df6be08594a785ebc9808972526cc4f23dc9d2a37d196eaf1a WatchSource:0}: Error finding container 24b33f02850225df6be08594a785ebc9808972526cc4f23dc9d2a37d196eaf1a: Status 404 returned error can't find the container with id 24b33f02850225df6be08594a785ebc9808972526cc4f23dc9d2a37d196eaf1a Jun 09 12:42:53.820243 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.820148 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm" event={"ID":"891c0a93-cea1-49cd-a121-b107a2d1fe66","Type":"ContainerStarted","Data":"15a720bbb789e28e665b839d0104e5ce212dce5b53d129f41df9386200926990"} Jun 09 12:42:53.820243 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.820208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm" event={"ID":"891c0a93-cea1-49cd-a121-b107a2d1fe66","Type":"ContainerStarted","Data":"57b80f6e55c875ffe3b2d5244e675e7275bc5bcf85abe0aa2176e24246190b89"} Jun 09 12:42:53.820676 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.820313 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm" Jun 09 12:42:53.822729 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.822697 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" event={"ID":"ca11da56-9bee-4d70-a6da-796881e3690f","Type":"ContainerStarted","Data":"e5d3b27638065b56808b4400edf8c31c76dc007afff9b97b5482f403dd292ffc"} Jun 09 12:42:53.822901 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.822739 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" event={"ID":"ca11da56-9bee-4d70-a6da-796881e3690f","Type":"ContainerStarted","Data":"24b33f02850225df6be08594a785ebc9808972526cc4f23dc9d2a37d196eaf1a"} Jun 09 12:42:53.822901 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.822802 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" Jun 09 12:42:53.824311 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.824291 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" event={"ID":"22dea84a-f758-41c5-95cc-335b46657af6","Type":"ContainerStarted","Data":"dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a"} Jun 09 12:42:53.824419 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.824322 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" event={"ID":"22dea84a-f758-41c5-95cc-335b46657af6","Type":"ContainerStarted","Data":"e7213a05872391347534eb7f89bed9706fb8dd163130325bd4241073e1d5c4bf"} Jun 09 12:42:53.824419 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.824417 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:42:53.845915 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.845873 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm" podStartSLOduration=1.8458598400000001 podStartE2EDuration="1.84585984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:53.844032943 +0000 UTC m=+681.358181030" watchObservedRunningTime="2026-06-09 12:42:53.84585984 +0000 UTC m=+681.360007925" Jun 09 12:42:53.873591 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.873538 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" podStartSLOduration=1.873523211 podStartE2EDuration="1.873523211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:53.871456275 +0000 UTC m=+681.385604361" watchObservedRunningTime="2026-06-09 12:42:53.873523211 +0000 UTC m=+681.387671296" Jun 09 12:42:53.913315 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:42:53.913076 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" podStartSLOduration=1.91305479 podStartE2EDuration="1.91305479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:53.903549682 +0000 UTC m=+681.417697792" watchObservedRunningTime="2026-06-09 12:42:53.91305479 +0000 UTC m=+681.427202877" Jun 09 12:43:04.832394 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:04.832359 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fg8qw" Jun 09 12:43:04.832902 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:04.832541 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gfghm" Jun 09 12:43:04.832902 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:04.832601 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:43:04.914380 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:04.914350 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd"] Jun 09 12:43:04.914583 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:04.914563 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" podUID="22dea84a-f758-41c5-95cc-335b46657af6" containerName="manager" containerID="cri-o://dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a" gracePeriod=10 Jun 09 12:43:05.188710 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.188682 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:43:05.333824 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.333791 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22dea84a-f758-41c5-95cc-335b46657af6-extensions-socket-volume\") pod \"22dea84a-f758-41c5-95cc-335b46657af6\" (UID: \"22dea84a-f758-41c5-95cc-335b46657af6\") " Jun 09 12:43:05.333987 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.333841 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb9th\" (UniqueName: \"kubernetes.io/projected/22dea84a-f758-41c5-95cc-335b46657af6-kube-api-access-bb9th\") pod \"22dea84a-f758-41c5-95cc-335b46657af6\" (UID: \"22dea84a-f758-41c5-95cc-335b46657af6\") " Jun 09 12:43:05.334274 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.334253 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22dea84a-f758-41c5-95cc-335b46657af6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "22dea84a-f758-41c5-95cc-335b46657af6" (UID: "22dea84a-f758-41c5-95cc-335b46657af6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:43:05.336092 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.336058 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22dea84a-f758-41c5-95cc-335b46657af6-kube-api-access-bb9th" (OuterVolumeSpecName: "kube-api-access-bb9th") pod "22dea84a-f758-41c5-95cc-335b46657af6" (UID: "22dea84a-f758-41c5-95cc-335b46657af6"). InnerVolumeSpecName "kube-api-access-bb9th". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:43:05.434995 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.434957 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22dea84a-f758-41c5-95cc-335b46657af6-extensions-socket-volume\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:43:05.435186 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.434992 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb9th\" (UniqueName: \"kubernetes.io/projected/22dea84a-f758-41c5-95cc-335b46657af6-kube-api-access-bb9th\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:43:05.886445 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.886406 2555 generic.go:356] "Generic (PLEG): container finished" podID="22dea84a-f758-41c5-95cc-335b46657af6" containerID="dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a" exitCode=0 Jun 09 12:43:05.886916 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.886455 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" Jun 09 12:43:05.886916 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.886489 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" event={"ID":"22dea84a-f758-41c5-95cc-335b46657af6","Type":"ContainerDied","Data":"dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a"} Jun 09 12:43:05.886916 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.886545 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd" event={"ID":"22dea84a-f758-41c5-95cc-335b46657af6","Type":"ContainerDied","Data":"e7213a05872391347534eb7f89bed9706fb8dd163130325bd4241073e1d5c4bf"} Jun 09 12:43:05.886916 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.886567 2555 scope.go:117] "RemoveContainer" containerID="dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a" Jun 09 12:43:05.896454 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.896426 2555 scope.go:117] "RemoveContainer" containerID="dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a" Jun 09 12:43:05.896751 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:43:05.896732 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a\": container with ID starting with dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a not found: ID does not exist" containerID="dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a" Jun 09 12:43:05.896798 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.896761 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a"} err="failed to get container status \"dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a\": rpc error: code = NotFound desc = could not find container \"dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a\": container with ID starting with dfc2e6a80bf0a540534782fb91096aa58a2d6ae73672ede205d5eb0cf880e96a not found: ID does not exist" Jun 09 12:43:05.915035 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.914989 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd"] Jun 09 12:43:05.923070 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:05.923046 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-df5fd"] Jun 09 12:43:06.964241 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:06.964211 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22dea84a-f758-41c5-95cc-335b46657af6" path="/var/lib/kubelet/pods/22dea84a-f758-41c5-95cc-335b46657af6/volumes" Jun 09 12:43:21.258124 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.258031 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z"] Jun 09 12:43:21.258638 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.258453 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22dea84a-f758-41c5-95cc-335b46657af6" containerName="manager" Jun 09 12:43:21.258638 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.258465 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="22dea84a-f758-41c5-95cc-335b46657af6" containerName="manager" Jun 09 12:43:21.258638 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.258539 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="22dea84a-f758-41c5-95cc-335b46657af6" containerName="manager" Jun 09 12:43:21.262469 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.262445 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.265544 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.265522 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-n5dzj\"" Jun 09 12:43:21.277434 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.277404 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z"] Jun 09 12:43:21.279612 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.279590 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlw6f\" (UniqueName: \"kubernetes.io/projected/ac9895ea-d7a8-483c-968c-0d4756576d46-kube-api-access-qlw6f\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.279721 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.279622 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-podinfo\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.279721 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.279641 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-data\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.279721 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.279659 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-token\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.279841 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.279770 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-credential-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.279841 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.279803 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-workload-certs\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.279841 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.279819 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-envoy\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.279935 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.279895 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-workload-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.279971 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.279948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac9895ea-d7a8-483c-968c-0d4756576d46-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.380938 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.380898 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac9895ea-d7a8-483c-968c-0d4756576d46-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381145 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.380947 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlw6f\" (UniqueName: \"kubernetes.io/projected/ac9895ea-d7a8-483c-968c-0d4756576d46-kube-api-access-qlw6f\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381145 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.380971 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-podinfo\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381145 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381012 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-data\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381145 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381114 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-token\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381367 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381235 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-credential-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381367 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381270 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-workload-certs\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381367 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381294 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-envoy\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381367 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381333 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-workload-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381594 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381464 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-data\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381656 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381617 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-credential-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381732 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-workload-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381788 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381755 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-workload-certs\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.381788 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.381770 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac9895ea-d7a8-483c-968c-0d4756576d46-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.383866 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.383837 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-podinfo\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.383985 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.383943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-envoy\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.395782 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.395136 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac9895ea-d7a8-483c-968c-0d4756576d46-istio-token\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.397976 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.397955 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlw6f\" (UniqueName: \"kubernetes.io/projected/ac9895ea-d7a8-483c-968c-0d4756576d46-kube-api-access-qlw6f\") pod \"maas-default-gateway-openshift-default-67497754f6-fhm6z\" (UID: \"ac9895ea-d7a8-483c-968c-0d4756576d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.574628 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.574530 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:21.729991 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.729961 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z"] Jun 09 12:43:21.732051 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:43:21.732026 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9895ea_d7a8_483c_968c_0d4756576d46.slice/crio-00aef4dfb026220d6b9dc91e7d7a24eba90493b563d708162145e0befb606d69 WatchSource:0}: Error finding container 00aef4dfb026220d6b9dc91e7d7a24eba90493b563d708162145e0befb606d69: Status 404 returned error can't find the container with id 00aef4dfb026220d6b9dc91e7d7a24eba90493b563d708162145e0befb606d69 Jun 09 12:43:21.734093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.734065 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 09 12:43:21.734168 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.734143 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 09 12:43:21.734209 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.734170 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 09 12:43:21.971847 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.971769 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" event={"ID":"ac9895ea-d7a8-483c-968c-0d4756576d46","Type":"ContainerStarted","Data":"f99a84df779b4b028b325b383898b042065f169eab88f6a2e205b152f405ac5c"} Jun 09 12:43:21.972071 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.971863 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" event={"ID":"ac9895ea-d7a8-483c-968c-0d4756576d46","Type":"ContainerStarted","Data":"00aef4dfb026220d6b9dc91e7d7a24eba90493b563d708162145e0befb606d69"} Jun 09 12:43:21.995369 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:21.995245 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" podStartSLOduration=0.995222043 podStartE2EDuration="995.222043ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:43:21.993383503 +0000 UTC m=+709.507531589" watchObservedRunningTime="2026-06-09 12:43:21.995222043 +0000 UTC m=+709.509370129" Jun 09 12:43:22.575174 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:22.575129 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:22.580471 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:22.580446 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:22.977227 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:22.977192 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:22.978171 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:22.978150 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:43:26.356554 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:26.356522 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rst4m"] Jun 09 12:43:26.358963 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:26.358947 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rst4m" Jun 09 12:43:26.362304 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:26.362284 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vmrgq\"" Jun 09 12:43:26.374678 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:26.374659 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rst4m"] Jun 09 12:43:26.426666 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:26.426631 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghfg\" (UniqueName: \"kubernetes.io/projected/47e21b1f-a22f-4e5e-bc44-4938ddaf5da6-kube-api-access-vghfg\") pod \"authorino-58cd955675-rst4m\" (UID: \"47e21b1f-a22f-4e5e-bc44-4938ddaf5da6\") " pod="kuadrant-system/authorino-58cd955675-rst4m" Jun 09 12:43:26.528093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:26.528059 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghfg\" (UniqueName: \"kubernetes.io/projected/47e21b1f-a22f-4e5e-bc44-4938ddaf5da6-kube-api-access-vghfg\") pod \"authorino-58cd955675-rst4m\" (UID: \"47e21b1f-a22f-4e5e-bc44-4938ddaf5da6\") " pod="kuadrant-system/authorino-58cd955675-rst4m" Jun 09 12:43:26.537423 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:26.537396 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghfg\" (UniqueName: \"kubernetes.io/projected/47e21b1f-a22f-4e5e-bc44-4938ddaf5da6-kube-api-access-vghfg\") pod \"authorino-58cd955675-rst4m\" (UID: \"47e21b1f-a22f-4e5e-bc44-4938ddaf5da6\") " pod="kuadrant-system/authorino-58cd955675-rst4m" Jun 09 12:43:26.668699 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:26.668607 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rst4m" Jun 09 12:43:26.810705 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:26.810678 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rst4m"] Jun 09 12:43:26.812132 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:43:26.812108 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47e21b1f_a22f_4e5e_bc44_4938ddaf5da6.slice/crio-371cd13902cec5b117ee2a1adcd1e16ab9b7d98d3007c132dcb4ceb92a15bce2 WatchSource:0}: Error finding container 371cd13902cec5b117ee2a1adcd1e16ab9b7d98d3007c132dcb4ceb92a15bce2: Status 404 returned error can't find the container with id 371cd13902cec5b117ee2a1adcd1e16ab9b7d98d3007c132dcb4ceb92a15bce2 Jun 09 12:43:26.999752 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:26.999656 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rst4m" event={"ID":"47e21b1f-a22f-4e5e-bc44-4938ddaf5da6","Type":"ContainerStarted","Data":"371cd13902cec5b117ee2a1adcd1e16ab9b7d98d3007c132dcb4ceb92a15bce2"} Jun 09 12:43:31.024276 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:31.024238 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rst4m" event={"ID":"47e21b1f-a22f-4e5e-bc44-4938ddaf5da6","Type":"ContainerStarted","Data":"05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0"} Jun 09 12:43:31.042316 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:31.042270 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rst4m" podStartSLOduration=1.78032937 podStartE2EDuration="5.042255695s" totalImagesPullingTime="3.261926325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:43:31.041905833 +0000 UTC m=+718.556053949" watchObservedRunningTime="2026-06-09 12:43:31.042255695 +0000 UTC m=+718.556403780" Jun 09 12:43:31.688504 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:31.688469 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rst4m"] Jun 09 12:43:33.034426 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:33.034386 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rst4m" podUID="47e21b1f-a22f-4e5e-bc44-4938ddaf5da6" containerName="authorino" containerID="cri-o://05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0" gracePeriod=30 Jun 09 12:43:33.285308 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:33.285244 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rst4m" Jun 09 12:43:33.393220 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:33.393190 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vghfg\" (UniqueName: \"kubernetes.io/projected/47e21b1f-a22f-4e5e-bc44-4938ddaf5da6-kube-api-access-vghfg\") pod \"47e21b1f-a22f-4e5e-bc44-4938ddaf5da6\" (UID: \"47e21b1f-a22f-4e5e-bc44-4938ddaf5da6\") " Jun 09 12:43:33.395421 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:33.395384 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e21b1f-a22f-4e5e-bc44-4938ddaf5da6-kube-api-access-vghfg" (OuterVolumeSpecName: "kube-api-access-vghfg") pod "47e21b1f-a22f-4e5e-bc44-4938ddaf5da6" (UID: "47e21b1f-a22f-4e5e-bc44-4938ddaf5da6"). InnerVolumeSpecName "kube-api-access-vghfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:43:33.494532 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:33.494495 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vghfg\" (UniqueName: \"kubernetes.io/projected/47e21b1f-a22f-4e5e-bc44-4938ddaf5da6-kube-api-access-vghfg\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:43:34.040706 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:34.040672 2555 generic.go:356] "Generic (PLEG): container finished" podID="47e21b1f-a22f-4e5e-bc44-4938ddaf5da6" containerID="05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0" exitCode=0 Jun 09 12:43:34.041190 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:34.040714 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rst4m" Jun 09 12:43:34.041190 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:34.040762 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rst4m" event={"ID":"47e21b1f-a22f-4e5e-bc44-4938ddaf5da6","Type":"ContainerDied","Data":"05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0"} Jun 09 12:43:34.041190 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:34.040809 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rst4m" event={"ID":"47e21b1f-a22f-4e5e-bc44-4938ddaf5da6","Type":"ContainerDied","Data":"371cd13902cec5b117ee2a1adcd1e16ab9b7d98d3007c132dcb4ceb92a15bce2"} Jun 09 12:43:34.041190 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:34.040837 2555 scope.go:117] "RemoveContainer" containerID="05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0" Jun 09 12:43:34.049656 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:34.049641 2555 scope.go:117] "RemoveContainer" containerID="05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0" Jun 09 12:43:34.049895 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:43:34.049879 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0\": container with ID starting with 05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0 not found: ID does not exist" containerID="05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0" Jun 09 12:43:34.049958 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:34.049902 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0"} err="failed to get container status \"05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0\": rpc error: code = NotFound desc = could not find container \"05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0\": container with ID starting with 05b2ebb5d6a91bb9f97268784d7949e8dfc3a5dd68dcb031039be432c2262cd0 not found: ID does not exist" Jun 09 12:43:34.065213 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:34.065187 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rst4m"] Jun 09 12:43:34.067474 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:34.067457 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rst4m"] Jun 09 12:43:34.963745 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:43:34.963712 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e21b1f-a22f-4e5e-bc44-4938ddaf5da6" path="/var/lib/kubelet/pods/47e21b1f-a22f-4e5e-bc44-4938ddaf5da6/volumes" Jun 09 12:44:23.294891 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.294858 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:44:23.295421 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.295306 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e21b1f-a22f-4e5e-bc44-4938ddaf5da6" containerName="authorino" Jun 09 12:44:23.295421 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.295324 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e21b1f-a22f-4e5e-bc44-4938ddaf5da6" containerName="authorino" Jun 09 12:44:23.295546 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.295464 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e21b1f-a22f-4e5e-bc44-4938ddaf5da6" containerName="authorino" Jun 09 12:44:23.297567 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.297552 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:44:23.300296 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.300269 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 12:44:23.300405 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.300290 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-bncf2\"" Jun 09 12:44:23.301446 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.301421 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 12:44:23.301559 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.301514 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 12:44:23.311919 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.311895 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:44:23.344505 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.344476 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bb2m\" (UniqueName: \"kubernetes.io/projected/ad06c905-dc3e-4014-bb85-f6e2ff3f1199-kube-api-access-5bb2m\") pod \"maas-keycloak-0\" (UID: \"ad06c905-dc3e-4014-bb85-f6e2ff3f1199\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:44:23.445894 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.445856 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bb2m\" (UniqueName: \"kubernetes.io/projected/ad06c905-dc3e-4014-bb85-f6e2ff3f1199-kube-api-access-5bb2m\") pod \"maas-keycloak-0\" (UID: \"ad06c905-dc3e-4014-bb85-f6e2ff3f1199\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:44:23.455647 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.455614 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bb2m\" (UniqueName: \"kubernetes.io/projected/ad06c905-dc3e-4014-bb85-f6e2ff3f1199-kube-api-access-5bb2m\") pod \"maas-keycloak-0\" (UID: \"ad06c905-dc3e-4014-bb85-f6e2ff3f1199\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:44:23.607737 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.607709 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:44:23.745463 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:23.745281 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:44:23.748632 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:44:23.748603 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad06c905_dc3e_4014_bb85_f6e2ff3f1199.slice/crio-de356bf3851f23767defea90ef1ebfef113e7f288ce6e4cb6c551148f91650ea WatchSource:0}: Error finding container de356bf3851f23767defea90ef1ebfef113e7f288ce6e4cb6c551148f91650ea: Status 404 returned error can't find the container with id de356bf3851f23767defea90ef1ebfef113e7f288ce6e4cb6c551148f91650ea Jun 09 12:44:24.306572 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:24.306518 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ad06c905-dc3e-4014-bb85-f6e2ff3f1199","Type":"ContainerStarted","Data":"de356bf3851f23767defea90ef1ebfef113e7f288ce6e4cb6c551148f91650ea"} Jun 09 12:44:28.336841 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:28.336793 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ad06c905-dc3e-4014-bb85-f6e2ff3f1199","Type":"ContainerStarted","Data":"dc1c3f8f7e42c90673d07b0779edca23043d949760a51cd3835d6873f6b5d293"} Jun 09 12:44:28.360873 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:28.360812 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.958550246 podStartE2EDuration="5.36079084s" totalImagesPullingTime="4.402240594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:44:28.359794649 +0000 UTC m=+775.873942736" watchObservedRunningTime="2026-06-09 12:44:28.36079084 +0000 UTC m=+775.874938927" Jun 09 12:44:28.608477 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:28.608436 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 12:44:28.610557 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:28.610522 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:29.608464 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:29.608406 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:30.608339 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:30.608297 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:31.608388 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:31.608336 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:32.608470 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:32.608428 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:33.608610 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:33.608553 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:33.609155 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:33.609056 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 12:44:34.610025 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:34.609488 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:35.608254 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:35.608209 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:36.609159 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:36.609108 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:37.609165 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:37.609117 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:38.608659 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:38.608612 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:39.609073 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:39.609028 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:40.608102 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:40.608056 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.43:9000/health/started\": dial tcp 10.132.0.43:9000: connect: connection refused" Jun 09 12:44:41.738769 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:41.738731 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 12:44:41.756693 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:41.756648 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:44:51.746493 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:51.746396 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 12:44:52.635487 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:52.635444 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c7ch7"] Jun 09 12:44:52.644286 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:52.644259 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c7ch7" Jun 09 12:44:52.652394 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:52.652371 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vmrgq\"" Jun 09 12:44:52.654345 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:52.654318 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c7ch7"] Jun 09 12:44:52.750531 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:52.750495 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rhxm\" (UniqueName: \"kubernetes.io/projected/40a250bf-6120-4c93-8074-02bd6b2fec77-kube-api-access-6rhxm\") pod \"authorino-5d4b67c446-c7ch7\" (UID: \"40a250bf-6120-4c93-8074-02bd6b2fec77\") " pod="kuadrant-system/authorino-5d4b67c446-c7ch7" Jun 09 12:44:52.851288 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:52.851253 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rhxm\" (UniqueName: \"kubernetes.io/projected/40a250bf-6120-4c93-8074-02bd6b2fec77-kube-api-access-6rhxm\") pod \"authorino-5d4b67c446-c7ch7\" (UID: \"40a250bf-6120-4c93-8074-02bd6b2fec77\") " pod="kuadrant-system/authorino-5d4b67c446-c7ch7" Jun 09 12:44:52.860688 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:52.860659 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rhxm\" (UniqueName: \"kubernetes.io/projected/40a250bf-6120-4c93-8074-02bd6b2fec77-kube-api-access-6rhxm\") pod \"authorino-5d4b67c446-c7ch7\" (UID: \"40a250bf-6120-4c93-8074-02bd6b2fec77\") " pod="kuadrant-system/authorino-5d4b67c446-c7ch7" Jun 09 12:44:52.871178 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:52.871155 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c7ch7"] Jun 09 12:44:52.871427 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:52.871415 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c7ch7" Jun 09 12:44:53.028626 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.028598 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c7ch7"] Jun 09 12:44:53.030913 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:44:53.030883 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40a250bf_6120_4c93_8074_02bd6b2fec77.slice/crio-d12b83936c85452fc8ba8fc30a1626eb76d36a3676a5f68dd305fffbefebddf5 WatchSource:0}: Error finding container d12b83936c85452fc8ba8fc30a1626eb76d36a3676a5f68dd305fffbefebddf5: Status 404 returned error can't find the container with id d12b83936c85452fc8ba8fc30a1626eb76d36a3676a5f68dd305fffbefebddf5 Jun 09 12:44:53.091281 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.091232 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59cbd96598-rs2lr"] Jun 09 12:44:53.094158 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.094139 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59cbd96598-rs2lr" Jun 09 12:44:53.097237 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.097213 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 12:44:53.105679 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.105656 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59cbd96598-rs2lr"] Jun 09 12:44:53.153527 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.153498 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a05e61db-25ff-4f5d-9180-58b8f7f37835-tls-cert\") pod \"authorino-59cbd96598-rs2lr\" (UID: \"a05e61db-25ff-4f5d-9180-58b8f7f37835\") " pod="kuadrant-system/authorino-59cbd96598-rs2lr" Jun 09 12:44:53.153679 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.153575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j986z\" (UniqueName: \"kubernetes.io/projected/a05e61db-25ff-4f5d-9180-58b8f7f37835-kube-api-access-j986z\") pod \"authorino-59cbd96598-rs2lr\" (UID: \"a05e61db-25ff-4f5d-9180-58b8f7f37835\") " pod="kuadrant-system/authorino-59cbd96598-rs2lr" Jun 09 12:44:53.254402 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.254309 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a05e61db-25ff-4f5d-9180-58b8f7f37835-tls-cert\") pod \"authorino-59cbd96598-rs2lr\" (UID: \"a05e61db-25ff-4f5d-9180-58b8f7f37835\") " pod="kuadrant-system/authorino-59cbd96598-rs2lr" Jun 09 12:44:53.254550 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.254401 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j986z\" (UniqueName: \"kubernetes.io/projected/a05e61db-25ff-4f5d-9180-58b8f7f37835-kube-api-access-j986z\") pod \"authorino-59cbd96598-rs2lr\" (UID: \"a05e61db-25ff-4f5d-9180-58b8f7f37835\") " pod="kuadrant-system/authorino-59cbd96598-rs2lr" Jun 09 12:44:53.256973 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.256947 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a05e61db-25ff-4f5d-9180-58b8f7f37835-tls-cert\") pod \"authorino-59cbd96598-rs2lr\" (UID: \"a05e61db-25ff-4f5d-9180-58b8f7f37835\") " pod="kuadrant-system/authorino-59cbd96598-rs2lr" Jun 09 12:44:53.263265 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.263232 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j986z\" (UniqueName: \"kubernetes.io/projected/a05e61db-25ff-4f5d-9180-58b8f7f37835-kube-api-access-j986z\") pod \"authorino-59cbd96598-rs2lr\" (UID: \"a05e61db-25ff-4f5d-9180-58b8f7f37835\") " pod="kuadrant-system/authorino-59cbd96598-rs2lr" Jun 09 12:44:53.404501 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.404454 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59cbd96598-rs2lr" Jun 09 12:44:53.509419 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.509326 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c7ch7" event={"ID":"40a250bf-6120-4c93-8074-02bd6b2fec77","Type":"ContainerStarted","Data":"d12b83936c85452fc8ba8fc30a1626eb76d36a3676a5f68dd305fffbefebddf5"} Jun 09 12:44:53.540556 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:53.540527 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59cbd96598-rs2lr"] Jun 09 12:44:53.541796 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:44:53.541774 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda05e61db_25ff_4f5d_9180_58b8f7f37835.slice/crio-d0f74a5a8b445a5e39c94cee5beef54a276706de8349fff44aeef8dad571c250 WatchSource:0}: Error finding container d0f74a5a8b445a5e39c94cee5beef54a276706de8349fff44aeef8dad571c250: Status 404 returned error can't find the container with id d0f74a5a8b445a5e39c94cee5beef54a276706de8349fff44aeef8dad571c250 Jun 09 12:44:54.517204 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:54.517170 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c7ch7" event={"ID":"40a250bf-6120-4c93-8074-02bd6b2fec77","Type":"ContainerStarted","Data":"10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d"} Jun 09 12:44:54.517625 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:54.517246 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-c7ch7" podUID="40a250bf-6120-4c93-8074-02bd6b2fec77" containerName="authorino" containerID="cri-o://10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d" gracePeriod=30 Jun 09 12:44:54.518873 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:54.518837 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59cbd96598-rs2lr" event={"ID":"a05e61db-25ff-4f5d-9180-58b8f7f37835","Type":"ContainerStarted","Data":"c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d"} Jun 09 12:44:54.519022 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:54.518887 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59cbd96598-rs2lr" event={"ID":"a05e61db-25ff-4f5d-9180-58b8f7f37835","Type":"ContainerStarted","Data":"d0f74a5a8b445a5e39c94cee5beef54a276706de8349fff44aeef8dad571c250"} Jun 09 12:44:54.534099 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:54.533977 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-c7ch7" podStartSLOduration=1.999832174 podStartE2EDuration="2.533961772s" totalImagesPullingTime="534.129598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:44:54.533029626 +0000 UTC m=+802.047177731" watchObservedRunningTime="2026-06-09 12:44:54.533961772 +0000 UTC m=+802.048109859" Jun 09 12:44:54.550829 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:54.550781 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59cbd96598-rs2lr" podStartSLOduration=1.241925267 podStartE2EDuration="1.550766565s" totalImagesPullingTime="308.841298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:44:54.549372656 +0000 UTC m=+802.063520744" watchObservedRunningTime="2026-06-09 12:44:54.550766565 +0000 UTC m=+802.064914652" Jun 09 12:44:54.782753 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:54.782691 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c7ch7" Jun 09 12:44:54.869194 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:54.869166 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rhxm\" (UniqueName: \"kubernetes.io/projected/40a250bf-6120-4c93-8074-02bd6b2fec77-kube-api-access-6rhxm\") pod \"40a250bf-6120-4c93-8074-02bd6b2fec77\" (UID: \"40a250bf-6120-4c93-8074-02bd6b2fec77\") " Jun 09 12:44:54.871469 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:54.871439 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40a250bf-6120-4c93-8074-02bd6b2fec77-kube-api-access-6rhxm" (OuterVolumeSpecName: "kube-api-access-6rhxm") pod "40a250bf-6120-4c93-8074-02bd6b2fec77" (UID: "40a250bf-6120-4c93-8074-02bd6b2fec77"). InnerVolumeSpecName "kube-api-access-6rhxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:44:54.969937 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:54.969901 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rhxm\" (UniqueName: \"kubernetes.io/projected/40a250bf-6120-4c93-8074-02bd6b2fec77-kube-api-access-6rhxm\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:44:55.526404 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:55.526363 2555 generic.go:356] "Generic (PLEG): container finished" podID="40a250bf-6120-4c93-8074-02bd6b2fec77" containerID="10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d" exitCode=0 Jun 09 12:44:55.526404 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:55.526408 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c7ch7" Jun 09 12:44:55.526936 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:55.526456 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c7ch7" event={"ID":"40a250bf-6120-4c93-8074-02bd6b2fec77","Type":"ContainerDied","Data":"10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d"} Jun 09 12:44:55.526936 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:55.526504 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c7ch7" event={"ID":"40a250bf-6120-4c93-8074-02bd6b2fec77","Type":"ContainerDied","Data":"d12b83936c85452fc8ba8fc30a1626eb76d36a3676a5f68dd305fffbefebddf5"} Jun 09 12:44:55.526936 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:55.526528 2555 scope.go:117] "RemoveContainer" containerID="10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d" Jun 09 12:44:55.536560 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:55.536541 2555 scope.go:117] "RemoveContainer" containerID="10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d" Jun 09 12:44:55.536880 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:44:55.536848 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d\": container with ID starting with 10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d not found: ID does not exist" containerID="10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d" Jun 09 12:44:55.536988 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:55.536888 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d"} err="failed to get container status \"10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d\": rpc error: code = NotFound desc = could not find container \"10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d\": container with ID starting with 10b08e797ac3dd30554fbff039ddc31e87e9da01d82d06d136572f040740bf3d not found: ID does not exist" Jun 09 12:44:55.545341 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:55.545316 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c7ch7"] Jun 09 12:44:55.550328 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:55.550307 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c7ch7"] Jun 09 12:44:56.963896 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:56.963865 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40a250bf-6120-4c93-8074-02bd6b2fec77" path="/var/lib/kubelet/pods/40a250bf-6120-4c93-8074-02bd6b2fec77/volumes" Jun 09 12:44:58.213569 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.213528 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-ljc67"] Jun 09 12:44:58.214164 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.213986 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40a250bf-6120-4c93-8074-02bd6b2fec77" containerName="authorino" Jun 09 12:44:58.214164 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.214018 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="40a250bf-6120-4c93-8074-02bd6b2fec77" containerName="authorino" Jun 09 12:44:58.214280 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.214171 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="40a250bf-6120-4c93-8074-02bd6b2fec77" containerName="authorino" Jun 09 12:44:58.218916 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.218898 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:44:58.222117 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.222093 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 12:44:58.222370 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.222350 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b8p7h\"" Jun 09 12:44:58.223364 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.223349 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 12:44:58.233480 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.233455 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-ljc67"] Jun 09 12:44:58.298938 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.298897 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d42deb5a-50ef-4bfa-b8e7-97674a14576d-webhook-cert\") pod \"maas-controller-7bbdb77c66-ljc67\" (UID: \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\") " pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:44:58.298938 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.298940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k242\" (UniqueName: \"kubernetes.io/projected/d42deb5a-50ef-4bfa-b8e7-97674a14576d-kube-api-access-4k242\") pod \"maas-controller-7bbdb77c66-ljc67\" (UID: \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\") " pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:44:58.399630 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.399595 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d42deb5a-50ef-4bfa-b8e7-97674a14576d-webhook-cert\") pod \"maas-controller-7bbdb77c66-ljc67\" (UID: \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\") " pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:44:58.399630 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.399631 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k242\" (UniqueName: \"kubernetes.io/projected/d42deb5a-50ef-4bfa-b8e7-97674a14576d-kube-api-access-4k242\") pod \"maas-controller-7bbdb77c66-ljc67\" (UID: \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\") " pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:44:58.399835 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:44:58.399749 2555 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 09 12:44:58.399835 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:44:58.399826 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42deb5a-50ef-4bfa-b8e7-97674a14576d-webhook-cert podName:d42deb5a-50ef-4bfa-b8e7-97674a14576d nodeName:}" failed. No retries permitted until 2026-06-09 12:44:58.899804734 +0000 UTC m=+806.413952799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d42deb5a-50ef-4bfa-b8e7-97674a14576d-webhook-cert") pod "maas-controller-7bbdb77c66-ljc67" (UID: "d42deb5a-50ef-4bfa-b8e7-97674a14576d") : secret "maas-controller-webhook-cert" not found Jun 09 12:44:58.418566 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.418536 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k242\" (UniqueName: \"kubernetes.io/projected/d42deb5a-50ef-4bfa-b8e7-97674a14576d-kube-api-access-4k242\") pod \"maas-controller-7bbdb77c66-ljc67\" (UID: \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\") " pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:44:58.461663 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.461623 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dbd84d96-jl98n"] Jun 09 12:44:58.465527 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.465465 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:44:58.488316 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.488290 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dbd84d96-jl98n"] Jun 09 12:44:58.500479 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.500449 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1dbedeee-c306-48b2-9e0b-5b38ddd46d4f-webhook-cert\") pod \"maas-controller-dbd84d96-jl98n\" (UID: \"1dbedeee-c306-48b2-9e0b-5b38ddd46d4f\") " pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:44:58.500617 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.500491 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjvlp\" (UniqueName: \"kubernetes.io/projected/1dbedeee-c306-48b2-9e0b-5b38ddd46d4f-kube-api-access-rjvlp\") pod \"maas-controller-dbd84d96-jl98n\" (UID: \"1dbedeee-c306-48b2-9e0b-5b38ddd46d4f\") " pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:44:58.601541 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.601500 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1dbedeee-c306-48b2-9e0b-5b38ddd46d4f-webhook-cert\") pod \"maas-controller-dbd84d96-jl98n\" (UID: \"1dbedeee-c306-48b2-9e0b-5b38ddd46d4f\") " pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:44:58.601541 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.601540 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjvlp\" (UniqueName: \"kubernetes.io/projected/1dbedeee-c306-48b2-9e0b-5b38ddd46d4f-kube-api-access-rjvlp\") pod \"maas-controller-dbd84d96-jl98n\" (UID: \"1dbedeee-c306-48b2-9e0b-5b38ddd46d4f\") " pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:44:58.601740 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:44:58.601651 2555 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 09 12:44:58.601740 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:44:58.601715 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbedeee-c306-48b2-9e0b-5b38ddd46d4f-webhook-cert podName:1dbedeee-c306-48b2-9e0b-5b38ddd46d4f nodeName:}" failed. No retries permitted until 2026-06-09 12:44:59.101699241 +0000 UTC m=+806.615847517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1dbedeee-c306-48b2-9e0b-5b38ddd46d4f-webhook-cert") pod "maas-controller-dbd84d96-jl98n" (UID: "1dbedeee-c306-48b2-9e0b-5b38ddd46d4f") : secret "maas-controller-webhook-cert" not found Jun 09 12:44:58.613953 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.613926 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjvlp\" (UniqueName: \"kubernetes.io/projected/1dbedeee-c306-48b2-9e0b-5b38ddd46d4f-kube-api-access-rjvlp\") pod \"maas-controller-dbd84d96-jl98n\" (UID: \"1dbedeee-c306-48b2-9e0b-5b38ddd46d4f\") " pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:44:58.905014 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.904971 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d42deb5a-50ef-4bfa-b8e7-97674a14576d-webhook-cert\") pod \"maas-controller-7bbdb77c66-ljc67\" (UID: \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\") " pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:44:58.907540 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:58.907519 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d42deb5a-50ef-4bfa-b8e7-97674a14576d-webhook-cert\") pod \"maas-controller-7bbdb77c66-ljc67\" (UID: \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\") " pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:44:59.106928 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:59.106886 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1dbedeee-c306-48b2-9e0b-5b38ddd46d4f-webhook-cert\") pod \"maas-controller-dbd84d96-jl98n\" (UID: \"1dbedeee-c306-48b2-9e0b-5b38ddd46d4f\") " pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:44:59.109492 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:59.109468 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1dbedeee-c306-48b2-9e0b-5b38ddd46d4f-webhook-cert\") pod \"maas-controller-dbd84d96-jl98n\" (UID: \"1dbedeee-c306-48b2-9e0b-5b38ddd46d4f\") " pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:44:59.130460 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:59.130431 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:44:59.270495 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:59.269173 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-ljc67"] Jun 09 12:44:59.271426 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:44:59.271398 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42deb5a_50ef_4bfa_b8e7_97674a14576d.slice/crio-c12801532f501ecfa27784945dcae663207e16ec38af643668a08560517dfcc7 WatchSource:0}: Error finding container c12801532f501ecfa27784945dcae663207e16ec38af643668a08560517dfcc7: Status 404 returned error can't find the container with id c12801532f501ecfa27784945dcae663207e16ec38af643668a08560517dfcc7 Jun 09 12:44:59.376186 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:59.376142 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:44:59.534355 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:59.534332 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dbd84d96-jl98n"] Jun 09 12:44:59.536867 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:44:59.536840 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbedeee_c306_48b2_9e0b_5b38ddd46d4f.slice/crio-4fc1e7402baf1521a4cdb1e80eb35bd51ed120483500a2ad493589833a3c8d9b WatchSource:0}: Error finding container 4fc1e7402baf1521a4cdb1e80eb35bd51ed120483500a2ad493589833a3c8d9b: Status 404 returned error can't find the container with id 4fc1e7402baf1521a4cdb1e80eb35bd51ed120483500a2ad493589833a3c8d9b Jun 09 12:44:59.550246 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:59.550216 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" event={"ID":"d42deb5a-50ef-4bfa-b8e7-97674a14576d","Type":"ContainerStarted","Data":"c12801532f501ecfa27784945dcae663207e16ec38af643668a08560517dfcc7"} Jun 09 12:44:59.551493 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:44:59.551471 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbd84d96-jl98n" event={"ID":"1dbedeee-c306-48b2-9e0b-5b38ddd46d4f","Type":"ContainerStarted","Data":"4fc1e7402baf1521a4cdb1e80eb35bd51ed120483500a2ad493589833a3c8d9b"} Jun 09 12:45:02.572442 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:02.572405 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbd84d96-jl98n" event={"ID":"1dbedeee-c306-48b2-9e0b-5b38ddd46d4f","Type":"ContainerStarted","Data":"6064ddbfeb1b31596bbe4e817f9a4e5ecd64d68192cbb32d73e329de4ac39b3b"} Jun 09 12:45:02.572951 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:02.572505 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:45:02.573877 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:02.573851 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" event={"ID":"d42deb5a-50ef-4bfa-b8e7-97674a14576d","Type":"ContainerStarted","Data":"a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c"} Jun 09 12:45:02.573943 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:02.573904 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:45:02.597994 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:02.597940 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dbd84d96-jl98n" podStartSLOduration=2.275771023 podStartE2EDuration="4.597923632s" totalImagesPullingTime="2.322152609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:45:02.59524497 +0000 UTC m=+810.109393057" watchObservedRunningTime="2026-06-09 12:45:02.597923632 +0000 UTC m=+810.112071717" Jun 09 12:45:02.623651 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:02.623599 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" podStartSLOduration=2.046977038 podStartE2EDuration="4.623583763s" totalImagesPullingTime="2.576606725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:45:02.621332834 +0000 UTC m=+810.135480934" watchObservedRunningTime="2026-06-09 12:45:02.623583763 +0000 UTC m=+810.137731848" Jun 09 12:45:13.585105 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:13.585075 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:45:13.585474 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:13.585149 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dbd84d96-jl98n" Jun 09 12:45:13.650864 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:13.650831 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-ljc67"] Jun 09 12:45:13.651178 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:13.651121 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" podUID="d42deb5a-50ef-4bfa-b8e7-97674a14576d" containerName="manager" containerID="cri-o://a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c" gracePeriod=30 Jun 09 12:45:13.906240 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:13.906215 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:45:14.053446 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.053361 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k242\" (UniqueName: \"kubernetes.io/projected/d42deb5a-50ef-4bfa-b8e7-97674a14576d-kube-api-access-4k242\") pod \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\" (UID: \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\") " Jun 09 12:45:14.053446 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.053426 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d42deb5a-50ef-4bfa-b8e7-97674a14576d-webhook-cert\") pod \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\" (UID: \"d42deb5a-50ef-4bfa-b8e7-97674a14576d\") " Jun 09 12:45:14.055764 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.055736 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42deb5a-50ef-4bfa-b8e7-97674a14576d-kube-api-access-4k242" (OuterVolumeSpecName: "kube-api-access-4k242") pod "d42deb5a-50ef-4bfa-b8e7-97674a14576d" (UID: "d42deb5a-50ef-4bfa-b8e7-97674a14576d"). InnerVolumeSpecName "kube-api-access-4k242". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:45:14.055764 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.055739 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42deb5a-50ef-4bfa-b8e7-97674a14576d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d42deb5a-50ef-4bfa-b8e7-97674a14576d" (UID: "d42deb5a-50ef-4bfa-b8e7-97674a14576d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:45:14.155235 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.155193 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k242\" (UniqueName: \"kubernetes.io/projected/d42deb5a-50ef-4bfa-b8e7-97674a14576d-kube-api-access-4k242\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:45:14.155235 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.155228 2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d42deb5a-50ef-4bfa-b8e7-97674a14576d-webhook-cert\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:45:14.645306 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.645272 2555 generic.go:356] "Generic (PLEG): container finished" podID="d42deb5a-50ef-4bfa-b8e7-97674a14576d" containerID="a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c" exitCode=0 Jun 09 12:45:14.645733 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.645316 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" Jun 09 12:45:14.645733 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.645349 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" event={"ID":"d42deb5a-50ef-4bfa-b8e7-97674a14576d","Type":"ContainerDied","Data":"a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c"} Jun 09 12:45:14.645733 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.645398 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdb77c66-ljc67" event={"ID":"d42deb5a-50ef-4bfa-b8e7-97674a14576d","Type":"ContainerDied","Data":"c12801532f501ecfa27784945dcae663207e16ec38af643668a08560517dfcc7"} Jun 09 12:45:14.645733 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.645420 2555 scope.go:117] "RemoveContainer" containerID="a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c" Jun 09 12:45:14.655313 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.655137 2555 scope.go:117] "RemoveContainer" containerID="a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c" Jun 09 12:45:14.655406 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:45:14.655389 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c\": container with ID starting with a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c not found: ID does not exist" containerID="a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c" Jun 09 12:45:14.655449 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.655416 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c"} err="failed to get container status \"a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c\": rpc error: code = NotFound desc = could not find container \"a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c\": container with ID starting with a2514feef31cfaec06efef140c54fbd3691a887f209b1854dcc907fb3f9e017c not found: ID does not exist" Jun 09 12:45:14.667201 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.667180 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-ljc67"] Jun 09 12:45:14.671201 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.671180 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-ljc67"] Jun 09 12:45:14.964446 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:14.964353 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42deb5a-50ef-4bfa-b8e7-97674a14576d" path="/var/lib/kubelet/pods/d42deb5a-50ef-4bfa-b8e7-97674a14576d/volumes" Jun 09 12:45:33.273127 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.273088 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-jdb6c"] Jun 09 12:45:33.273519 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.273496 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42deb5a-50ef-4bfa-b8e7-97674a14576d" containerName="manager" Jun 09 12:45:33.273519 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.273507 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42deb5a-50ef-4bfa-b8e7-97674a14576d" containerName="manager" Jun 09 12:45:33.273591 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.273586 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42deb5a-50ef-4bfa-b8e7-97674a14576d" containerName="manager" Jun 09 12:45:33.280277 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.280248 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-jdb6c" Jun 09 12:45:33.283437 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.283417 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qk28b\"" Jun 09 12:45:33.283558 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.283418 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 12:45:33.287680 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.287654 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-jdb6c"] Jun 09 12:45:33.337567 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.337535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfh89\" (UniqueName: \"kubernetes.io/projected/d2399b50-b136-42fb-9b07-792241f88719-kube-api-access-vfh89\") pod \"payload-pre-processing-67d7689b65-jdb6c\" (UID: \"d2399b50-b136-42fb-9b07-792241f88719\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-jdb6c" Jun 09 12:45:33.348408 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.348374 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gfc8b"] Jun 09 12:45:33.352623 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.352598 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:45:33.363533 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.363470 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gfc8b"] Jun 09 12:45:33.439082 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.439047 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td6cb\" (UniqueName: \"kubernetes.io/projected/828b1fc8-01c8-4cf9-8604-b9d2e31889a8-kube-api-access-td6cb\") pod \"payload-processing-7c6c859784-gfc8b\" (UID: \"828b1fc8-01c8-4cf9-8604-b9d2e31889a8\") " pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:45:33.439338 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.439103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfh89\" (UniqueName: \"kubernetes.io/projected/d2399b50-b136-42fb-9b07-792241f88719-kube-api-access-vfh89\") pod \"payload-pre-processing-67d7689b65-jdb6c\" (UID: \"d2399b50-b136-42fb-9b07-792241f88719\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-jdb6c" Jun 09 12:45:33.448161 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.448136 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfh89\" (UniqueName: \"kubernetes.io/projected/d2399b50-b136-42fb-9b07-792241f88719-kube-api-access-vfh89\") pod \"payload-pre-processing-67d7689b65-jdb6c\" (UID: \"d2399b50-b136-42fb-9b07-792241f88719\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-jdb6c" Jun 09 12:45:33.539760 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.539719 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td6cb\" (UniqueName: \"kubernetes.io/projected/828b1fc8-01c8-4cf9-8604-b9d2e31889a8-kube-api-access-td6cb\") pod \"payload-processing-7c6c859784-gfc8b\" (UID: \"828b1fc8-01c8-4cf9-8604-b9d2e31889a8\") " pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:45:33.551291 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.551254 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td6cb\" (UniqueName: \"kubernetes.io/projected/828b1fc8-01c8-4cf9-8604-b9d2e31889a8-kube-api-access-td6cb\") pod \"payload-processing-7c6c859784-gfc8b\" (UID: \"828b1fc8-01c8-4cf9-8604-b9d2e31889a8\") " pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:45:33.593581 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.593481 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-jdb6c" Jun 09 12:45:33.666631 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.666598 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:45:33.755127 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.755102 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-jdb6c"] Jun 09 12:45:33.757760 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:45:33.757727 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2399b50_b136_42fb_9b07_792241f88719.slice/crio-3535a57e369cf32e256e6edcd19b03defb552fc0bf920518e6281182546fafc5 WatchSource:0}: Error finding container 3535a57e369cf32e256e6edcd19b03defb552fc0bf920518e6281182546fafc5: Status 404 returned error can't find the container with id 3535a57e369cf32e256e6edcd19b03defb552fc0bf920518e6281182546fafc5 Jun 09 12:45:33.829188 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:33.827581 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gfc8b"] Jun 09 12:45:33.831942 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:45:33.831879 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828b1fc8_01c8_4cf9_8604_b9d2e31889a8.slice/crio-8a5522a7b0246402727ca9077b2e036c19a0d5417ea7d268d9a3d103bba5b4ca WatchSource:0}: Error finding container 8a5522a7b0246402727ca9077b2e036c19a0d5417ea7d268d9a3d103bba5b4ca: Status 404 returned error can't find the container with id 8a5522a7b0246402727ca9077b2e036c19a0d5417ea7d268d9a3d103bba5b4ca Jun 09 12:45:34.758472 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:34.758431 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" event={"ID":"828b1fc8-01c8-4cf9-8604-b9d2e31889a8","Type":"ContainerStarted","Data":"8a5522a7b0246402727ca9077b2e036c19a0d5417ea7d268d9a3d103bba5b4ca"} Jun 09 12:45:34.760065 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:34.760034 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-jdb6c" event={"ID":"d2399b50-b136-42fb-9b07-792241f88719","Type":"ContainerStarted","Data":"3535a57e369cf32e256e6edcd19b03defb552fc0bf920518e6281182546fafc5"} Jun 09 12:45:35.771160 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:35.770939 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-jdb6c" event={"ID":"d2399b50-b136-42fb-9b07-792241f88719","Type":"ContainerStarted","Data":"dd253306a80ebd5ae687bb8a860b70ca552b7e68640162adfb2778f952583a7d"} Jun 09 12:45:35.771160 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:35.771053 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-jdb6c" Jun 09 12:45:35.773211 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:35.773186 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" event={"ID":"828b1fc8-01c8-4cf9-8604-b9d2e31889a8","Type":"ContainerStarted","Data":"ddfee6e26e3336b466bba86c71cb5d691d96dbbd5f0396ed41e186c007d8bc82"} Jun 09 12:45:35.773886 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:35.773866 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:45:35.789725 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:35.789655 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-jdb6c" podStartSLOduration=1.189110633 podStartE2EDuration="2.789632218s" totalImagesPullingTime="1.600521585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:45:35.788355276 +0000 UTC m=+843.302503365" watchObservedRunningTime="2026-06-09 12:45:35.789632218 +0000 UTC m=+843.303780306" Jun 09 12:45:35.809152 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:35.809099 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" podStartSLOduration=1.2866051170000001 podStartE2EDuration="2.809080345s" totalImagesPullingTime="1.522475228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:45:35.807625881 +0000 UTC m=+843.321773978" watchObservedRunningTime="2026-06-09 12:45:35.809080345 +0000 UTC m=+843.323228431" Jun 09 12:45:41.814023 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:41.813967 2555 generic.go:356] "Generic (PLEG): container finished" podID="ac9895ea-d7a8-483c-968c-0d4756576d46" containerID="f99a84df779b4b028b325b383898b042065f169eab88f6a2e205b152f405ac5c" exitCode=0 Jun 09 12:45:41.814458 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:41.814042 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" event={"ID":"ac9895ea-d7a8-483c-968c-0d4756576d46","Type":"ContainerDied","Data":"f99a84df779b4b028b325b383898b042065f169eab88f6a2e205b152f405ac5c"} Jun 09 12:45:41.814458 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:41.814428 2555 scope.go:117] "RemoveContainer" containerID="f99a84df779b4b028b325b383898b042065f169eab88f6a2e205b152f405ac5c" Jun 09 12:45:41.815381 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:41.815357 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 09 12:45:41.815434 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:41.815426 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 09 12:45:41.815470 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:41.815459 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 09 12:45:42.821898 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:42.821863 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" event={"ID":"ac9895ea-d7a8-483c-968c-0d4756576d46","Type":"ContainerStarted","Data":"31f863872f07238291215b10cf755d5195bf3e2b243bc53028e3b2ee0398555b"} Jun 09 12:45:43.575625 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:43.575587 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:45:43.575844 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:43.575640 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-fhm6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jun 09 12:45:43.575844 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:43.575706 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" podUID="ac9895ea-d7a8-483c-968c-0d4756576d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jun 09 12:45:44.161741 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:44.161703 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:45:44.162274 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:44.161893 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" containerID="cri-o://dc1c3f8f7e42c90673d07b0779edca23043d949760a51cd3835d6873f6b5d293" gracePeriod=30 Jun 09 12:45:44.575593 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:44.575495 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-fhm6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jun 09 12:45:44.575857 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:44.575826 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" podUID="ac9895ea-d7a8-483c-968c-0d4756576d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jun 09 12:45:45.576172 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:45.576126 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-fhm6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jun 09 12:45:45.576700 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:45.576205 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" podUID="ac9895ea-d7a8-483c-968c-0d4756576d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jun 09 12:45:45.839423 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:45.839394 2555 generic.go:356] "Generic (PLEG): container finished" podID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerID="dc1c3f8f7e42c90673d07b0779edca23043d949760a51cd3835d6873f6b5d293" exitCode=143 Jun 09 12:45:45.839585 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:45.839477 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ad06c905-dc3e-4014-bb85-f6e2ff3f1199","Type":"ContainerDied","Data":"dc1c3f8f7e42c90673d07b0779edca23043d949760a51cd3835d6873f6b5d293"} Jun 09 12:45:45.839585 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:45.839525 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ad06c905-dc3e-4014-bb85-f6e2ff3f1199","Type":"ContainerDied","Data":"de356bf3851f23767defea90ef1ebfef113e7f288ce6e4cb6c551148f91650ea"} Jun 09 12:45:45.839585 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:45.839539 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de356bf3851f23767defea90ef1ebfef113e7f288ce6e4cb6c551148f91650ea" Jun 09 12:45:45.848881 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:45.848859 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:45.972328 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:45.972286 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bb2m\" (UniqueName: \"kubernetes.io/projected/ad06c905-dc3e-4014-bb85-f6e2ff3f1199-kube-api-access-5bb2m\") pod \"ad06c905-dc3e-4014-bb85-f6e2ff3f1199\" (UID: \"ad06c905-dc3e-4014-bb85-f6e2ff3f1199\") " Jun 09 12:45:45.986129 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:45.984148 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad06c905-dc3e-4014-bb85-f6e2ff3f1199-kube-api-access-5bb2m" (OuterVolumeSpecName: "kube-api-access-5bb2m") pod "ad06c905-dc3e-4014-bb85-f6e2ff3f1199" (UID: "ad06c905-dc3e-4014-bb85-f6e2ff3f1199"). InnerVolumeSpecName "kube-api-access-5bb2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:45:46.073737 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.073696 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bb2m\" (UniqueName: \"kubernetes.io/projected/ad06c905-dc3e-4014-bb85-f6e2ff3f1199-kube-api-access-5bb2m\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:45:46.575265 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.575216 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-fhm6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jun 09 12:45:46.575500 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.575296 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" podUID="ac9895ea-d7a8-483c-968c-0d4756576d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jun 09 12:45:46.844949 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.844918 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:46.867810 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.867780 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:45:46.873437 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.873407 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:45:46.902449 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.902415 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:45:46.903146 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.903126 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" Jun 09 12:45:46.903200 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.903150 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" Jun 09 12:45:46.903266 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.903254 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" containerName="keycloak" Jun 09 12:45:46.905870 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.905849 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:46.911616 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.911592 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 12:45:46.911814 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.911797 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 12:45:46.912069 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.912055 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 12:45:46.912578 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.912564 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 12:45:46.912659 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.912566 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-bncf2\"" Jun 09 12:45:46.928138 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.928106 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:45:46.964880 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.964848 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad06c905-dc3e-4014-bb85-f6e2ff3f1199" path="/var/lib/kubelet/pods/ad06c905-dc3e-4014-bb85-f6e2ff3f1199/volumes" Jun 09 12:45:46.983813 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.983782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjb4s\" (UniqueName: \"kubernetes.io/projected/d624d14b-2553-4481-8c5e-da71aa514343-kube-api-access-vjb4s\") pod \"maas-keycloak-0\" (UID: \"d624d14b-2553-4481-8c5e-da71aa514343\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:46.983976 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:46.983847 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d624d14b-2553-4481-8c5e-da71aa514343-test-realms\") pod \"maas-keycloak-0\" (UID: \"d624d14b-2553-4481-8c5e-da71aa514343\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:47.084890 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.084850 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjb4s\" (UniqueName: \"kubernetes.io/projected/d624d14b-2553-4481-8c5e-da71aa514343-kube-api-access-vjb4s\") pod \"maas-keycloak-0\" (UID: \"d624d14b-2553-4481-8c5e-da71aa514343\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:47.085146 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.084911 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d624d14b-2553-4481-8c5e-da71aa514343-test-realms\") pod \"maas-keycloak-0\" (UID: \"d624d14b-2553-4481-8c5e-da71aa514343\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:47.085653 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.085632 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d624d14b-2553-4481-8c5e-da71aa514343-test-realms\") pod \"maas-keycloak-0\" (UID: \"d624d14b-2553-4481-8c5e-da71aa514343\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:47.096418 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.096361 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjb4s\" (UniqueName: \"kubernetes.io/projected/d624d14b-2553-4481-8c5e-da71aa514343-kube-api-access-vjb4s\") pod \"maas-keycloak-0\" (UID: \"d624d14b-2553-4481-8c5e-da71aa514343\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:47.218535 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.218488 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:47.376804 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:45:47.376768 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd624d14b_2553_4481_8c5e_da71aa514343.slice/crio-08ec480f86aca3ed3cb607ef3f13d9ee170fca23f8456ffafc117d1dd60e34c6 WatchSource:0}: Error finding container 08ec480f86aca3ed3cb607ef3f13d9ee170fca23f8456ffafc117d1dd60e34c6: Status 404 returned error can't find the container with id 08ec480f86aca3ed3cb607ef3f13d9ee170fca23f8456ffafc117d1dd60e34c6 Jun 09 12:45:47.377553 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.377530 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:45:47.578600 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.578573 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:45:47.578880 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.578862 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:45:47.579526 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.579510 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-fhm6z" Jun 09 12:45:47.792233 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.792186 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:45:47.792412 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.792264 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-jdb6c" Jun 09 12:45:47.854612 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.854566 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d624d14b-2553-4481-8c5e-da71aa514343","Type":"ContainerStarted","Data":"5ec351201db5c0b71c2c7a7164260df053bbf148944893b47df876630e0de1fc"} Jun 09 12:45:47.855090 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.854627 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d624d14b-2553-4481-8c5e-da71aa514343","Type":"ContainerStarted","Data":"08ec480f86aca3ed3cb607ef3f13d9ee170fca23f8456ffafc117d1dd60e34c6"} Jun 09 12:45:47.882773 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:47.882717 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.591755647 podStartE2EDuration="1.882701141s" totalImagesPullingTime="290.945494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:45:47.880159466 +0000 UTC m=+855.394307552" watchObservedRunningTime="2026-06-09 12:45:47.882701141 +0000 UTC m=+855.396849226" Jun 09 12:45:48.219633 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:48.219593 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:48.221566 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:48.221536 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:49.219307 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:49.219250 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:50.219261 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:50.219206 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:51.219559 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:51.219508 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:52.219334 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:52.219287 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:53.219181 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:53.219126 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:54.220127 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:54.219614 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:55.220507 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:55.220461 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:56.219143 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:56.219093 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:57.218858 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:57.218811 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 12:45:57.219651 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:57.219622 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:58.219783 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:58.219730 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:45:59.218943 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:45:59.218892 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:46:00.218914 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:00.218872 2555 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 09 12:46:01.344863 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:01.344824 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 12:46:01.364467 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:01.364418 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:46:11.351109 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:11.351056 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d624d14b-2553-4481-8c5e-da71aa514343" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:46:21.351695 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:21.351602 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 12:46:35.631421 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:35.631386 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59cbd96598-rs2lr"] Jun 09 12:46:35.631844 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:35.631567 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-59cbd96598-rs2lr" podUID="a05e61db-25ff-4f5d-9180-58b8f7f37835" containerName="authorino" containerID="cri-o://c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d" gracePeriod=30 Jun 09 12:46:35.889194 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:35.889133 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59cbd96598-rs2lr" Jun 09 12:46:35.987034 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:35.986973 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a05e61db-25ff-4f5d-9180-58b8f7f37835-tls-cert\") pod \"a05e61db-25ff-4f5d-9180-58b8f7f37835\" (UID: \"a05e61db-25ff-4f5d-9180-58b8f7f37835\") " Jun 09 12:46:35.987235 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:35.987144 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j986z\" (UniqueName: \"kubernetes.io/projected/a05e61db-25ff-4f5d-9180-58b8f7f37835-kube-api-access-j986z\") pod \"a05e61db-25ff-4f5d-9180-58b8f7f37835\" (UID: \"a05e61db-25ff-4f5d-9180-58b8f7f37835\") " Jun 09 12:46:35.989188 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:35.989162 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a05e61db-25ff-4f5d-9180-58b8f7f37835-kube-api-access-j986z" (OuterVolumeSpecName: "kube-api-access-j986z") pod "a05e61db-25ff-4f5d-9180-58b8f7f37835" (UID: "a05e61db-25ff-4f5d-9180-58b8f7f37835"). InnerVolumeSpecName "kube-api-access-j986z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:46:36.000457 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.000433 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a05e61db-25ff-4f5d-9180-58b8f7f37835-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a05e61db-25ff-4f5d-9180-58b8f7f37835" (UID: "a05e61db-25ff-4f5d-9180-58b8f7f37835"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:46:36.088299 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.088254 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j986z\" (UniqueName: \"kubernetes.io/projected/a05e61db-25ff-4f5d-9180-58b8f7f37835-kube-api-access-j986z\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:46:36.088299 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.088298 2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a05e61db-25ff-4f5d-9180-58b8f7f37835-tls-cert\") on node \"ip-10-0-135-164.ec2.internal\" DevicePath \"\"" Jun 09 12:46:36.165986 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.165901 2555 generic.go:356] "Generic (PLEG): container finished" podID="a05e61db-25ff-4f5d-9180-58b8f7f37835" containerID="c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d" exitCode=0 Jun 09 12:46:36.165986 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.165945 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59cbd96598-rs2lr" Jun 09 12:46:36.165986 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.165979 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59cbd96598-rs2lr" event={"ID":"a05e61db-25ff-4f5d-9180-58b8f7f37835","Type":"ContainerDied","Data":"c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d"} Jun 09 12:46:36.166249 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.166050 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59cbd96598-rs2lr" event={"ID":"a05e61db-25ff-4f5d-9180-58b8f7f37835","Type":"ContainerDied","Data":"d0f74a5a8b445a5e39c94cee5beef54a276706de8349fff44aeef8dad571c250"} Jun 09 12:46:36.166249 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.166073 2555 scope.go:117] "RemoveContainer" containerID="c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d" Jun 09 12:46:36.175591 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.175572 2555 scope.go:117] "RemoveContainer" containerID="c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d" Jun 09 12:46:36.175814 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:46:36.175796 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d\": container with ID starting with c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d not found: ID does not exist" containerID="c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d" Jun 09 12:46:36.175863 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.175821 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d"} err="failed to get container status \"c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d\": rpc error: code = NotFound desc = could not find container \"c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d\": container with ID starting with c17706131948f8766763ef3df27e250b7d20da4eb9e059e686ee88eeaa3ea89d not found: ID does not exist" Jun 09 12:46:36.193210 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.193184 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59cbd96598-rs2lr"] Jun 09 12:46:36.197140 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.197115 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59cbd96598-rs2lr"] Jun 09 12:46:36.965526 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:36.965493 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a05e61db-25ff-4f5d-9180-58b8f7f37835" path="/var/lib/kubelet/pods/a05e61db-25ff-4f5d-9180-58b8f7f37835/volumes" Jun 09 12:46:41.272093 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.272060 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px"] Jun 09 12:46:41.272616 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.272512 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a05e61db-25ff-4f5d-9180-58b8f7f37835" containerName="authorino" Jun 09 12:46:41.272616 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.272525 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a05e61db-25ff-4f5d-9180-58b8f7f37835" containerName="authorino" Jun 09 12:46:41.272746 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.272639 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a05e61db-25ff-4f5d-9180-58b8f7f37835" containerName="authorino" Jun 09 12:46:41.276197 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.276175 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.281426 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.281392 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ghvsf\"" Jun 09 12:46:41.281572 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.281460 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 12:46:41.281572 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.281391 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 12:46:41.281892 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.281408 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 12:46:41.290185 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.290155 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px"] Jun 09 12:46:41.337428 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.337385 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7t5t\" (UniqueName: \"kubernetes.io/projected/62cb1da0-670d-477e-ad9a-e4d4d7046774-kube-api-access-s7t5t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.337613 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.337446 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.337613 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.337466 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.337613 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.337486 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.337613 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.337588 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.337756 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.337630 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62cb1da0-670d-477e-ad9a-e4d4d7046774-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.438874 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.438831 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.439169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.438882 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62cb1da0-670d-477e-ad9a-e4d4d7046774-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.439169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.438921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7t5t\" (UniqueName: \"kubernetes.io/projected/62cb1da0-670d-477e-ad9a-e4d4d7046774-kube-api-access-s7t5t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.439169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.438962 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.439169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.438978 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.439169 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.438996 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.439458 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.439414 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.439515 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.439455 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.439515 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.439467 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.441470 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.441447 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62cb1da0-670d-477e-ad9a-e4d4d7046774-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.441747 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.441727 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62cb1da0-670d-477e-ad9a-e4d4d7046774-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.447741 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.447716 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7t5t\" (UniqueName: \"kubernetes.io/projected/62cb1da0-670d-477e-ad9a-e4d4d7046774-kube-api-access-s7t5t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d26px\" (UID: \"62cb1da0-670d-477e-ad9a-e4d4d7046774\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.595380 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.595343 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:46:41.779537 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:41.779511 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px"] Jun 09 12:46:41.781122 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:46:41.781094 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62cb1da0_670d_477e_ad9a_e4d4d7046774.slice/crio-b6f1ddcd922baf47c452cd604e81ac6778437cdb919eab921057d90c7f62917a WatchSource:0}: Error finding container b6f1ddcd922baf47c452cd604e81ac6778437cdb919eab921057d90c7f62917a: Status 404 returned error can't find the container with id b6f1ddcd922baf47c452cd604e81ac6778437cdb919eab921057d90c7f62917a Jun 09 12:46:42.201278 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:42.201236 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" event={"ID":"62cb1da0-670d-477e-ad9a-e4d4d7046774","Type":"ContainerStarted","Data":"b6f1ddcd922baf47c452cd604e81ac6778437cdb919eab921057d90c7f62917a"} Jun 09 12:46:46.229675 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:46.229634 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" event={"ID":"62cb1da0-670d-477e-ad9a-e4d4d7046774","Type":"ContainerStarted","Data":"b821aade1f1a7dc0865a87bade203f74807edccb0c528b79cd1cf96e220086e6"} Jun 09 12:46:47.378679 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.378639 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd"] Jun 09 12:46:47.383950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.383925 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.386579 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.386552 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 12:46:47.393813 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.393786 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd"] Jun 09 12:46:47.502442 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.502398 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.502612 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.502454 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.502612 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.502473 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.502612 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.502541 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4vj4\" (UniqueName: \"kubernetes.io/projected/da0df131-a23e-49e8-932b-f40e66624fad-kube-api-access-r4vj4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.502612 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.502578 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.502754 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.502664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da0df131-a23e-49e8-932b-f40e66624fad-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.603784 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.603755 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4vj4\" (UniqueName: \"kubernetes.io/projected/da0df131-a23e-49e8-932b-f40e66624fad-kube-api-access-r4vj4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.603980 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.603795 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.603980 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.603845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da0df131-a23e-49e8-932b-f40e66624fad-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.603980 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.603873 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.603980 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.603901 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.603980 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.603919 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.604342 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.604306 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.604455 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.604348 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.604455 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.604384 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.606634 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.606611 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da0df131-a23e-49e8-932b-f40e66624fad-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.606774 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.606750 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da0df131-a23e-49e8-932b-f40e66624fad-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.612682 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.612655 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4vj4\" (UniqueName: \"kubernetes.io/projected/da0df131-a23e-49e8-932b-f40e66624fad-kube-api-access-r4vj4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-649pd\" (UID: \"da0df131-a23e-49e8-932b-f40e66624fad\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.696792 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.696697 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:46:47.848815 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:47.848789 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd"] Jun 09 12:46:47.850471 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:46:47.850441 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda0df131_a23e_49e8_932b_f40e66624fad.slice/crio-af18feced7723be3fcba7149fe818a587225b0c25e94127bd29e9e354598fff5 WatchSource:0}: Error finding container af18feced7723be3fcba7149fe818a587225b0c25e94127bd29e9e354598fff5: Status 404 returned error can't find the container with id af18feced7723be3fcba7149fe818a587225b0c25e94127bd29e9e354598fff5 Jun 09 12:46:48.246687 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:48.246651 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" event={"ID":"da0df131-a23e-49e8-932b-f40e66624fad","Type":"ContainerStarted","Data":"9e6e6288878beb5bf810a072221cc861930bb672fd25f7cdd18db6d4f4ad446c"} Jun 09 12:46:48.246891 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:46:48.246717 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" event={"ID":"da0df131-a23e-49e8-932b-f40e66624fad","Type":"ContainerStarted","Data":"af18feced7723be3fcba7149fe818a587225b0c25e94127bd29e9e354598fff5"} Jun 09 12:47:33.104944 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.104915 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5"] Jun 09 12:47:33.110046 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.109987 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.121018 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.120982 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 12:47:33.135871 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.135834 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5"] Jun 09 12:47:33.254237 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.254206 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.254403 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.254245 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.254403 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.254267 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a87438-77fd-4cb9-b920-824c8e18605d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.254403 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.254378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.254515 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.254443 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz5vd\" (UniqueName: \"kubernetes.io/projected/f0a87438-77fd-4cb9-b920-824c8e18605d-kube-api-access-hz5vd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.254551 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.254516 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.355570 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.355471 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.355570 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.355531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.355570 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.355548 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a87438-77fd-4cb9-b920-824c8e18605d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.355848 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.355584 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.355848 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.355727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5vd\" (UniqueName: \"kubernetes.io/projected/f0a87438-77fd-4cb9-b920-824c8e18605d-kube-api-access-hz5vd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.355965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.355847 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.355965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.355923 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.355965 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.355946 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.356229 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.356203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.357963 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.357941 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0a87438-77fd-4cb9-b920-824c8e18605d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.358205 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.358186 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a87438-77fd-4cb9-b920-824c8e18605d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.369845 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.369823 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz5vd\" (UniqueName: \"kubernetes.io/projected/f0a87438-77fd-4cb9-b920-824c8e18605d-kube-api-access-hz5vd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5\" (UID: \"f0a87438-77fd-4cb9-b920-824c8e18605d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.421889 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.421865 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:33.584207 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:33.584175 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5"] Jun 09 12:47:33.590972 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:47:33.590945 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a87438_77fd_4cb9_b920_824c8e18605d.slice/crio-2f6644c00ff96cdd5d398f82936806663d97f14bbf8c63318130b44b9bc4af1b WatchSource:0}: Error finding container 2f6644c00ff96cdd5d398f82936806663d97f14bbf8c63318130b44b9bc4af1b: Status 404 returned error can't find the container with id 2f6644c00ff96cdd5d398f82936806663d97f14bbf8c63318130b44b9bc4af1b Jun 09 12:47:34.501887 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:34.501850 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" event={"ID":"f0a87438-77fd-4cb9-b920-824c8e18605d","Type":"ContainerStarted","Data":"f6f8e16fd78ee3ae1e05e592e9821cbcfccc272b8fee6b95540ebfa125c3d5e6"} Jun 09 12:47:34.502304 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:34.501911 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" event={"ID":"f0a87438-77fd-4cb9-b920-824c8e18605d","Type":"ContainerStarted","Data":"2f6644c00ff96cdd5d398f82936806663d97f14bbf8c63318130b44b9bc4af1b"} Jun 09 12:47:35.508680 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:35.508649 2555 generic.go:356] "Generic (PLEG): container finished" podID="f0a87438-77fd-4cb9-b920-824c8e18605d" containerID="f6f8e16fd78ee3ae1e05e592e9821cbcfccc272b8fee6b95540ebfa125c3d5e6" exitCode=0 Jun 09 12:47:35.509145 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:35.508744 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" event={"ID":"f0a87438-77fd-4cb9-b920-824c8e18605d","Type":"ContainerDied","Data":"f6f8e16fd78ee3ae1e05e592e9821cbcfccc272b8fee6b95540ebfa125c3d5e6"} Jun 09 12:47:35.509228 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:35.509213 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:47:36.518107 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:36.518066 2555 generic.go:356] "Generic (PLEG): container finished" podID="828b1fc8-01c8-4cf9-8604-b9d2e31889a8" containerID="ddfee6e26e3336b466bba86c71cb5d691d96dbbd5f0396ed41e186c007d8bc82" exitCode=1 Jun 09 12:47:36.518608 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:36.518132 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" event={"ID":"828b1fc8-01c8-4cf9-8604-b9d2e31889a8","Type":"ContainerDied","Data":"ddfee6e26e3336b466bba86c71cb5d691d96dbbd5f0396ed41e186c007d8bc82"} Jun 09 12:47:36.518608 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:36.518552 2555 scope.go:117] "RemoveContainer" containerID="ddfee6e26e3336b466bba86c71cb5d691d96dbbd5f0396ed41e186c007d8bc82" Jun 09 12:47:37.525976 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:37.525938 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" event={"ID":"f0a87438-77fd-4cb9-b920-824c8e18605d","Type":"ContainerStarted","Data":"f66d335c194d309d62fc2f655f3a74a59a79af3c9dd49143ac65035faa7fbaa5"} Jun 09 12:47:37.527960 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:37.527934 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" event={"ID":"828b1fc8-01c8-4cf9-8604-b9d2e31889a8","Type":"ContainerStarted","Data":"82b1ea45edc3d8c2ff312e8b30fef44d091be65616e7486d3c45aa6c3ef2b2f1"} Jun 09 12:47:37.528170 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:37.528153 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:47:37.556434 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:37.556388 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" podStartSLOduration=2.250409909 podStartE2EDuration="4.556373497s" totalImagesPullingTime="1.109441741s" totalInitContainerRuntime="1.196521847s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:37.554242313 +0000 UTC m=+965.068390400" watchObservedRunningTime="2026-06-09 12:47:37.556373497 +0000 UTC m=+965.070521599" Jun 09 12:47:38.535116 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:38.535082 2555 generic.go:356] "Generic (PLEG): container finished" podID="62cb1da0-670d-477e-ad9a-e4d4d7046774" containerID="b821aade1f1a7dc0865a87bade203f74807edccb0c528b79cd1cf96e220086e6" exitCode=0 Jun 09 12:47:38.535512 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:38.535155 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" event={"ID":"62cb1da0-670d-477e-ad9a-e4d4d7046774","Type":"ContainerDied","Data":"b821aade1f1a7dc0865a87bade203f74807edccb0c528b79cd1cf96e220086e6"} Jun 09 12:47:39.542712 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:39.542680 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" event={"ID":"62cb1da0-670d-477e-ad9a-e4d4d7046774","Type":"ContainerStarted","Data":"0f669358420b0b174d43e0054156da9dc084a1ad32409b8a882c13304b25c7fe"} Jun 09 12:47:39.576726 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:39.576676 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" podStartSLOduration=2.179493345 podStartE2EDuration="58.576662042s" totalImagesPullingTime="4.263405798s" totalInitContainerRuntime="52.133762899s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:46:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:39.575885251 +0000 UTC m=+967.090033336" watchObservedRunningTime="2026-06-09 12:47:39.576662042 +0000 UTC m=+967.090810145" Jun 09 12:47:41.596127 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:41.596092 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:47:41.596526 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:41.596429 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:47:41.608608 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:41.608583 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:47:42.569788 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:42.569760 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d26px" Jun 09 12:47:43.422326 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:43.422289 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:43.422830 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:43.422356 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:43.434805 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:43.434778 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:43.575131 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:43.575105 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5" Jun 09 12:47:44.938039 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:44.937991 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f"] Jun 09 12:47:44.945597 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:44.945573 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:44.948806 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:44.948786 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 12:47:44.964875 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:44.964852 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f"] Jun 09 12:47:44.976910 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:44.976883 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:44.977076 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:44.976922 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:44.977076 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:44.977032 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqr4v\" (UniqueName: \"kubernetes.io/projected/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-kube-api-access-nqr4v\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:44.977186 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:44.977162 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:44.977245 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:44.977225 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:44.977304 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:44.977288 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.078397 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.078352 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.078598 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.078407 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.078598 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.078436 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqr4v\" (UniqueName: \"kubernetes.io/projected/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-kube-api-access-nqr4v\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.078598 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.078488 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.078598 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.078533 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.078598 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.078575 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.078885 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.078834 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.078885 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.078872 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.079209 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.079181 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.080923 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.080901 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.081458 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.081443 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.092904 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.092883 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqr4v\" (UniqueName: \"kubernetes.io/projected/6d9419e9-abf3-408a-ab7e-4ec41902ef4f-kube-api-access-nqr4v\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f\" (UID: \"6d9419e9-abf3-408a-ab7e-4ec41902ef4f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.256845 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.256746 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" Jun 09 12:47:45.430312 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.430278 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f"] Jun 09 12:47:45.430521 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:47:45.430494 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d9419e9_abf3_408a_ab7e_4ec41902ef4f.slice/crio-c3290f96a4602b469740e7164086008e60b069b241f554fcd95bcd64cf590aad WatchSource:0}: Error finding container c3290f96a4602b469740e7164086008e60b069b241f554fcd95bcd64cf590aad: Status 404 returned error can't find the container with id c3290f96a4602b469740e7164086008e60b069b241f554fcd95bcd64cf590aad Jun 09 12:47:45.578144 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.578050 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" event={"ID":"6d9419e9-abf3-408a-ab7e-4ec41902ef4f","Type":"ContainerStarted","Data":"bdde03e79c3541329fcb4e2ec9527971ca5bc7955beb986c796218610161cad1"} Jun 09 12:47:45.578144 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:45.578121 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f" event={"ID":"6d9419e9-abf3-408a-ab7e-4ec41902ef4f","Type":"ContainerStarted","Data":"c3290f96a4602b469740e7164086008e60b069b241f554fcd95bcd64cf590aad"} Jun 09 12:47:48.537809 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:47:48.537773 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:49:23.118398 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:23.118363 2555 generic.go:356] "Generic (PLEG): container finished" podID="da0df131-a23e-49e8-932b-f40e66624fad" containerID="9e6e6288878beb5bf810a072221cc861930bb672fd25f7cdd18db6d4f4ad446c" exitCode=0 Jun 09 12:49:23.118819 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:23.118435 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" event={"ID":"da0df131-a23e-49e8-932b-f40e66624fad","Type":"ContainerDied","Data":"9e6e6288878beb5bf810a072221cc861930bb672fd25f7cdd18db6d4f4ad446c"} Jun 09 12:49:24.126929 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:24.126889 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" event={"ID":"da0df131-a23e-49e8-932b-f40e66624fad","Type":"ContainerStarted","Data":"c079637cbfe5cfcfef76e82444f064e7b476cfd58e4a8fa7b54d4ac70f4f2496"} Jun 09 12:49:24.149633 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:24.149584 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" podStartSLOduration=2.016861296 podStartE2EDuration="2m37.149570097s" totalImagesPullingTime="254.147879ms" totalInitContainerRuntime="2m34.878560922s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:49:24.147528588 +0000 UTC m=+1071.661676673" watchObservedRunningTime="2026-06-09 12:49:24.149570097 +0000 UTC m=+1071.663718204" Jun 09 12:49:27.697446 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:27.697405 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:49:27.697949 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:27.697483 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:49:27.709696 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:27.709674 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:49:28.161323 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:28.161294 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-649pd" Jun 09 12:49:37.201240 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:37.201208 2555 generic.go:356] "Generic (PLEG): container finished" podID="828b1fc8-01c8-4cf9-8604-b9d2e31889a8" containerID="82b1ea45edc3d8c2ff312e8b30fef44d091be65616e7486d3c45aa6c3ef2b2f1" exitCode=1 Jun 09 12:49:37.201664 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:37.201281 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" event={"ID":"828b1fc8-01c8-4cf9-8604-b9d2e31889a8","Type":"ContainerDied","Data":"82b1ea45edc3d8c2ff312e8b30fef44d091be65616e7486d3c45aa6c3ef2b2f1"} Jun 09 12:49:37.201664 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:37.201338 2555 scope.go:117] "RemoveContainer" containerID="ddfee6e26e3336b466bba86c71cb5d691d96dbbd5f0396ed41e186c007d8bc82" Jun 09 12:49:37.201769 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:37.201681 2555 scope.go:117] "RemoveContainer" containerID="82b1ea45edc3d8c2ff312e8b30fef44d091be65616e7486d3c45aa6c3ef2b2f1" Jun 09 12:49:37.201949 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:49:37.201928 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-gfc8b_openshift-ingress(828b1fc8-01c8-4cf9-8604-b9d2e31889a8)\"" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" podUID="828b1fc8-01c8-4cf9-8604-b9d2e31889a8" Jun 09 12:49:38.536099 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:38.536045 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:49:38.536542 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:38.536421 2555 scope.go:117] "RemoveContainer" containerID="82b1ea45edc3d8c2ff312e8b30fef44d091be65616e7486d3c45aa6c3ef2b2f1" Jun 09 12:49:38.536643 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:49:38.536622 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-gfc8b_openshift-ingress(828b1fc8-01c8-4cf9-8604-b9d2e31889a8)\"" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" podUID="828b1fc8-01c8-4cf9-8604-b9d2e31889a8" Jun 09 12:49:50.957827 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:50.957793 2555 scope.go:117] "RemoveContainer" containerID="82b1ea45edc3d8c2ff312e8b30fef44d091be65616e7486d3c45aa6c3ef2b2f1" Jun 09 12:49:51.282617 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:51.282527 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" event={"ID":"828b1fc8-01c8-4cf9-8604-b9d2e31889a8","Type":"ContainerStarted","Data":"334aa5c0e5fd17fcdf2b890b94408a124fecaf344f4100c627c40c05b8e47b91"} Jun 09 12:49:51.282789 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:49:51.282737 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:50:02.289932 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:50:02.289897 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:50:33.118887 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:50:33.118852 2555 scope.go:117] "RemoveContainer" containerID="dc1c3f8f7e42c90673d07b0779edca23043d949760a51cd3835d6873f6b5d293" Jun 09 12:51:39.086161 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:39.086129 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f_6d9419e9-abf3-408a-ab7e-4ec41902ef4f/storage-initializer/0.log" Jun 09 12:51:44.826462 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:44.826427 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5fd759c44c-9fvmw_3e3af169-5542-40ca-ae0d-b7237764b66b/nginx/0.log" Jun 09 12:51:45.443644 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:45.443601 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dbd84d96-jl98n_1dbedeee-c306-48b2-9e0b-5b38ddd46d4f/manager/0.log" Jun 09 12:51:45.818521 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:45.818440 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-54whn_db1e4702-b20a-4e5d-98cd-76684cdaa9fc/copy-manifests/0.log" Jun 09 12:51:45.827027 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:45.826976 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-54whn_db1e4702-b20a-4e5d-98cd-76684cdaa9fc/manager/0.log" Jun 09 12:51:47.932220 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:47.932191 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6ffks_0507a932-4b95-494c-a398-a96b62533d3a/manager/0.log" Jun 09 12:51:48.163898 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:48.163865 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jgb8k_751c18bb-ff7d-48e5-936a-e00803de6e31/registry-server/0.log" Jun 09 12:51:48.284415 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:48.284337 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fg8qw_ca11da56-9bee-4d70-a6da-796881e3690f/manager/0.log" Jun 09 12:51:48.515360 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:48.515327 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gfghm_891c0a93-cea1-49cd-a121-b107a2d1fe66/manager/0.log" Jun 09 12:51:48.869244 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:48.869213 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5_7d28b518-3f0d-4971-a800-44002bde7a7d/istio-proxy/0.log" Jun 09 12:51:49.373534 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:49.373504 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-fhm6z_ac9895ea-d7a8-483c-968c-0d4756576d46/istio-proxy/1.log" Jun 09 12:51:49.481644 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:49.481622 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jdb6c_d2399b50-b136-42fb-9b07-792241f88719/payload-pre-processing/0.log" Jun 09 12:51:49.595159 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:49.595127 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gfc8b_828b1fc8-01c8-4cf9-8604-b9d2e31889a8/payload-processing/2.log" Jun 09 12:51:50.067341 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:50.067314 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-d26px_62cb1da0-670d-477e-ad9a-e4d4d7046774/storage-initializer/0.log" Jun 09 12:51:50.076313 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:50.076292 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-d26px_62cb1da0-670d-477e-ad9a-e4d4d7046774/main/0.log" Jun 09 12:51:50.200076 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:50.200016 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-649pd_da0df131-a23e-49e8-932b-f40e66624fad/storage-initializer/0.log" Jun 09 12:51:50.214855 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:50.214832 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-649pd_da0df131-a23e-49e8-932b-f40e66624fad/main/0.log" Jun 09 12:51:50.465828 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:50.465801 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5_f0a87438-77fd-4cb9-b920-824c8e18605d/main/0.log" Jun 09 12:51:50.473084 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:50.473062 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqx6z5_f0a87438-77fd-4cb9-b920-824c8e18605d/storage-initializer/0.log" Jun 09 12:51:50.593525 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:50.593493 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-bxf9f_6d9419e9-abf3-408a-ab7e-4ec41902ef4f/storage-initializer/0.log" Jun 09 12:51:51.979763 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:51.979730 2555 generic.go:356] "Generic (PLEG): container finished" podID="828b1fc8-01c8-4cf9-8604-b9d2e31889a8" containerID="334aa5c0e5fd17fcdf2b890b94408a124fecaf344f4100c627c40c05b8e47b91" exitCode=1 Jun 09 12:51:51.980198 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:51.979796 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" event={"ID":"828b1fc8-01c8-4cf9-8604-b9d2e31889a8","Type":"ContainerDied","Data":"334aa5c0e5fd17fcdf2b890b94408a124fecaf344f4100c627c40c05b8e47b91"} Jun 09 12:51:51.980198 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:51.979848 2555 scope.go:117] "RemoveContainer" containerID="82b1ea45edc3d8c2ff312e8b30fef44d091be65616e7486d3c45aa6c3ef2b2f1" Jun 09 12:51:51.980322 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:51.980214 2555 scope.go:117] "RemoveContainer" containerID="334aa5c0e5fd17fcdf2b890b94408a124fecaf344f4100c627c40c05b8e47b91" Jun 09 12:51:51.980478 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:51:51.980459 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-gfc8b_openshift-ingress(828b1fc8-01c8-4cf9-8604-b9d2e31889a8)\"" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" podUID="828b1fc8-01c8-4cf9-8604-b9d2e31889a8" Jun 09 12:51:52.288172 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:52.288084 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:51:52.986788 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:52.986761 2555 scope.go:117] "RemoveContainer" containerID="334aa5c0e5fd17fcdf2b890b94408a124fecaf344f4100c627c40c05b8e47b91" Jun 09 12:51:52.987236 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:51:52.986966 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-gfc8b_openshift-ingress(828b1fc8-01c8-4cf9-8604-b9d2e31889a8)\"" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" podUID="828b1fc8-01c8-4cf9-8604-b9d2e31889a8" Jun 09 12:51:53.667774 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:53.667723 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:51:53.994204 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:53.994121 2555 scope.go:117] "RemoveContainer" containerID="334aa5c0e5fd17fcdf2b890b94408a124fecaf344f4100c627c40c05b8e47b91" Jun 09 12:51:53.994600 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:51:53.994359 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-gfc8b_openshift-ingress(828b1fc8-01c8-4cf9-8604-b9d2e31889a8)\"" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" podUID="828b1fc8-01c8-4cf9-8604-b9d2e31889a8" Jun 09 12:51:58.677552 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:58.677527 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qxl9t_79e89228-0242-4e97-98a2-5432c7b7e319/global-pull-secret-syncer/0.log" Jun 09 12:51:58.785456 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:58.785427 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-krdzp_572ea6d9-269a-4d3a-86e8-a19b840b7724/konnectivity-agent/0.log" Jun 09 12:51:58.834854 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:51:58.834827 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-164.ec2.internal_a4aaeb683b3b1a7a518043c3fe0c1ee5/haproxy/0.log" Jun 09 12:52:03.490806 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:03.490773 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6ffks_0507a932-4b95-494c-a398-a96b62533d3a/manager/0.log" Jun 09 12:52:03.554371 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:03.554343 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jgb8k_751c18bb-ff7d-48e5-936a-e00803de6e31/registry-server/0.log" Jun 09 12:52:03.594478 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:03.594442 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fg8qw_ca11da56-9bee-4d70-a6da-796881e3690f/manager/0.log" Jun 09 12:52:03.656909 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:03.656877 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gfghm_891c0a93-cea1-49cd-a121-b107a2d1fe66/manager/0.log" Jun 09 12:52:05.482899 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.482867 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e06d88e-f0be-4fca-81b7-d47ff01cf046/alertmanager/0.log" Jun 09 12:52:05.516688 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.516659 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e06d88e-f0be-4fca-81b7-d47ff01cf046/config-reloader/0.log" Jun 09 12:52:05.543538 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.543518 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e06d88e-f0be-4fca-81b7-d47ff01cf046/kube-rbac-proxy-web/0.log" Jun 09 12:52:05.570989 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.570964 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e06d88e-f0be-4fca-81b7-d47ff01cf046/kube-rbac-proxy/0.log" Jun 09 12:52:05.594291 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.594234 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e06d88e-f0be-4fca-81b7-d47ff01cf046/kube-rbac-proxy-metric/0.log" Jun 09 12:52:05.625193 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.625172 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e06d88e-f0be-4fca-81b7-d47ff01cf046/prom-label-proxy/0.log" Jun 09 12:52:05.650475 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.650450 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e06d88e-f0be-4fca-81b7-d47ff01cf046/init-config-reloader/0.log" Jun 09 12:52:05.693220 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.693195 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-rjkw5_13b42da2-bc96-4e3e-a072-29f0119aed46/cluster-monitoring-operator/0.log" Jun 09 12:52:05.728906 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.728879 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5tx8v_39609855-c635-4538-a8ed-5e79210ee7d6/kube-state-metrics/0.log" Jun 09 12:52:05.751619 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.751552 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5tx8v_39609855-c635-4538-a8ed-5e79210ee7d6/kube-rbac-proxy-main/0.log" Jun 09 12:52:05.782244 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:05.782212 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5tx8v_39609855-c635-4538-a8ed-5e79210ee7d6/kube-rbac-proxy-self/0.log" Jun 09 12:52:06.074440 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.074358 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qg2qt_a66e5190-05fc-49ca-9ab6-853c7b0586d9/node-exporter/0.log" Jun 09 12:52:06.101609 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.101578 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qg2qt_a66e5190-05fc-49ca-9ab6-853c7b0586d9/kube-rbac-proxy/0.log" Jun 09 12:52:06.127213 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.127190 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qg2qt_a66e5190-05fc-49ca-9ab6-853c7b0586d9/init-textfile/0.log" Jun 09 12:52:06.454075 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.454046 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7v2l6_41eab9ac-7e6a-44d5-b9e9-44d003064cf6/prometheus-operator/0.log" Jun 09 12:52:06.478981 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.478956 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7v2l6_41eab9ac-7e6a-44d5-b9e9-44d003064cf6/kube-rbac-proxy/0.log" Jun 09 12:52:06.506897 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.506870 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-xbldf_874b7331-81de-4c95-8783-48fc879b50dc/prometheus-operator-admission-webhook/0.log" Jun 09 12:52:06.543756 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.543732 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dd5c68d4-vqxck_70f25845-9f76-407f-8e23-647e4d51282a/telemeter-client/0.log" Jun 09 12:52:06.567719 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.567700 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dd5c68d4-vqxck_70f25845-9f76-407f-8e23-647e4d51282a/reload/0.log" Jun 09 12:52:06.590681 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.590649 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dd5c68d4-vqxck_70f25845-9f76-407f-8e23-647e4d51282a/kube-rbac-proxy/0.log" Jun 09 12:52:06.637631 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.637609 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/thanos-query/0.log" Jun 09 12:52:06.662763 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.662745 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/kube-rbac-proxy-web/0.log" Jun 09 12:52:06.690024 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.689989 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/kube-rbac-proxy/0.log" Jun 09 12:52:06.715889 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.715829 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/prom-label-proxy/0.log" Jun 09 12:52:06.744116 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.744093 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/kube-rbac-proxy-rules/0.log" Jun 09 12:52:06.768367 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:06.768341 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b7869645b-wzvft_a0316c1f-b6cb-48b6-a998-3f84ba4a5131/kube-rbac-proxy-metrics/0.log" Jun 09 12:52:08.097130 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.097095 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-pzw2l_43afa927-47d9-4912-8f71-aaf254512973/networking-console-plugin/0.log" Jun 09 12:52:08.836382 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.836351 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d"] Jun 09 12:52:08.839755 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.839735 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:08.842637 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.842617 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m2w5j\"/\"default-dockercfg-pv9dm\"" Jun 09 12:52:08.843949 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.843927 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m2w5j\"/\"openshift-service-ca.crt\"" Jun 09 12:52:08.844075 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.843986 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m2w5j\"/\"kube-root-ca.crt\"" Jun 09 12:52:08.847986 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.847960 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d"] Jun 09 12:52:08.907928 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.907893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgfzj\" (UniqueName: \"kubernetes.io/projected/be5d4965-d025-41fb-9555-54f051610824-kube-api-access-wgfzj\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:08.908105 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.907941 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-podres\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:08.908105 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.908068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-proc\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:08.908105 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.908095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-sys\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:08.908223 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.908111 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-lib-modules\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:08.957877 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:08.957848 2555 scope.go:117] "RemoveContainer" containerID="334aa5c0e5fd17fcdf2b890b94408a124fecaf344f4100c627c40c05b8e47b91" Jun 09 12:52:08.958092 ip-10-0-135-164 kubenswrapper[2555]: E0609 12:52:08.958074 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-gfc8b_openshift-ingress(828b1fc8-01c8-4cf9-8604-b9d2e31889a8)\"" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" podUID="828b1fc8-01c8-4cf9-8604-b9d2e31889a8" Jun 09 12:52:09.008910 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.008878 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgfzj\" (UniqueName: \"kubernetes.io/projected/be5d4965-d025-41fb-9555-54f051610824-kube-api-access-wgfzj\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.009107 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.008923 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-podres\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.009107 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.008967 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-proc\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.009107 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.009053 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-proc\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.009225 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.009114 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-sys\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.009225 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.009133 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-podres\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.009225 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.009142 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-lib-modules\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.009225 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.009180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-sys\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.009352 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.009235 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be5d4965-d025-41fb-9555-54f051610824-lib-modules\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.018795 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.018765 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgfzj\" (UniqueName: \"kubernetes.io/projected/be5d4965-d025-41fb-9555-54f051610824-kube-api-access-wgfzj\") pod \"perf-node-gather-daemonset-h869d\" (UID: \"be5d4965-d025-41fb-9555-54f051610824\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.151591 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.151562 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:09.290037 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:09.289994 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d"] Jun 09 12:52:09.291772 ip-10-0-135-164 kubenswrapper[2555]: W0609 12:52:09.291747 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbe5d4965_d025_41fb_9555_54f051610824.slice/crio-994ec8510839f4fb69e424711eca91597a4781bdf3ff3115747ba4c99b057658 WatchSource:0}: Error finding container 994ec8510839f4fb69e424711eca91597a4781bdf3ff3115747ba4c99b057658: Status 404 returned error can't find the container with id 994ec8510839f4fb69e424711eca91597a4781bdf3ff3115747ba4c99b057658 Jun 09 12:52:10.092516 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:10.092474 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" event={"ID":"be5d4965-d025-41fb-9555-54f051610824","Type":"ContainerStarted","Data":"6d894af0f14ffc752bb0630164c52b93fe2a405b071178f542bb8fb7b6ec8df9"} Jun 09 12:52:10.092712 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:10.092537 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" event={"ID":"be5d4965-d025-41fb-9555-54f051610824","Type":"ContainerStarted","Data":"994ec8510839f4fb69e424711eca91597a4781bdf3ff3115747ba4c99b057658"} Jun 09 12:52:10.092712 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:10.092700 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:10.109867 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:10.109816 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" podStartSLOduration=2.109802319 podStartE2EDuration="2.109802319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:52:10.108049686 +0000 UTC m=+1237.622197773" watchObservedRunningTime="2026-06-09 12:52:10.109802319 +0000 UTC m=+1237.623950447" Jun 09 12:52:11.235118 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:11.235094 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgcb7_58e7cc69-6586-4fe2-8051-01ff87f28b2b/dns/0.log" Jun 09 12:52:11.258472 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:11.258442 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgcb7_58e7cc69-6586-4fe2-8051-01ff87f28b2b/kube-rbac-proxy/0.log" Jun 09 12:52:11.451650 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:11.451616 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5262_90eff6cf-05c0-47be-a6f2-40f689890444/dns-node-resolver/0.log" Jun 09 12:52:12.073230 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:12.073198 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjbzc_defc77c1-b17f-4f7e-b81d-fe817b6423f4/node-ca/0.log" Jun 09 12:52:13.180184 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:13.180158 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5_7d28b518-3f0d-4971-a800-44002bde7a7d/istio-proxy/0.log" Jun 09 12:52:13.329429 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:13.329402 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-fhm6z_ac9895ea-d7a8-483c-968c-0d4756576d46/istio-proxy/1.log" Jun 09 12:52:13.329642 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:13.329611 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-fhm6z_ac9895ea-d7a8-483c-968c-0d4756576d46/istio-proxy/0.log" Jun 09 12:52:13.356892 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:13.356870 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jdb6c_d2399b50-b136-42fb-9b07-792241f88719/payload-pre-processing/0.log" Jun 09 12:52:13.387110 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:13.387080 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gfc8b_828b1fc8-01c8-4cf9-8604-b9d2e31889a8/payload-processing/2.log" Jun 09 12:52:13.387273 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:13.387148 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gfc8b_828b1fc8-01c8-4cf9-8604-b9d2e31889a8/payload-processing/2.log" Jun 09 12:52:14.089086 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:14.089057 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lhhw2_2eb1ee7f-a2c0-4047-a06c-7a5bdfe59217/serve-healthcheck-canary/0.log" Jun 09 12:52:14.688861 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:14.688830 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-fnvcd_6fbd7ff6-c8e4-4284-9534-83bb1c63c731/insights-operator/0.log" Jun 09 12:52:14.690383 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:14.690357 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-fnvcd_6fbd7ff6-c8e4-4284-9534-83bb1c63c731/insights-operator/1.log" Jun 09 12:52:14.900543 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:14.900514 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g6rf4_124d515e-085d-49c0-9f7d-20504773847e/kube-rbac-proxy/0.log" Jun 09 12:52:14.930823 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:14.930800 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g6rf4_124d515e-085d-49c0-9f7d-20504773847e/exporter/0.log" Jun 09 12:52:14.967777 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:14.967686 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g6rf4_124d515e-085d-49c0-9f7d-20504773847e/extractor/0.log" Jun 09 12:52:16.108654 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:16.108627 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-h869d" Jun 09 12:52:17.368652 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:17.368628 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5fd759c44c-9fvmw_3e3af169-5542-40ca-ae0d-b7237764b66b/nginx/0.log" Jun 09 12:52:17.624286 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:17.624212 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dbd84d96-jl98n_1dbedeee-c306-48b2-9e0b-5b38ddd46d4f/manager/0.log" Jun 09 12:52:17.815186 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:17.815159 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-54whn_db1e4702-b20a-4e5d-98cd-76684cdaa9fc/manager/0.log" Jun 09 12:52:17.858515 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:17.858491 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-54whn_db1e4702-b20a-4e5d-98cd-76684cdaa9fc/copy-manifests/0.log" Jun 09 12:52:19.722255 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:19.722217 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b48576bd-lbgz4_8f8177db-d999-42dc-aea5-706f63092da3/manager/0.log" Jun 09 12:52:21.957908 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:21.957874 2555 scope.go:117] "RemoveContainer" containerID="334aa5c0e5fd17fcdf2b890b94408a124fecaf344f4100c627c40c05b8e47b91" Jun 09 12:52:22.169611 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:22.169560 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" event={"ID":"828b1fc8-01c8-4cf9-8604-b9d2e31889a8","Type":"ContainerStarted","Data":"06144d5f13f89ca598ad0ed065b6dd0f39895983d8592202b64bf2c67602fce9"} Jun 09 12:52:22.169887 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:22.169857 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-gfc8b" Jun 09 12:52:22.656867 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:22.656827 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5_7d28b518-3f0d-4971-a800-44002bde7a7d/istio-proxy/0.log" Jun 09 12:52:22.782950 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:22.782922 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-fhm6z_ac9895ea-d7a8-483c-968c-0d4756576d46/istio-proxy/1.log" Jun 09 12:52:22.783329 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:22.783307 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-fhm6z_ac9895ea-d7a8-483c-968c-0d4756576d46/istio-proxy/0.log" Jun 09 12:52:22.796889 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:22.796872 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jdb6c_d2399b50-b136-42fb-9b07-792241f88719/payload-pre-processing/0.log" Jun 09 12:52:22.824977 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:22.824947 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gfc8b_828b1fc8-01c8-4cf9-8604-b9d2e31889a8/payload-processing/2.log" Jun 09 12:52:22.825566 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:22.825550 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gfc8b_828b1fc8-01c8-4cf9-8604-b9d2e31889a8/payload-processing/3.log" Jun 09 12:52:23.916567 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:23.916529 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5_7d28b518-3f0d-4971-a800-44002bde7a7d/istio-proxy/0.log" Jun 09 12:52:24.032282 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:24.032248 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-fhm6z_ac9895ea-d7a8-483c-968c-0d4756576d46/istio-proxy/1.log" Jun 09 12:52:24.032685 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:24.032665 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-fhm6z_ac9895ea-d7a8-483c-968c-0d4756576d46/istio-proxy/0.log" Jun 09 12:52:24.045496 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:24.045472 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jdb6c_d2399b50-b136-42fb-9b07-792241f88719/payload-pre-processing/0.log" Jun 09 12:52:24.067102 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:24.067076 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gfc8b_828b1fc8-01c8-4cf9-8604-b9d2e31889a8/payload-processing/3.log" Jun 09 12:52:24.068457 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:24.068432 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gfc8b_828b1fc8-01c8-4cf9-8604-b9d2e31889a8/payload-processing/2.log" Jun 09 12:52:25.313365 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:25.313283 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-n6w2m_5273a8a9-bbf6-467f-bf61-a6cc0120f3f6/migrator/0.log" Jun 09 12:52:25.335793 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:25.335769 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-n6w2m_5273a8a9-bbf6-467f-bf61-a6cc0120f3f6/graceful-termination/0.log" Jun 09 12:52:25.782850 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:25.782810 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jdc5v_d57d8daf-9039-45b2-a295-18a24463c3bd/kube-storage-version-migrator-operator/1.log" Jun 09 12:52:25.783244 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:25.783227 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994c6rnv5_7d28b518-3f0d-4971-a800-44002bde7a7d/istio-proxy/0.log" Jun 09 12:52:25.783621 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:25.783604 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jdc5v_d57d8daf-9039-45b2-a295-18a24463c3bd/kube-storage-version-migrator-operator/0.log" Jun 09 12:52:25.884572 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:25.884544 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-fhm6z_ac9895ea-d7a8-483c-968c-0d4756576d46/istio-proxy/1.log" Jun 09 12:52:25.884795 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:25.884783 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-fhm6z_ac9895ea-d7a8-483c-968c-0d4756576d46/istio-proxy/0.log" Jun 09 12:52:25.896877 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:25.896853 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jdb6c_d2399b50-b136-42fb-9b07-792241f88719/payload-pre-processing/0.log" Jun 09 12:52:25.913426 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:25.913405 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gfc8b_828b1fc8-01c8-4cf9-8604-b9d2e31889a8/payload-processing/3.log" Jun 09 12:52:25.914101 ip-10-0-135-164 kubenswrapper[2555]: I0609 12:52:25.914082 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gfc8b_828b1fc8-01c8-4cf9-8604-b9d2e31889a8/payload-processing/2.log"