Jun 09 02:59:42.893939 ip-10-0-136-172 systemd[1]: Starting Kubernetes Kubelet... Jun 09 02:59:43.245698 ip-10-0-136-172 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:59:43.245698 ip-10-0-136-172 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 02:59:43.245698 ip-10-0-136-172 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:59:43.245698 ip-10-0-136-172 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 02:59:43.245698 ip-10-0-136-172 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:59:43.247786 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.247683 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 02:59:43.253149 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253128 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:59:43.253149 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253148 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253152 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253156 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253159 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253162 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253165 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253169 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253172 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253174 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253177 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253180 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253183 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253185 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253188 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253191 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253193 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253197 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253199 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253202 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253205 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:59:43.253224 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253214 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253217 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253220 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253223 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253226 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253229 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253232 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253235 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253238 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253241 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253244 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253247 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253249 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253252 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253255 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253257 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253260 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253263 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253265 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253270 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:59:43.253743 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253274 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253277 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253281 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253284 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253287 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253289 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253292 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253295 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253298 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253300 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253304 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253308 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253311 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253314 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253319 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253322 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253325 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253328 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253332 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:59:43.254301 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253334 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253337 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253340 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253343 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253345 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253348 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253351 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253353 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253356 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253359 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253362 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253366 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253369 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253373 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253377 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253380 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253382 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253385 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253387 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:59:43.254807 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253391 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253394 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253397 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253399 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253402 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253405 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253407 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253410 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253414 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253417 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253419 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253422 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253425 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253427 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253430 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253433 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253435 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253438 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253440 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:59:43.255290 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.253443 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:59:43.257118 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257096 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:59:43.257118 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257114 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:59:43.257118 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257119 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:59:43.257118 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257123 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:59:43.257118 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257126 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257132 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257135 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257138 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257141 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257144 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257149 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257154 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257157 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257161 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257164 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257167 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257170 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257174 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257178 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257181 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257184 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257187 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257190 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:59:43.257323 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257194 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257197 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257200 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257203 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257205 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257208 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257211 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257214 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257216 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257219 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257222 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257225 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257229 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257234 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257238 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257242 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257245 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257249 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257251 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:59:43.257858 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257255 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257257 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257261 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257264 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257266 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257269 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257272 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257275 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257284 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257287 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257290 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257293 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257296 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257299 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257301 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257304 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257308 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257310 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257313 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257316 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:59:43.258368 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257319 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257321 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257324 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257327 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257330 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257333 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257335 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257338 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257342 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257345 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257348 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257351 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257355 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257358 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257361 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257364 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257367 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257369 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257372 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257375 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:59:43.258911 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257378 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257387 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257390 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257393 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257396 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257398 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257401 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257404 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257406 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257409 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257411 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257415 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257417 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257420 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257423 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257425 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257428 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257959 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257966 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257970 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:59:43.259434 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257974 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257977 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257980 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257983 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257986 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257989 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257992 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257995 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.257998 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258002 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258005 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258007 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258010 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258019 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258022 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258025 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258028 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258030 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258033 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258035 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:59:43.259981 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258038 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258041 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258043 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258046 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258049 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258052 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258055 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258058 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258060 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258063 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258068 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258073 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258078 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258081 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258084 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258087 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258090 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258093 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258095 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258098 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:59:43.260544 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258101 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258103 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258106 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258109 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258113 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258116 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258125 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258129 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258132 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258134 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258138 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258141 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258144 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258146 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258149 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258152 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258155 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258158 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258161 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:59:43.261071 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258163 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258166 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258168 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258171 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258174 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258177 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258180 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258183 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258187 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258190 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258193 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258196 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258198 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258201 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258204 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258206 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258209 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258212 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258215 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:59:43.261564 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258217 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258226 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258228 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258231 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258233 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258236 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258239 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258241 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258244 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258246 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258249 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258251 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258254 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258257 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258259 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258262 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258265 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.258268 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258344 2568 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258351 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258364 2568 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 02:59:43.262070 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258369 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258374 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258377 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258382 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258386 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258390 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258393 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258396 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258400 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258403 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258406 2568 flags.go:64] FLAG: --cgroup-root="" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258409 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258412 2568 flags.go:64] FLAG: --client-ca-file="" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258422 2568 flags.go:64] FLAG: --cloud-provider="external" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258425 2568 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258432 2568 flags.go:64] FLAG: --cluster-domain="" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258435 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258438 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258441 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258444 2568 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258448 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258451 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258455 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 02:59:43.262635 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258458 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258461 2568 flags.go:64] FLAG: --contention-profiling="false" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258464 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258467 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258471 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258474 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258479 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258482 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258485 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258489 2568 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258492 2568 flags.go:64] FLAG: --enable-server="true" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258495 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258502 2568 flags.go:64] FLAG: --event-burst="100" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258506 2568 flags.go:64] FLAG: --event-qps="50" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258509 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258512 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258515 2568 flags.go:64] FLAG: --eviction-hard="" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258519 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258522 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258525 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258528 2568 flags.go:64] FLAG: --eviction-soft="" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258531 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258534 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258544 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258548 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 02:59:43.263230 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258551 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258554 2568 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258557 2568 flags.go:64] FLAG: --feature-gates="" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258561 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258565 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258584 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258588 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258591 2568 flags.go:64] FLAG: --healthz-port="10248" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258594 2568 flags.go:64] FLAG: --help="false" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258597 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258601 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258604 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258607 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258611 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258615 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258618 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258621 2568 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258624 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258627 2568 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258630 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258636 2568 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258639 2568 flags.go:64] FLAG: --kube-reserved="" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258642 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258645 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 02:59:43.263910 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258648 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258651 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258654 2568 flags.go:64] FLAG: --lock-file="" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258657 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258660 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258663 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258669 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258678 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258682 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258686 2568 flags.go:64] FLAG: --logging-format="text" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258690 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258693 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258696 2568 flags.go:64] FLAG: --manifest-url="" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258699 2568 flags.go:64] FLAG: --manifest-url-header="" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258704 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258707 2568 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258712 2568 flags.go:64] FLAG: --max-pods="110" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258715 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258718 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258721 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258724 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258728 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258731 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258734 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258741 2568 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 02:59:43.264707 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258744 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258747 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258750 2568 flags.go:64] FLAG: --pod-cidr="" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258755 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258761 2568 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258764 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258768 2568 flags.go:64] FLAG: --pods-per-core="0" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258771 2568 flags.go:64] FLAG: --port="10250" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258774 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258777 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a9100e4e0c812eca" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258780 2568 flags.go:64] FLAG: --qos-reserved="" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258783 2568 flags.go:64] FLAG: --read-only-port="10255" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258786 2568 flags.go:64] FLAG: --register-node="true" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258789 2568 flags.go:64] FLAG: --register-with-taints="" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258793 2568 flags.go:64] FLAG: --registry-burst="10" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258802 2568 flags.go:64] FLAG: --registry-qps="5" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258806 2568 flags.go:64] FLAG: --reserved-cpus="" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258810 2568 flags.go:64] FLAG: --reserved-memory="" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258814 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258817 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258820 2568 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258823 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258826 2568 flags.go:64] FLAG: --runonce="false" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258830 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258833 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 02:59:43.265416 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258836 2568 flags.go:64] FLAG: --seccomp-default="false" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258839 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258842 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258845 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258849 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258852 2568 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258855 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258858 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258861 2568 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258863 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258868 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258871 2568 flags.go:64] FLAG: --system-cgroups="" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258874 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258879 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258882 2568 flags.go:64] FLAG: --tls-cert-file="" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258885 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258892 2568 flags.go:64] FLAG: --tls-min-version="" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258895 2568 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258898 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258901 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258904 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258907 2568 flags.go:64] FLAG: --v="2" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258911 2568 flags.go:64] FLAG: --version="false" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258923 2568 flags.go:64] FLAG: --vmodule="" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258929 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 02:59:43.266096 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.258932 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259085 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259090 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259094 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259098 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259101 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259104 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259107 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259110 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259113 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259115 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259118 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259120 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259123 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259126 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259129 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259132 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259136 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259139 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:59:43.266760 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259141 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259144 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259147 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259149 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259152 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259155 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259157 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259160 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259163 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259165 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259168 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259171 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259181 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259185 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259187 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259190 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259193 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259196 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259199 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259201 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:59:43.267288 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259204 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259207 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259210 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259212 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259215 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259218 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259221 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259223 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259227 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259231 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259236 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259239 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259242 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259245 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259247 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259250 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259253 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259255 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259258 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259261 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:59:43.267939 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259263 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259266 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259268 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259271 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259275 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259284 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259287 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259290 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259293 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259296 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259298 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259301 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259304 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259306 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259309 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259311 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259315 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259317 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259320 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259322 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:59:43.268453 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259325 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259328 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259332 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259335 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259337 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259340 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259343 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259345 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259348 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259350 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259353 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259356 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259358 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259361 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259364 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259366 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259370 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259373 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259382 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:59:43.268994 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259385 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.259389 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.260074 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.267314 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.267334 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.267355 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.267363 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267428 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267435 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267439 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267442 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267446 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267449 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267452 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:59:43.269505 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267455 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267458 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267461 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267463 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267466 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267469 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267472 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267475 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267478 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267481 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267484 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267487 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267490 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267493 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267496 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267499 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267502 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267505 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267507 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267510 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:59:43.269890 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267513 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267516 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267521 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267524 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267527 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267530 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267533 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267536 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267539 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267542 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267544 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267547 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267550 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267553 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267556 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267558 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267561 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267563 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267566 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267585 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:59:43.270409 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267590 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267595 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267600 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267605 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267608 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267611 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267614 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267617 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267620 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267622 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267625 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267628 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267631 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267634 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267637 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267641 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267646 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267650 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267653 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:59:43.270931 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267656 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267659 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267662 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267664 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267667 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267670 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267673 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267675 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267678 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267681 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267684 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267686 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267689 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267692 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267695 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267698 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267701 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267704 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267706 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267709 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:59:43.271406 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267712 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267715 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267718 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267720 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267723 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267727 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267731 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267735 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267740 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267743 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267747 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267750 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267752 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.267758 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:59:43.272011 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267913 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267918 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267921 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267924 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267927 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267930 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267933 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267936 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267939 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267943 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267946 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267949 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267953 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267956 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267959 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267961 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267964 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267967 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267970 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267972 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:59:43.272383 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267975 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267977 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267980 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267983 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267985 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267988 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267991 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267994 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.267997 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268000 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268002 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268005 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268008 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268010 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268013 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268016 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268019 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268021 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268024 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268027 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:59:43.272913 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268029 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268032 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268035 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268038 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268040 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268043 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268047 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268049 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268052 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268055 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268059 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268062 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268065 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268068 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268071 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268073 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268076 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268079 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268082 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268085 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:59:43.273414 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268088 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268091 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268094 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268096 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268099 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268102 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268104 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268107 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268109 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268113 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268116 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268118 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268121 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268123 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268126 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268129 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268132 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268135 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268137 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:59:43.273988 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268140 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268143 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268146 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268150 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268152 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268155 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268157 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268160 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268163 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268166 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268168 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268171 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268174 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268177 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268179 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268183 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268186 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268190 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268194 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:59:43.274480 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:43.268197 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:59:43.274975 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.268202 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:59:43.274975 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.268364 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 02:59:43.274975 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.270671 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 02:59:43.274975 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.272058 2568 server.go:1019] "Starting client certificate rotation" Jun 09 02:59:43.274975 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.272161 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 02:59:43.274975 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.272198 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 02:59:43.274975 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.274691 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 02:59:43.279366 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.279347 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 02:59:43.286690 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.286669 2568 log.go:25] "Validated CRI v1 runtime API" Jun 09 02:59:43.289323 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.289304 2568 log.go:25] "Validated CRI v1 image API" Jun 09 02:59:43.290144 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.290129 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 02:59:43.293475 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.293454 2568 fs.go:135] Filesystem UUIDs: map[09400779-add7-4db8-84af-1fde1251750d:/dev/nvme0n1p4 36886b93-6e3a-4492-846b-f2e29b08c507:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 09 02:59:43.293554 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.293475 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 02:59:43.298371 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.298352 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 02:59:43.299502 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.299383 2568 manager.go:216] Machine: {Timestamp:2026-06-09 02:59:43.297841807 +0000 UTC m=+0.296848244 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202064 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2204dadb2d4a55d946beba9287d57e SystemUUID:ec2204da-db2d-4a55-d946-beba9287d57e BootID:1be94437-ece1-47ce-9618-f34c7d9096f8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:92:0f:be:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:92:0f:be:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:f9:28:43:af:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 02:59:43.299502 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.299498 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 02:59:43.299641 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.299609 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 02:59:43.303062 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.303034 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 02:59:43.303224 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.303065 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-172.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 02:59:43.303940 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.303928 2568 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 02:59:43.303976 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.303942 2568 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 02:59:43.303976 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.303951 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 02:59:43.304712 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.304701 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 02:59:43.305915 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.305904 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 02:59:43.310094 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.310079 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 09 02:59:43.310228 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.310218 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 02:59:43.310265 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.310257 2568 kubelet.go:486] "Attempting to sync node with API server" Jun 09 02:59:43.310295 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.310284 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 02:59:43.310333 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.310300 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 02:59:43.310333 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.310311 2568 kubelet.go:398] "Adding apiserver pod source" Jun 09 02:59:43.310333 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.310322 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 02:59:43.310795 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.310781 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 02:59:43.310850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.310809 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 02:59:43.313253 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.313238 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 02:59:43.315746 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.315730 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 02:59:43.315814 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.315762 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 02:59:43.317288 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317276 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 02:59:43.317325 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317294 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 02:59:43.317325 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317301 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 02:59:43.317325 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317306 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 02:59:43.317325 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317315 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 02:59:43.317325 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317321 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 02:59:43.317490 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317329 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 02:59:43.317490 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317335 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 02:59:43.317490 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317343 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 02:59:43.317490 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317349 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 02:59:43.317490 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317364 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 02:59:43.317490 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.317369 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 02:59:43.318338 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.318326 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 02:59:43.318338 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.318336 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 02:59:43.321457 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.321436 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f6wdg" Jun 09 02:59:43.321837 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.321815 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 02:59:43.321837 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.321827 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-172.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 02:59:43.322005 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.321856 2568 server.go:1268] "Started kubelet" Jun 09 02:59:43.322005 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.321861 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 02:59:43.322005 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.321912 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 02:59:43.322148 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.321984 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 02:59:43.322148 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.322081 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 02:59:43.322839 ip-10-0-136-172 systemd[1]: Started Kubernetes Kubelet. Jun 09 02:59:43.327048 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.326834 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 02:59:43.327427 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.327405 2568 server.go:310] "Adding debug handlers to kubelet server" Jun 09 02:59:43.329054 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.329032 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f6wdg" Jun 09 02:59:43.333000 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.331797 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-172.ec2.internal.18b74a66de1c32b5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-172.ec2.internal,UID:ip-10-0-136-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-172.ec2.internal,},FirstTimestamp:2026-06-09 02:59:43.321830069 +0000 UTC m=+0.320836508,LastTimestamp:2026-06-09 02:59:43.321830069 +0000 UTC m=+0.320836508,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-172.ec2.internal,}" Jun 09 02:59:43.334786 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.334766 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 02:59:43.336946 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.336924 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 02:59:43.336946 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.336941 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 02:59:43.337086 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.337010 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:43.337762 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.337743 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 02:59:43.337878 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.337734 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 02:59:43.337878 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.337881 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 02:59:43.338039 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.338024 2568 reconstruct.go:97] "Volume reconstruction finished" Jun 09 02:59:43.338039 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.338033 2568 reconciler.go:29] "Reconciler: start to sync state" Jun 09 02:59:43.338171 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.338093 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 02:59:43.338171 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.338107 2568 factory.go:55] Registering systemd factory Jun 09 02:59:43.338171 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.338117 2568 factory.go:223] Registration of the systemd container factory successfully Jun 09 02:59:43.338480 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.338462 2568 factory.go:153] Registering CRI-O factory Jun 09 02:59:43.338579 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.338482 2568 factory.go:223] Registration of the crio container factory successfully Jun 09 02:59:43.338579 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.338521 2568 factory.go:103] Registering Raw factory Jun 09 02:59:43.338579 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.338536 2568 manager.go:1196] Started watching for new ooms in manager Jun 09 02:59:43.338952 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.338938 2568 manager.go:349] Starting recovery of all containers Jun 09 02:59:43.347323 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.347155 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:59:43.347467 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.347453 2568 manager.go:354] Recovery completed Jun 09 02:59:43.349913 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.349895 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-172.ec2.internal\" not found" node="ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.351528 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.351507 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:59:43.353932 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.353914 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:59:43.354017 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.353951 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:59:43.354017 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.353966 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:59:43.354583 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.354571 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 02:59:43.354583 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.354585 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 02:59:43.354668 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.354607 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 09 02:59:43.354668 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.354587 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:59:43.355452 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.355433 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:59:43.355550 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.355461 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:59:43.355550 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.355472 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:59:43.356692 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.356680 2568 policy_none.go:49] "None policy: Start" Jun 09 02:59:43.356736 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.356698 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 02:59:43.356736 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.356711 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 02:59:43.358548 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.358534 2568 policy_none.go:47] "Start" Jun 09 02:59:43.391087 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.391066 2568 manager.go:337] "Starting Device Plugin manager" Jun 09 02:59:43.391210 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.391105 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 02:59:43.391210 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.391119 2568 server.go:87] "Starting device plugin registration server" Jun 09 02:59:43.391411 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.391399 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 02:59:43.391468 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.391415 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 02:59:43.391616 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.391561 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 02:59:43.391691 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.391652 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 02:59:43.391691 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.391677 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 02:59:43.392254 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.392232 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 02:59:43.392348 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.392291 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:43.408200 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.408167 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 02:59:43.419157 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.409264 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 02:59:43.419157 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.409294 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 02:59:43.419157 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.409315 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 02:59:43.419157 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.409349 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 02:59:43.419157 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.411614 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:59:43.492045 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.491999 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:59:43.493055 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.493040 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:59:43.493115 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.493072 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:59:43.493115 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.493083 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:59:43.493115 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.493106 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.500790 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.500742 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.500790 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.500772 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-172.ec2.internal\": node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:43.509560 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.509536 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal"] Jun 09 02:59:43.509623 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.509598 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:59:43.511540 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.511528 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:59:43.511591 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.511555 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:59:43.511591 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.511564 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:59:43.512375 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.512359 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:43.514167 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.514153 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:59:43.514254 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.514240 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.514289 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.514269 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:59:43.514948 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.514926 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:59:43.515012 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.514957 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:59:43.515012 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.514967 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:59:43.515012 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.514930 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:59:43.515118 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.515028 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:59:43.515118 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.515040 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:59:43.517203 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.517187 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.517283 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.517216 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:59:43.517955 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.517942 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:59:43.518004 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.517965 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:59:43.518004 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.517975 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:59:43.540264 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.540236 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-172.ec2.internal\" not found" node="ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.544574 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.544549 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-172.ec2.internal\" not found" node="ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.613242 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.613197 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:43.639633 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.639602 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/921d4fba766938b5001b2e2d4d67ec1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal\" (UID: \"921d4fba766938b5001b2e2d4d67ec1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.639756 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.639639 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c31be9ab5b45b5bc46bc0a18af81246-config\") pod \"kube-apiserver-proxy-ip-10-0-136-172.ec2.internal\" (UID: \"9c31be9ab5b45b5bc46bc0a18af81246\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.639756 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.639664 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/921d4fba766938b5001b2e2d4d67ec1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal\" (UID: \"921d4fba766938b5001b2e2d4d67ec1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.713765 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.713722 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:43.740102 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.740067 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c31be9ab5b45b5bc46bc0a18af81246-config\") pod \"kube-apiserver-proxy-ip-10-0-136-172.ec2.internal\" (UID: \"9c31be9ab5b45b5bc46bc0a18af81246\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.740243 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.740107 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/921d4fba766938b5001b2e2d4d67ec1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal\" (UID: \"921d4fba766938b5001b2e2d4d67ec1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.740243 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.740133 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/921d4fba766938b5001b2e2d4d67ec1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal\" (UID: \"921d4fba766938b5001b2e2d4d67ec1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.740243 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.740172 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c31be9ab5b45b5bc46bc0a18af81246-config\") pod \"kube-apiserver-proxy-ip-10-0-136-172.ec2.internal\" (UID: \"9c31be9ab5b45b5bc46bc0a18af81246\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.740243 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.740174 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/921d4fba766938b5001b2e2d4d67ec1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal\" (UID: \"921d4fba766938b5001b2e2d4d67ec1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.740243 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.740176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/921d4fba766938b5001b2e2d4d67ec1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal\" (UID: \"921d4fba766938b5001b2e2d4d67ec1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.814608 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.814533 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:43.847105 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.847078 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.851984 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:43.851669 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" Jun 09 02:59:43.915523 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:43.915477 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:44.016065 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:44.016032 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:44.116688 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:44.116609 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:44.217225 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:44.217189 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-172.ec2.internal\" not found" Jun 09 02:59:44.271750 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.271715 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 02:59:44.272348 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.271907 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 02:59:44.272348 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.271916 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 02:59:44.312177 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.312147 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:59:44.336051 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.336018 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 02:54:43 +0000 UTC" deadline="2028-03-22 14:16:59.586781044 +0000 UTC" Jun 09 02:59:44.336051 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.336045 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15659h17m15.250738607s" Jun 09 02:59:44.337105 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.337090 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal" Jun 09 02:59:44.337179 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.337130 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 02:59:44.347275 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.347252 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 02:59:44.349508 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.349479 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" Jun 09 02:59:44.351139 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.351121 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 02:59:44.364534 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.364513 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 02:59:44.366678 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:44.366652 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921d4fba766938b5001b2e2d4d67ec1a.slice/crio-ff473f9baee5b6ccb1e7b5e6633c70da91e601c9ec54a74d3431e4cdb5ed969e WatchSource:0}: Error finding container ff473f9baee5b6ccb1e7b5e6633c70da91e601c9ec54a74d3431e4cdb5ed969e: Status 404 returned error can't find the container with id ff473f9baee5b6ccb1e7b5e6633c70da91e601c9ec54a74d3431e4cdb5ed969e Jun 09 02:59:44.367132 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:44.367085 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c31be9ab5b45b5bc46bc0a18af81246.slice/crio-e82d8fab4a18366f44164c920be9c081666c2049aa3b5d8a9a59f4faed8ef8a8 WatchSource:0}: Error finding container e82d8fab4a18366f44164c920be9c081666c2049aa3b5d8a9a59f4faed8ef8a8: Status 404 returned error can't find the container with id e82d8fab4a18366f44164c920be9c081666c2049aa3b5d8a9a59f4faed8ef8a8 Jun 09 02:59:44.368569 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.368550 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pzbr6" Jun 09 02:59:44.373398 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.373384 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:59:44.375836 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.375820 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pzbr6" Jun 09 02:59:44.412418 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.412366 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" event={"ID":"921d4fba766938b5001b2e2d4d67ec1a","Type":"ContainerStarted","Data":"ff473f9baee5b6ccb1e7b5e6633c70da91e601c9ec54a74d3431e4cdb5ed969e"} Jun 09 02:59:44.413444 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.413422 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal" event={"ID":"9c31be9ab5b45b5bc46bc0a18af81246","Type":"ContainerStarted","Data":"e82d8fab4a18366f44164c920be9c081666c2049aa3b5d8a9a59f4faed8ef8a8"} Jun 09 02:59:44.629354 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:44.629285 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:59:45.212366 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.212332 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:59:45.239746 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.239723 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:59:45.312012 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.311976 2568 apiserver.go:52] "Watching apiserver" Jun 09 02:59:45.323314 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.323277 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 02:59:45.324684 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.324650 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5vd6f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal","openshift-multus/network-metrics-daemon-fbpvr","openshift-network-diagnostics/network-check-target-hxpx7","openshift-network-operator/iptables-alerter-x6244","openshift-ovn-kubernetes/ovnkube-node-9rp4j","kube-system/global-pull-secret-syncer-5qbmr","kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7","openshift-dns/node-resolver-jnj47","openshift-multus/multus-2lbc2","openshift-multus/multus-additional-cni-plugins-zmx5b","kube-system/konnectivity-agent-hnwtf","openshift-cluster-node-tuning-operator/tuned-c56r6"] Jun 09 02:59:45.327339 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.327317 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:45.327444 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.327398 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 02:59:45.329508 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.329472 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hnwtf" Jun 09 02:59:45.332038 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.331892 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 02:59:45.332038 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.331921 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 02:59:45.332038 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.331950 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cn77d\"" Jun 09 02:59:45.332038 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.332017 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:45.332290 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.332094 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 02:59:45.334420 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.334401 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:45.334552 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.334466 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 02:59:45.336422 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.336402 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.338901 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.338730 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:59:45.338901 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.338738 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v92fb\"" Jun 09 02:59:45.339336 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.339079 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 02:59:45.339336 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.339085 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.339729 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.339101 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 02:59:45.341094 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.341074 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.341842 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.341822 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 02:59:45.342244 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.342216 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 02:59:45.342375 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.342216 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 02:59:45.343376 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.343356 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 02:59:45.344016 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.343759 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 02:59:45.344016 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.343786 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 02:59:45.344016 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.343802 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 02:59:45.344016 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.343793 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hc2sg\"" Jun 09 02:59:45.344016 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.344000 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 02:59:45.344281 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.344027 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.344281 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.344187 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 02:59:45.344381 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.344288 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7t9c4\"" Jun 09 02:59:45.345803 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.345737 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.346460 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.346400 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vtq82\"" Jun 09 02:59:45.346575 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.346473 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 02:59:45.347548 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.346923 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 02:59:45.347548 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.346973 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 02:59:45.347897 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.347878 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 02:59:45.348258 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.348147 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.348341 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.348233 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j65vs\"" Jun 09 02:59:45.349132 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.348148 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:59:45.350146 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.349936 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7db617ff-dc47-4c2f-afef-3894d8f89a2b-iptables-alerter-script\") pod \"iptables-alerter-x6244\" (UID: \"7db617ff-dc47-4c2f-afef-3894d8f89a2b\") " pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.350146 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.349978 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58lnj\" (UniqueName: \"kubernetes.io/projected/7db617ff-dc47-4c2f-afef-3894d8f89a2b-kube-api-access-58lnj\") pod \"iptables-alerter-x6244\" (UID: \"7db617ff-dc47-4c2f-afef-3894d8f89a2b\") " pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.350146 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350009 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-run-systemd\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350146 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350042 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-etc-openvswitch\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350146 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-log-socket\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350146 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350125 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-cni-bin\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350469 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350170 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-run-openvswitch\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350469 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7455a43-a416-40a2-b102-d498bf398269-dbus\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:45.350469 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgt2w\" (UniqueName: \"kubernetes.io/projected/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-kube-api-access-xgt2w\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:45.350469 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350292 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14c0ecc7-1fa2-461d-b171-4fe38f21b310-konnectivity-ca\") pod \"konnectivity-agent-hnwtf\" (UID: \"14c0ecc7-1fa2-461d-b171-4fe38f21b310\") " pod="kube-system/konnectivity-agent-hnwtf" Jun 09 02:59:45.350469 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350322 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-var-lib-openvswitch\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350469 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350351 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-node-log\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350469 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350375 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350469 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhj8l\" (UniqueName: \"kubernetes.io/projected/91ad2818-5103-48f9-ad94-616c4956273d-kube-api-access-rhj8l\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350839 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mzfp\" (UniqueName: \"kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp\") pod \"network-check-target-hxpx7\" (UID: \"1744ad2a-8698-4fa5-9b1d-fd6d234256d1\") " pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:45.350839 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-run-netns\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350839 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350629 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:45.350839 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350692 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7db617ff-dc47-4c2f-afef-3894d8f89a2b-host-slash\") pod \"iptables-alerter-x6244\" (UID: \"7db617ff-dc47-4c2f-afef-3894d8f89a2b\") " pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.350839 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350727 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-kubelet\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350839 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350753 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-slash\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350839 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-run-ovn\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.350839 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350838 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7455a43-a416-40a2-b102-d498bf398269-kubelet-config\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:45.351180 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14c0ecc7-1fa2-461d-b171-4fe38f21b310-agent-certs\") pod \"konnectivity-agent-hnwtf\" (UID: \"14c0ecc7-1fa2-461d-b171-4fe38f21b310\") " pod="kube-system/konnectivity-agent-hnwtf" Jun 09 02:59:45.351180 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350929 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-systemd-units\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.351180 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91ad2818-5103-48f9-ad94-616c4956273d-ovn-node-metrics-cert\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.351180 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.350991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91ad2818-5103-48f9-ad94-616c4956273d-env-overrides\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.351180 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.351023 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-run-ovn-kubernetes\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.351180 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.351048 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-cni-netd\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.351180 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.351087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91ad2818-5103-48f9-ad94-616c4956273d-ovnkube-config\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.351180 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.351124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91ad2818-5103-48f9-ad94-616c4956273d-ovnkube-script-lib\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.351180 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.351094 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-st8w2\"" Jun 09 02:59:45.351180 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.351152 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:45.351642 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.351339 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 02:59:45.352368 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.352350 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 02:59:45.353527 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.353485 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.355926 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.355880 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 02:59:45.355926 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.355914 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 02:59:45.356311 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.356225 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.357009 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.356896 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ldd8v\"" Jun 09 02:59:45.357009 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.356898 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 02:59:45.357159 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.357151 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 02:59:45.358509 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.358478 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 02:59:45.359030 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.358856 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 02:59:45.359137 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.359044 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sl2vk\"" Jun 09 02:59:45.379817 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.379776 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 02:54:44 +0000 UTC" deadline="2028-03-12 20:20:11.313824666 +0000 UTC" Jun 09 02:59:45.379817 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.379812 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15425h20m25.934014796s" Jun 09 02:59:45.439327 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.439297 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 02:59:45.451855 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.451821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-run-openvswitch\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.452021 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.451865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7455a43-a416-40a2-b102-d498bf398269-dbus\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:45.452021 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.451892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-run\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.452021 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.451914 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d348c30a-0d0a-4a00-89a5-945f9cf88304-tmp\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.452021 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.451935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd66dde4-da1d-49c1-b791-dca66777bd71-tmp-dir\") pod \"node-resolver-jnj47\" (UID: \"fd66dde4-da1d-49c1-b791-dca66777bd71\") " pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.452021 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.451941 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-run-openvswitch\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.452021 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.451958 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm8tr\" (UniqueName: \"kubernetes.io/projected/fd66dde4-da1d-49c1-b791-dca66777bd71-kube-api-access-bm8tr\") pod \"node-resolver-jnj47\" (UID: \"fd66dde4-da1d-49c1-b791-dca66777bd71\") " pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.452021 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452001 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-os-release\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452025 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-kubernetes\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452046 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7455a43-a416-40a2-b102-d498bf398269-dbus\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452049 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwn9n\" (UniqueName: \"kubernetes.io/projected/d348c30a-0d0a-4a00-89a5-945f9cf88304-kube-api-access-mwn9n\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-tuned\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452159 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14c0ecc7-1fa2-461d-b171-4fe38f21b310-konnectivity-ca\") pod \"konnectivity-agent-hnwtf\" (UID: \"14c0ecc7-1fa2-461d-b171-4fe38f21b310\") " pod="kube-system/konnectivity-agent-hnwtf" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452189 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-var-lib-openvswitch\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452227 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-node-log\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452267 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhj8l\" (UniqueName: \"kubernetes.io/projected/91ad2818-5103-48f9-ad94-616c4956273d-kube-api-access-rhj8l\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-sys\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-host\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452340 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:45.452362 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452361 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f00933df-8470-4be5-8679-54ba6a748b3d-serviceca\") pod \"node-ca-5vd6f\" (UID: \"f00933df-8470-4be5-8679-54ba6a748b3d\") " pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452386 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-sysconfig\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-sysctl-conf\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-cni-dir\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452442 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-socket-dir-parent\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6834b640-f33e-4cc2-96f1-038a55c5ff71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452474 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-slash\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452487 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-run-ovn\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452524 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7455a43-a416-40a2-b102-d498bf398269-kubelet-config\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c67dt\" (UniqueName: \"kubernetes.io/projected/341986da-22ac-4e91-8e83-573ad2e2a265-kube-api-access-c67dt\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-systemd\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452606 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-cnibin\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452633 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-conf-dir\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14c0ecc7-1fa2-461d-b171-4fe38f21b310-agent-certs\") pod \"konnectivity-agent-hnwtf\" (UID: \"14c0ecc7-1fa2-461d-b171-4fe38f21b310\") " pod="kube-system/konnectivity-agent-hnwtf" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452694 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-systemd-units\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452715 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91ad2818-5103-48f9-ad94-616c4956273d-ovn-node-metrics-cert\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452753 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-etc-selinux\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.452968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452806 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-slash\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452891 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14c0ecc7-1fa2-461d-b171-4fe38f21b310-konnectivity-ca\") pod \"konnectivity-agent-hnwtf\" (UID: \"14c0ecc7-1fa2-461d-b171-4fe38f21b310\") " pod="kube-system/konnectivity-agent-hnwtf" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452932 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7455a43-a416-40a2-b102-d498bf398269-kubelet-config\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452931 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-systemd-units\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452961 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-run-ovn\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452976 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-node-log\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.452941 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.453030 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453100 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-var-lib-openvswitch\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453158 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-hostroot\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.453185 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret podName:a7455a43-a416-40a2-b102-d498bf398269 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:45.95315162 +0000 UTC m=+2.952158047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret") pod "global-pull-secret-syncer-5qbmr" (UID: "a7455a43-a416-40a2-b102-d498bf398269") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453290 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91ad2818-5103-48f9-ad94-616c4956273d-ovnkube-script-lib\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-registration-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453359 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f00933df-8470-4be5-8679-54ba6a748b3d-host\") pod \"node-ca-5vd6f\" (UID: \"f00933df-8470-4be5-8679-54ba6a748b3d\") " pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453394 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-sysctl-d\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-lib-modules\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.453850 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453458 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-run-k8s-cni-cncf-io\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-run-multus-certs\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453543 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7db617ff-dc47-4c2f-afef-3894d8f89a2b-iptables-alerter-script\") pod \"iptables-alerter-x6244\" (UID: \"7db617ff-dc47-4c2f-afef-3894d8f89a2b\") " pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453570 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-run-systemd\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-etc-openvswitch\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453618 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-log-socket\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453644 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-var-lib-kubelet\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453654 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-run-systemd\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453660 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-etc-openvswitch\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453669 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-etc-kubernetes\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453690 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-log-socket\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453713 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6834b640-f33e-4cc2-96f1-038a55c5ff71-cni-binary-copy\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453739 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-var-lib-cni-multus\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453767 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgt2w\" (UniqueName: \"kubernetes.io/projected/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-kube-api-access-xgt2w\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-device-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453813 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-sys-fs\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453834 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd66dde4-da1d-49c1-b791-dca66777bd71-hosts-file\") pod \"node-resolver-jnj47\" (UID: \"fd66dde4-da1d-49c1-b791-dca66777bd71\") " pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.454463 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cc03ebb-dd2e-4062-b9a4-2443742319cf-cni-binary-copy\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.453881 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-cnibin\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454001 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91ad2818-5103-48f9-ad94-616c4956273d-ovnkube-script-lib\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454078 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7db617ff-dc47-4c2f-afef-3894d8f89a2b-iptables-alerter-script\") pod \"iptables-alerter-x6244\" (UID: \"7db617ff-dc47-4c2f-afef-3894d8f89a2b\") " pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64w6v\" (UniqueName: \"kubernetes.io/projected/f00933df-8470-4be5-8679-54ba6a748b3d-kube-api-access-64w6v\") pod \"node-ca-5vd6f\" (UID: \"f00933df-8470-4be5-8679-54ba6a748b3d\") " pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454361 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-var-lib-cni-bin\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454387 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrfxw\" (UniqueName: \"kubernetes.io/projected/2cc03ebb-dd2e-4062-b9a4-2443742319cf-kube-api-access-jrfxw\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454410 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzfp\" (UniqueName: \"kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp\") pod \"network-check-target-hxpx7\" (UID: \"1744ad2a-8698-4fa5-9b1d-fd6d234256d1\") " pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-run-netns\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454454 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-modprobe-d\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454473 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-system-cni-dir\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-system-cni-dir\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454532 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7db617ff-dc47-4c2f-afef-3894d8f89a2b-host-slash\") pod \"iptables-alerter-x6244\" (UID: \"7db617ff-dc47-4c2f-afef-3894d8f89a2b\") " pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-kubelet\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454573 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7db617ff-dc47-4c2f-afef-3894d8f89a2b-host-slash\") pod \"iptables-alerter-x6244\" (UID: \"7db617ff-dc47-4c2f-afef-3894d8f89a2b\") " pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454530 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-run-netns\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-kubelet-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.455211 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454620 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-kubelet\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454649 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-var-lib-kubelet\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454683 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454705 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91ad2818-5103-48f9-ad94-616c4956273d-env-overrides\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454742 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-run-ovn-kubernetes\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454765 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-cni-netd\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454783 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91ad2818-5103-48f9-ad94-616c4956273d-ovnkube-config\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454803 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-run-netns\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454826 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-daemon-config\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454831 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-cni-netd\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454850 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6834b640-f33e-4cc2-96f1-038a55c5ff71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454855 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-run-ovn-kubernetes\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58lnj\" (UniqueName: \"kubernetes.io/projected/7db617ff-dc47-4c2f-afef-3894d8f89a2b-kube-api-access-58lnj\") pod \"iptables-alerter-x6244\" (UID: \"7db617ff-dc47-4c2f-afef-3894d8f89a2b\") " pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454923 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-cni-bin\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454946 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-socket-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454968 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-os-release\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.455778 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.454991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sncfz\" (UniqueName: \"kubernetes.io/projected/6834b640-f33e-4cc2-96f1-038a55c5ff71-kube-api-access-sncfz\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.456301 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.455007 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:59:45.456301 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.455053 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs podName:dbfc6f31-41c5-4e02-9e38-2a3248ca1063 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:45.955037046 +0000 UTC m=+2.954043477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs") pod "network-metrics-daemon-fbpvr" (UID: "dbfc6f31-41c5-4e02-9e38-2a3248ca1063") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:59:45.456301 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.455091 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91ad2818-5103-48f9-ad94-616c4956273d-env-overrides\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.456301 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.455083 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91ad2818-5103-48f9-ad94-616c4956273d-host-cni-bin\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.456301 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.455446 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91ad2818-5103-48f9-ad94-616c4956273d-ovnkube-config\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.456888 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.456858 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91ad2818-5103-48f9-ad94-616c4956273d-ovn-node-metrics-cert\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.456968 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.456955 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14c0ecc7-1fa2-461d-b171-4fe38f21b310-agent-certs\") pod \"konnectivity-agent-hnwtf\" (UID: \"14c0ecc7-1fa2-461d-b171-4fe38f21b310\") " pod="kube-system/konnectivity-agent-hnwtf" Jun 09 02:59:45.461608 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.461588 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:59:45.461700 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.461617 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:59:45.461700 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.461631 2568 projected.go:196] Error preparing data for projected volume kube-api-access-5mzfp for pod openshift-network-diagnostics/network-check-target-hxpx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:59:45.461700 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.461693 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp podName:1744ad2a-8698-4fa5-9b1d-fd6d234256d1 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:45.961675365 +0000 UTC m=+2.960681789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5mzfp" (UniqueName: "kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp") pod "network-check-target-hxpx7" (UID: "1744ad2a-8698-4fa5-9b1d-fd6d234256d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:59:45.463164 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.463113 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhj8l\" (UniqueName: \"kubernetes.io/projected/91ad2818-5103-48f9-ad94-616c4956273d-kube-api-access-rhj8l\") pod \"ovnkube-node-9rp4j\" (UID: \"91ad2818-5103-48f9-ad94-616c4956273d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.463664 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.463648 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58lnj\" (UniqueName: \"kubernetes.io/projected/7db617ff-dc47-4c2f-afef-3894d8f89a2b-kube-api-access-58lnj\") pod \"iptables-alerter-x6244\" (UID: \"7db617ff-dc47-4c2f-afef-3894d8f89a2b\") " pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.463731 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.463667 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgt2w\" (UniqueName: \"kubernetes.io/projected/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-kube-api-access-xgt2w\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:45.555882 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.555847 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-sys-fs\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.555882 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.555886 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd66dde4-da1d-49c1-b791-dca66777bd71-hosts-file\") pod \"node-resolver-jnj47\" (UID: \"fd66dde4-da1d-49c1-b791-dca66777bd71\") " pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.555903 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cc03ebb-dd2e-4062-b9a4-2443742319cf-cni-binary-copy\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.555924 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-cnibin\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.555947 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64w6v\" (UniqueName: \"kubernetes.io/projected/f00933df-8470-4be5-8679-54ba6a748b3d-kube-api-access-64w6v\") pod \"node-ca-5vd6f\" (UID: \"f00933df-8470-4be5-8679-54ba6a748b3d\") " pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.555970 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-var-lib-cni-bin\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.555981 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-sys-fs\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.555993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrfxw\" (UniqueName: \"kubernetes.io/projected/2cc03ebb-dd2e-4062-b9a4-2443742319cf-kube-api-access-jrfxw\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556014 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd66dde4-da1d-49c1-b791-dca66777bd71-hosts-file\") pod \"node-resolver-jnj47\" (UID: \"fd66dde4-da1d-49c1-b791-dca66777bd71\") " pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556046 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-modprobe-d\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556068 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-system-cni-dir\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556077 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-var-lib-cni-bin\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-system-cni-dir\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556115 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-kubelet-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.556136 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556138 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-var-lib-kubelet\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556160 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556186 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-run-netns\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556194 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-modprobe-d\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556206 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-cnibin\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556207 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-daemon-config\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556249 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-system-cni-dir\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6834b640-f33e-4cc2-96f1-038a55c5ff71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556270 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-kubelet-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556281 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-var-lib-kubelet\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556325 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-socket-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556354 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-os-release\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sncfz\" (UniqueName: \"kubernetes.io/projected/6834b640-f33e-4cc2-96f1-038a55c5ff71-kube-api-access-sncfz\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556380 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556326 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-run-netns\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556414 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-run\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556353 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-system-cni-dir\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.556749 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556445 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-os-release\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556455 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-socket-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556472 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-run\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556531 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cc03ebb-dd2e-4062-b9a4-2443742319cf-cni-binary-copy\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d348c30a-0d0a-4a00-89a5-945f9cf88304-tmp\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556574 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd66dde4-da1d-49c1-b791-dca66777bd71-tmp-dir\") pod \"node-resolver-jnj47\" (UID: \"fd66dde4-da1d-49c1-b791-dca66777bd71\") " pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556599 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm8tr\" (UniqueName: \"kubernetes.io/projected/fd66dde4-da1d-49c1-b791-dca66777bd71-kube-api-access-bm8tr\") pod \"node-resolver-jnj47\" (UID: \"fd66dde4-da1d-49c1-b791-dca66777bd71\") " pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556625 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-os-release\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-kubernetes\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556672 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwn9n\" (UniqueName: \"kubernetes.io/projected/d348c30a-0d0a-4a00-89a5-945f9cf88304-kube-api-access-mwn9n\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556694 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-tuned\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556731 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-sys\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556781 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-host\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556827 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-daemon-config\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556839 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6834b640-f33e-4cc2-96f1-038a55c5ff71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556828 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-host\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556890 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-sys\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556912 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6834b640-f33e-4cc2-96f1-038a55c5ff71-os-release\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.557322 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556928 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-kubernetes\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556944 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f00933df-8470-4be5-8679-54ba6a748b3d-serviceca\") pod \"node-ca-5vd6f\" (UID: \"f00933df-8470-4be5-8679-54ba6a748b3d\") " pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-sysconfig\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.556990 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-sysctl-conf\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557020 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-cni-dir\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557040 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-sysconfig\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-socket-dir-parent\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557069 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6834b640-f33e-4cc2-96f1-038a55c5ff71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c67dt\" (UniqueName: \"kubernetes.io/projected/341986da-22ac-4e91-8e83-573ad2e2a265-kube-api-access-c67dt\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-systemd\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557136 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-socket-dir-parent\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-cnibin\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557099 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-cni-dir\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557155 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-sysctl-conf\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-conf-dir\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557195 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-cnibin\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557205 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-etc-selinux\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557218 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-systemd\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.557973 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557228 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-hostroot\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557255 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-registration-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557280 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f00933df-8470-4be5-8679-54ba6a748b3d-host\") pod \"node-ca-5vd6f\" (UID: \"f00933df-8470-4be5-8679-54ba6a748b3d\") " pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557286 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-hostroot\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557302 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-sysctl-d\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557324 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-lib-modules\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557347 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-run-k8s-cni-cncf-io\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557371 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-run-multus-certs\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557380 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-etc-selinux\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-var-lib-kubelet\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557419 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f00933df-8470-4be5-8679-54ba6a748b3d-host\") pod \"node-ca-5vd6f\" (UID: \"f00933df-8470-4be5-8679-54ba6a748b3d\") " pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557423 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-etc-kubernetes\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f00933df-8470-4be5-8679-54ba6a748b3d-serviceca\") pod \"node-ca-5vd6f\" (UID: \"f00933df-8470-4be5-8679-54ba6a748b3d\") " pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557429 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-registration-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557257 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-multus-conf-dir\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557455 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-etc-kubernetes\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557460 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6834b640-f33e-4cc2-96f1-038a55c5ff71-cni-binary-copy\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557484 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-run-multus-certs\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.558601 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557520 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-var-lib-cni-multus\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557548 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-device-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557553 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-var-lib-kubelet\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557571 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6834b640-f33e-4cc2-96f1-038a55c5ff71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557590 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-run-k8s-cni-cncf-io\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557611 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd66dde4-da1d-49c1-b791-dca66777bd71-tmp-dir\") pod \"node-resolver-jnj47\" (UID: \"fd66dde4-da1d-49c1-b791-dca66777bd71\") " pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557551 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-sysctl-d\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557635 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d348c30a-0d0a-4a00-89a5-945f9cf88304-lib-modules\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557668 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cc03ebb-dd2e-4062-b9a4-2443742319cf-host-var-lib-cni-multus\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557689 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/341986da-22ac-4e91-8e83-573ad2e2a265-device-dir\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.557939 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6834b640-f33e-4cc2-96f1-038a55c5ff71-cni-binary-copy\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.559290 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.559059 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d348c30a-0d0a-4a00-89a5-945f9cf88304-tmp\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.559723 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.559703 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d348c30a-0d0a-4a00-89a5-945f9cf88304-etc-tuned\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.565655 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.565633 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrfxw\" (UniqueName: \"kubernetes.io/projected/2cc03ebb-dd2e-4062-b9a4-2443742319cf-kube-api-access-jrfxw\") pod \"multus-2lbc2\" (UID: \"2cc03ebb-dd2e-4062-b9a4-2443742319cf\") " pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.565655 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.565645 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c67dt\" (UniqueName: \"kubernetes.io/projected/341986da-22ac-4e91-8e83-573ad2e2a265-kube-api-access-c67dt\") pod \"aws-ebs-csi-driver-node-22kh7\" (UID: \"341986da-22ac-4e91-8e83-573ad2e2a265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.565858 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.565720 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64w6v\" (UniqueName: \"kubernetes.io/projected/f00933df-8470-4be5-8679-54ba6a748b3d-kube-api-access-64w6v\") pod \"node-ca-5vd6f\" (UID: \"f00933df-8470-4be5-8679-54ba6a748b3d\") " pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.566125 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.566103 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm8tr\" (UniqueName: \"kubernetes.io/projected/fd66dde4-da1d-49c1-b791-dca66777bd71-kube-api-access-bm8tr\") pod \"node-resolver-jnj47\" (UID: \"fd66dde4-da1d-49c1-b791-dca66777bd71\") " pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.566388 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.566371 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwn9n\" (UniqueName: \"kubernetes.io/projected/d348c30a-0d0a-4a00-89a5-945f9cf88304-kube-api-access-mwn9n\") pod \"tuned-c56r6\" (UID: \"d348c30a-0d0a-4a00-89a5-945f9cf88304\") " pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.567557 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.567540 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sncfz\" (UniqueName: \"kubernetes.io/projected/6834b640-f33e-4cc2-96f1-038a55c5ff71-kube-api-access-sncfz\") pod \"multus-additional-cni-plugins-zmx5b\" (UID: \"6834b640-f33e-4cc2-96f1-038a55c5ff71\") " pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.643053 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.643024 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hnwtf" Jun 09 02:59:45.652567 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.652538 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x6244" Jun 09 02:59:45.664433 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.664401 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 02:59:45.668204 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.668183 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" Jun 09 02:59:45.673803 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.673782 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5vd6f" Jun 09 02:59:45.680384 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.680365 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c56r6" Jun 09 02:59:45.687902 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.687880 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jnj47" Jun 09 02:59:45.694642 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.694621 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2lbc2" Jun 09 02:59:45.699297 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.699275 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" Jun 09 02:59:45.960512 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.960477 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:45.960700 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:45.960530 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:45.960700 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.960660 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:59:45.960793 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.960712 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret podName:a7455a43-a416-40a2-b102-d498bf398269 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:46.960699444 +0000 UTC m=+3.959705867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret") pod "global-pull-secret-syncer-5qbmr" (UID: "a7455a43-a416-40a2-b102-d498bf398269") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:59:45.960793 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.960662 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:59:45.960865 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:45.960805 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs podName:dbfc6f31-41c5-4e02-9e38-2a3248ca1063 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:46.960785228 +0000 UTC m=+3.959791657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs") pod "network-metrics-daemon-fbpvr" (UID: "dbfc6f31-41c5-4e02-9e38-2a3248ca1063") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:59:46.061146 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.061101 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzfp\" (UniqueName: \"kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp\") pod \"network-check-target-hxpx7\" (UID: \"1744ad2a-8698-4fa5-9b1d-fd6d234256d1\") " pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:46.061329 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:46.061292 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:59:46.061329 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:46.061317 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:59:46.061423 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:46.061330 2568 projected.go:196] Error preparing data for projected volume kube-api-access-5mzfp for pod openshift-network-diagnostics/network-check-target-hxpx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:59:46.061423 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:46.061404 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp podName:1744ad2a-8698-4fa5-9b1d-fd6d234256d1 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:47.061383044 +0000 UTC m=+4.060389485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5mzfp" (UniqueName: "kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp") pod "network-check-target-hxpx7" (UID: "1744ad2a-8698-4fa5-9b1d-fd6d234256d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:59:46.155854 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:46.155822 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c0ecc7_1fa2_461d_b171_4fe38f21b310.slice/crio-fd2703ea65cd496ee54d1becc6f32e7fed84ddf4c2b55429a96a400353a1abe4 WatchSource:0}: Error finding container fd2703ea65cd496ee54d1becc6f32e7fed84ddf4c2b55429a96a400353a1abe4: Status 404 returned error can't find the container with id fd2703ea65cd496ee54d1becc6f32e7fed84ddf4c2b55429a96a400353a1abe4 Jun 09 02:59:46.157258 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:46.157189 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341986da_22ac_4e91_8e83_573ad2e2a265.slice/crio-0752537d4ff5fea6e53de49efac7622a95eda52c0ecd03324591b622893f2667 WatchSource:0}: Error finding container 0752537d4ff5fea6e53de49efac7622a95eda52c0ecd03324591b622893f2667: Status 404 returned error can't find the container with id 0752537d4ff5fea6e53de49efac7622a95eda52c0ecd03324591b622893f2667 Jun 09 02:59:46.158110 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:46.157847 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd348c30a_0d0a_4a00_89a5_945f9cf88304.slice/crio-2d4cade1e92e7f63a6a8aaee834cf1beefeaf61802fe95d3706cb1a31e3755f7 WatchSource:0}: Error finding container 2d4cade1e92e7f63a6a8aaee834cf1beefeaf61802fe95d3706cb1a31e3755f7: Status 404 returned error can't find the container with id 2d4cade1e92e7f63a6a8aaee834cf1beefeaf61802fe95d3706cb1a31e3755f7 Jun 09 02:59:46.161348 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:46.161328 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc03ebb_dd2e_4062_b9a4_2443742319cf.slice/crio-e81058ca8b1689fcf75311e1fee52f2332aaba3ccb2ecf90851f11d79d5e4ace WatchSource:0}: Error finding container e81058ca8b1689fcf75311e1fee52f2332aaba3ccb2ecf90851f11d79d5e4ace: Status 404 returned error can't find the container with id e81058ca8b1689fcf75311e1fee52f2332aaba3ccb2ecf90851f11d79d5e4ace Jun 09 02:59:46.163023 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:46.162999 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6834b640_f33e_4cc2_96f1_038a55c5ff71.slice/crio-509ff454a77c958e119f4c6e94ce56d64368c916b76a0dd8c512fcc5093840f5 WatchSource:0}: Error finding container 509ff454a77c958e119f4c6e94ce56d64368c916b76a0dd8c512fcc5093840f5: Status 404 returned error can't find the container with id 509ff454a77c958e119f4c6e94ce56d64368c916b76a0dd8c512fcc5093840f5 Jun 09 02:59:46.164749 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:46.164706 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ad2818_5103_48f9_ad94_616c4956273d.slice/crio-30e8594ee668353988c91a1c1ddc6b2a2410b8ac03f07445912a593f133eb7cb WatchSource:0}: Error finding container 30e8594ee668353988c91a1c1ddc6b2a2410b8ac03f07445912a593f133eb7cb: Status 404 returned error can't find the container with id 30e8594ee668353988c91a1c1ddc6b2a2410b8ac03f07445912a593f133eb7cb Jun 09 02:59:46.165669 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:46.165648 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd66dde4_da1d_49c1_b791_dca66777bd71.slice/crio-738d852fa919573983dca7e91a800086505c6b9d6f596638bdde14494c6ca2f6 WatchSource:0}: Error finding container 738d852fa919573983dca7e91a800086505c6b9d6f596638bdde14494c6ca2f6: Status 404 returned error can't find the container with id 738d852fa919573983dca7e91a800086505c6b9d6f596638bdde14494c6ca2f6 Jun 09 02:59:46.166686 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:46.166596 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00933df_8470_4be5_8679_54ba6a748b3d.slice/crio-ce743464a4ab0ab3266dfff5cba3c755d2919309de7eb1253baf9b1f41fab07a WatchSource:0}: Error finding container ce743464a4ab0ab3266dfff5cba3c755d2919309de7eb1253baf9b1f41fab07a: Status 404 returned error can't find the container with id ce743464a4ab0ab3266dfff5cba3c755d2919309de7eb1253baf9b1f41fab07a Jun 09 02:59:46.167362 ip-10-0-136-172 kubenswrapper[2568]: W0609 02:59:46.167304 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db617ff_dc47_4c2f_afef_3894d8f89a2b.slice/crio-f0855e0f84c24b16aab5c4274beea75bb957de8a5b890597f66602ff59e715d6 WatchSource:0}: Error finding container f0855e0f84c24b16aab5c4274beea75bb957de8a5b890597f66602ff59e715d6: Status 404 returned error can't find the container with id f0855e0f84c24b16aab5c4274beea75bb957de8a5b890597f66602ff59e715d6 Jun 09 02:59:46.380000 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.379930 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 02:54:44 +0000 UTC" deadline="2027-12-21 04:05:43.232527981 +0000 UTC" Jun 09 02:59:46.380000 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.379984 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13441h5m56.852547197s" Jun 09 02:59:46.418228 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.418196 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerStarted","Data":"30e8594ee668353988c91a1c1ddc6b2a2410b8ac03f07445912a593f133eb7cb"} Jun 09 02:59:46.419477 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.419446 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" event={"ID":"6834b640-f33e-4cc2-96f1-038a55c5ff71","Type":"ContainerStarted","Data":"509ff454a77c958e119f4c6e94ce56d64368c916b76a0dd8c512fcc5093840f5"} Jun 09 02:59:46.420567 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.420523 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2lbc2" event={"ID":"2cc03ebb-dd2e-4062-b9a4-2443742319cf","Type":"ContainerStarted","Data":"e81058ca8b1689fcf75311e1fee52f2332aaba3ccb2ecf90851f11d79d5e4ace"} Jun 09 02:59:46.421998 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.421976 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" event={"ID":"341986da-22ac-4e91-8e83-573ad2e2a265","Type":"ContainerStarted","Data":"0752537d4ff5fea6e53de49efac7622a95eda52c0ecd03324591b622893f2667"} Jun 09 02:59:46.423226 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.423205 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hnwtf" event={"ID":"14c0ecc7-1fa2-461d-b171-4fe38f21b310","Type":"ContainerStarted","Data":"fd2703ea65cd496ee54d1becc6f32e7fed84ddf4c2b55429a96a400353a1abe4"} Jun 09 02:59:46.426406 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.426385 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal" event={"ID":"9c31be9ab5b45b5bc46bc0a18af81246","Type":"ContainerStarted","Data":"08b2b27b17d1c2736bb601759f38872ac93ee8229549c4e6bc8af111aabc1b6e"} Jun 09 02:59:46.428560 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.428530 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5vd6f" event={"ID":"f00933df-8470-4be5-8679-54ba6a748b3d","Type":"ContainerStarted","Data":"ce743464a4ab0ab3266dfff5cba3c755d2919309de7eb1253baf9b1f41fab07a"} Jun 09 02:59:46.429637 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.429618 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c56r6" event={"ID":"d348c30a-0d0a-4a00-89a5-945f9cf88304","Type":"ContainerStarted","Data":"2d4cade1e92e7f63a6a8aaee834cf1beefeaf61802fe95d3706cb1a31e3755f7"} Jun 09 02:59:46.433350 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.433322 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x6244" event={"ID":"7db617ff-dc47-4c2f-afef-3894d8f89a2b","Type":"ContainerStarted","Data":"f0855e0f84c24b16aab5c4274beea75bb957de8a5b890597f66602ff59e715d6"} Jun 09 02:59:46.434540 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.434518 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jnj47" event={"ID":"fd66dde4-da1d-49c1-b791-dca66777bd71","Type":"ContainerStarted","Data":"738d852fa919573983dca7e91a800086505c6b9d6f596638bdde14494c6ca2f6"} Jun 09 02:59:46.439162 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.439112 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-172.ec2.internal" podStartSLOduration=2.439095977 podStartE2EDuration="2.439095977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:59:46.438604705 +0000 UTC m=+3.437611162" watchObservedRunningTime="2026-06-09 02:59:46.439095977 +0000 UTC m=+3.438102424" Jun 09 02:59:46.969738 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.968934 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:46.969738 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:46.968995 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:46.969738 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:46.969152 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:59:46.969738 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:46.969216 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret podName:a7455a43-a416-40a2-b102-d498bf398269 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:48.969196488 +0000 UTC m=+5.968202933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret") pod "global-pull-secret-syncer-5qbmr" (UID: "a7455a43-a416-40a2-b102-d498bf398269") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:59:46.969738 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:46.969649 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:59:46.969738 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:46.969704 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs podName:dbfc6f31-41c5-4e02-9e38-2a3248ca1063 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:48.969686653 +0000 UTC m=+5.968693081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs") pod "network-metrics-daemon-fbpvr" (UID: "dbfc6f31-41c5-4e02-9e38-2a3248ca1063") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:59:47.069690 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:47.069647 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzfp\" (UniqueName: \"kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp\") pod \"network-check-target-hxpx7\" (UID: \"1744ad2a-8698-4fa5-9b1d-fd6d234256d1\") " pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:47.069860 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:47.069817 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:59:47.069860 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:47.069840 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:59:47.069860 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:47.069852 2568 projected.go:196] Error preparing data for projected volume kube-api-access-5mzfp for pod openshift-network-diagnostics/network-check-target-hxpx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:59:47.070017 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:47.069913 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp podName:1744ad2a-8698-4fa5-9b1d-fd6d234256d1 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:49.069894225 +0000 UTC m=+6.068900653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5mzfp" (UniqueName: "kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp") pod "network-check-target-hxpx7" (UID: "1744ad2a-8698-4fa5-9b1d-fd6d234256d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:59:47.411573 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:47.409815 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:47.411573 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:47.409943 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 02:59:47.411573 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:47.410375 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:47.411573 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:47.410483 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 02:59:47.411573 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:47.410557 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:47.411573 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:47.410628 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 02:59:47.448938 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:47.447777 2568 generic.go:356] "Generic (PLEG): container finished" podID="921d4fba766938b5001b2e2d4d67ec1a" containerID="8646ef3c827675fe7e11766bb0c99bdce4dedffe08d0fc807acfbb27b8ec9583" exitCode=0 Jun 09 02:59:47.448938 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:47.448715 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" event={"ID":"921d4fba766938b5001b2e2d4d67ec1a","Type":"ContainerDied","Data":"8646ef3c827675fe7e11766bb0c99bdce4dedffe08d0fc807acfbb27b8ec9583"} Jun 09 02:59:48.468371 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:48.468271 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" event={"ID":"921d4fba766938b5001b2e2d4d67ec1a","Type":"ContainerStarted","Data":"096bfb794838402fa0eea19ae52f2019e4abc6b1ea9f32f7204e242f7ffcf9e7"} Jun 09 02:59:48.483636 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:48.482791 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-172.ec2.internal" podStartSLOduration=4.482770389 podStartE2EDuration="4.482770389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:59:48.482318855 +0000 UTC m=+5.481325302" watchObservedRunningTime="2026-06-09 02:59:48.482770389 +0000 UTC m=+5.481776836" Jun 09 02:59:48.986709 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:48.986670 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:48.986882 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:48.986735 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:48.986882 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:48.986801 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:59:48.986882 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:48.986873 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs podName:dbfc6f31-41c5-4e02-9e38-2a3248ca1063 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:52.986854238 +0000 UTC m=+9.985860665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs") pod "network-metrics-daemon-fbpvr" (UID: "dbfc6f31-41c5-4e02-9e38-2a3248ca1063") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:59:48.987053 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:48.986885 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:59:48.987053 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:48.986945 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret podName:a7455a43-a416-40a2-b102-d498bf398269 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:52.98692938 +0000 UTC m=+9.985935809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret") pod "global-pull-secret-syncer-5qbmr" (UID: "a7455a43-a416-40a2-b102-d498bf398269") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:59:49.088201 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:49.087597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzfp\" (UniqueName: \"kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp\") pod \"network-check-target-hxpx7\" (UID: \"1744ad2a-8698-4fa5-9b1d-fd6d234256d1\") " pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:49.088201 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:49.087752 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:59:49.088201 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:49.087774 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:59:49.088201 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:49.087787 2568 projected.go:196] Error preparing data for projected volume kube-api-access-5mzfp for pod openshift-network-diagnostics/network-check-target-hxpx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:59:49.088201 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:49.087845 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp podName:1744ad2a-8698-4fa5-9b1d-fd6d234256d1 nodeName:}" failed. No retries permitted until 2026-06-09 02:59:53.087825819 +0000 UTC m=+10.086832244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5mzfp" (UniqueName: "kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp") pod "network-check-target-hxpx7" (UID: "1744ad2a-8698-4fa5-9b1d-fd6d234256d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:59:49.413598 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:49.413565 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:49.413784 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:49.413568 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:49.413784 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:49.413706 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 02:59:49.413911 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:49.413798 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 02:59:49.413911 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:49.413571 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:49.413911 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:49.413896 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 02:59:51.410088 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:51.409993 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:51.410088 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:51.410035 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:51.410645 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:51.409993 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:51.410645 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:51.410137 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 02:59:51.410645 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:51.410250 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 02:59:51.410645 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:51.410336 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 02:59:53.022164 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:53.022126 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:53.022671 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:53.022194 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:53.022671 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.022371 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:59:53.022671 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.022437 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret podName:a7455a43-a416-40a2-b102-d498bf398269 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:01.022417164 +0000 UTC m=+18.021423589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret") pod "global-pull-secret-syncer-5qbmr" (UID: "a7455a43-a416-40a2-b102-d498bf398269") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:59:53.022671 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.022520 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:59:53.022671 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.022556 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs podName:dbfc6f31-41c5-4e02-9e38-2a3248ca1063 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:01.022544169 +0000 UTC m=+18.021550597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs") pod "network-metrics-daemon-fbpvr" (UID: "dbfc6f31-41c5-4e02-9e38-2a3248ca1063") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:59:53.122828 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:53.122781 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzfp\" (UniqueName: \"kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp\") pod \"network-check-target-hxpx7\" (UID: \"1744ad2a-8698-4fa5-9b1d-fd6d234256d1\") " pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:53.123012 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.122960 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:59:53.123012 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.122984 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:59:53.123012 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.122996 2568 projected.go:196] Error preparing data for projected volume kube-api-access-5mzfp for pod openshift-network-diagnostics/network-check-target-hxpx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:59:53.123174 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.123059 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp podName:1744ad2a-8698-4fa5-9b1d-fd6d234256d1 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:01.123042169 +0000 UTC m=+18.122048595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5mzfp" (UniqueName: "kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp") pod "network-check-target-hxpx7" (UID: "1744ad2a-8698-4fa5-9b1d-fd6d234256d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:59:53.410956 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:53.410877 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:53.411146 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.410997 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 02:59:53.411146 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:53.411014 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:53.411146 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:53.411038 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:53.411303 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.411162 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 02:59:53.411303 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:53.411269 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 02:59:55.409887 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:55.409850 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:55.410400 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:55.409851 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:55.410400 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:55.409987 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:55.410400 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:55.409983 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 02:59:55.410400 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:55.410109 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 02:59:55.410400 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:55.410199 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 02:59:57.409658 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:57.409611 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:57.409658 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:57.409643 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:57.410160 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:57.409613 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:57.410160 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:57.409752 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 02:59:57.410160 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:57.409844 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 02:59:57.410160 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:57.409937 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 02:59:59.410473 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:59.410416 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 02:59:59.410909 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:59.410447 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 02:59:59.410909 ip-10-0-136-172 kubenswrapper[2568]: I0609 02:59:59.410416 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 02:59:59.410909 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:59.410587 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 02:59:59.410909 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:59.410690 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 02:59:59.410909 ip-10-0-136-172 kubenswrapper[2568]: E0609 02:59:59.410791 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 03:00:01.085245 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:01.085196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:01.085673 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:01.085317 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:01.085673 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.085385 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 03:00:01.085673 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.085425 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 03:00:01.085673 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.085460 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs podName:dbfc6f31-41c5-4e02-9e38-2a3248ca1063 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:17.085441902 +0000 UTC m=+34.084448332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs") pod "network-metrics-daemon-fbpvr" (UID: "dbfc6f31-41c5-4e02-9e38-2a3248ca1063") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 03:00:01.085673 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.085475 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret podName:a7455a43-a416-40a2-b102-d498bf398269 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:17.085468967 +0000 UTC m=+34.084475390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret") pod "global-pull-secret-syncer-5qbmr" (UID: "a7455a43-a416-40a2-b102-d498bf398269") : object "kube-system"/"original-pull-secret" not registered Jun 09 03:00:01.186590 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:01.186532 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzfp\" (UniqueName: \"kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp\") pod \"network-check-target-hxpx7\" (UID: \"1744ad2a-8698-4fa5-9b1d-fd6d234256d1\") " pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:01.186784 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.186716 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 03:00:01.186784 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.186740 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 03:00:01.186784 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.186750 2568 projected.go:196] Error preparing data for projected volume kube-api-access-5mzfp for pod openshift-network-diagnostics/network-check-target-hxpx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 03:00:01.186942 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.186805 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp podName:1744ad2a-8698-4fa5-9b1d-fd6d234256d1 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:17.186789299 +0000 UTC m=+34.185795734 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5mzfp" (UniqueName: "kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp") pod "network-check-target-hxpx7" (UID: "1744ad2a-8698-4fa5-9b1d-fd6d234256d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 03:00:01.410380 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:01.410348 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:01.410562 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:01.410348 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:01.410562 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:01.410356 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:01.410562 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.410523 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 03:00:01.410734 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.410592 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 03:00:01.410734 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:01.410666 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 03:00:03.412528 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:03.411733 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:03.412528 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:03.411921 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 03:00:03.412528 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:03.412389 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:03.413215 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:03.413135 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 03:00:03.413316 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:03.413183 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:03.413436 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:03.413404 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 03:00:04.503115 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.502930 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jnj47" event={"ID":"fd66dde4-da1d-49c1-b791-dca66777bd71","Type":"ContainerStarted","Data":"e8f65d90bbaf31c897a0238994ca9442f15fbb2e63b5bab73d853b957bc3d809"} Jun 09 03:00:04.504692 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.504665 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerStarted","Data":"72b512219fa0c8e471d5a8f333d40a700e321d9a37047a8a0b493af6d1b8a748"} Jun 09 03:00:04.504779 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.504730 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerStarted","Data":"73b41f874e94e408d9aaf84f862f150f0009175f586a17cf3096dbe6850dc9c4"} Jun 09 03:00:04.505967 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.505942 2568 generic.go:356] "Generic (PLEG): container finished" podID="6834b640-f33e-4cc2-96f1-038a55c5ff71" containerID="235313833deb38d2cf47023c797c6800fd69024d5b1571605c179f72a4ce801a" exitCode=0 Jun 09 03:00:04.506058 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.506017 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" event={"ID":"6834b640-f33e-4cc2-96f1-038a55c5ff71","Type":"ContainerDied","Data":"235313833deb38d2cf47023c797c6800fd69024d5b1571605c179f72a4ce801a"} Jun 09 03:00:04.507520 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.507429 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2lbc2" event={"ID":"2cc03ebb-dd2e-4062-b9a4-2443742319cf","Type":"ContainerStarted","Data":"5cc982aab942c4242006bdb941871f08f8788a9e6a836eba0e521ce434d205cf"} Jun 09 03:00:04.508945 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.508921 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" event={"ID":"341986da-22ac-4e91-8e83-573ad2e2a265","Type":"ContainerStarted","Data":"915cf9e304c2c50ec24e9cca3e89a40cc65267456378c663f50303e1433a8619"} Jun 09 03:00:04.510318 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.510295 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hnwtf" event={"ID":"14c0ecc7-1fa2-461d-b171-4fe38f21b310","Type":"ContainerStarted","Data":"45dbc1a9553d549c508b3296c92ba8ef857ece993ff1f782439c68733498eb10"} Jun 09 03:00:04.512024 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.512001 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5vd6f" event={"ID":"f00933df-8470-4be5-8679-54ba6a748b3d","Type":"ContainerStarted","Data":"47df6ceabebc0e8119b613a89e73a2c96a8eaab0ffe4798cf5440fc9023a02ce"} Jun 09 03:00:04.515991 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.514149 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c56r6" event={"ID":"d348c30a-0d0a-4a00-89a5-945f9cf88304","Type":"ContainerStarted","Data":"5f23e0a5685c6133ce2bb0569e83837569f105d68f7fb524e4865c463899388e"} Jun 09 03:00:04.539705 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.539653 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5vd6f" podStartSLOduration=3.865164816 podStartE2EDuration="21.53963353s" totalImagesPullingTime="17.674468714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:04.538902357 +0000 UTC m=+21.537908801" watchObservedRunningTime="2026-06-09 03:00:04.53963353 +0000 UTC m=+21.538639976" Jun 09 03:00:04.552433 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.552256 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jnj47" podStartSLOduration=3.849091047 podStartE2EDuration="21.552233332s" totalImagesPullingTime="17.703142285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:04.551552608 +0000 UTC m=+21.550559074" watchObservedRunningTime="2026-06-09 03:00:04.552233332 +0000 UTC m=+21.551239777" Jun 09 03:00:04.567267 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.567217 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c56r6" podStartSLOduration=3.83432537 podStartE2EDuration="21.567201922s" totalImagesPullingTime="17.732876552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:04.566755183 +0000 UTC m=+21.565761629" watchObservedRunningTime="2026-06-09 03:00:04.567201922 +0000 UTC m=+21.566208424" Jun 09 03:00:04.582535 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.582469 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2lbc2" podStartSLOduration=3.818578821 podStartE2EDuration="21.582452284s" totalImagesPullingTime="17.763873463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:04.581856757 +0000 UTC m=+21.580863202" watchObservedRunningTime="2026-06-09 03:00:04.582452284 +0000 UTC m=+21.581458728" Jun 09 03:00:04.597317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.597279 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hnwtf" podStartSLOduration=8.115531117 podStartE2EDuration="21.597265294s" totalImagesPullingTime="13.481734177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:04.596826843 +0000 UTC m=+21.595833307" watchObservedRunningTime="2026-06-09 03:00:04.597265294 +0000 UTC m=+21.596271738" Jun 09 03:00:04.618560 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.618463 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:04.700970 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.700940 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:04.800658 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.800633 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:04.900903 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.900824 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:04.948990 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:04.948953 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:05.102991 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.102962 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:05.203417 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.203387 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:05.409845 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.409780 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:05.409845 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.409816 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:05.410065 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.409780 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:05.410065 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:05.409903 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 03:00:05.410065 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:05.409970 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 03:00:05.410065 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:05.410037 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 03:00:05.518996 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.518957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x6244" event={"ID":"7db617ff-dc47-4c2f-afef-3894d8f89a2b","Type":"ContainerStarted","Data":"201ddb646b6790e44c2160567cace0270ad8a03d5e157581b86fd120f38fef15"} Jun 09 03:00:05.523574 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.522698 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:00:05.523574 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.523204 2568 generic.go:356] "Generic (PLEG): container finished" podID="91ad2818-5103-48f9-ad94-616c4956273d" containerID="72b512219fa0c8e471d5a8f333d40a700e321d9a37047a8a0b493af6d1b8a748" exitCode=1 Jun 09 03:00:05.523574 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.523445 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerDied","Data":"72b512219fa0c8e471d5a8f333d40a700e321d9a37047a8a0b493af6d1b8a748"} Jun 09 03:00:05.523836 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.523604 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerStarted","Data":"0a16f240326bc27d9efc9479bb3fa4403413af66cbe1477a5151dde8200c833c"} Jun 09 03:00:05.523836 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.523679 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerStarted","Data":"567ee6915edd5ea6f65fdb9c0569b3498e59d8f6573e7ebf6ba6ef1827b7a279"} Jun 09 03:00:05.523836 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.523791 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerStarted","Data":"7a486a27b48980e7afa5d384b8966dba192f5f5cc03cce791d183e6148a401c4"} Jun 09 03:00:05.523970 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.523857 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerStarted","Data":"a9a5d3e0bfa764699e1ec2c43dcf0ffc98caf76ef2d8f35b3b91b6c526548edb"} Jun 09 03:00:05.535295 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.535244 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x6244" podStartSLOduration=4.832448138 podStartE2EDuration="22.53522783s" totalImagesPullingTime="17.702779692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:05.534656069 +0000 UTC m=+22.533662513" watchObservedRunningTime="2026-06-09 03:00:05.53522783 +0000 UTC m=+22.534234276" Jun 09 03:00:05.610254 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.610227 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 03:00:05.651618 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.651575 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:05.697745 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:05.697716 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:06.044332 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:06.044288 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:06.093155 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:06.093089 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:06.403791 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:06.403630 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T03:00:05.610248779Z","UUID":"a327e159-6809-40db-b910-604771258953","Handler":null,"Name":"","Endpoint":""} Jun 09 03:00:06.405367 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:06.405342 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 03:00:06.405515 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:06.405382 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 03:00:06.528317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:06.528279 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" event={"ID":"341986da-22ac-4e91-8e83-573ad2e2a265","Type":"ContainerStarted","Data":"a9e99d940f311caf0ad7c2315799fd8dc655a35cf52f9b355f440df9551be692"} Jun 09 03:00:07.390611 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:07.390325 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hnwtf" Jun 09 03:00:07.390941 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:07.390916 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hnwtf" Jun 09 03:00:07.410102 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:07.410073 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:07.410290 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:07.410112 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:07.410290 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:07.410073 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:07.410290 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:07.410195 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 03:00:07.410448 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:07.410325 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 03:00:07.410448 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:07.410411 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 03:00:07.534752 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:07.534723 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:00:07.535227 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:07.535201 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerStarted","Data":"353589be85006705a98b2c966f3a90e16cd2837f59d0cc2d520b38b7d8b3e89c"} Jun 09 03:00:07.537452 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:07.537415 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" event={"ID":"341986da-22ac-4e91-8e83-573ad2e2a265","Type":"ContainerStarted","Data":"6b74cfafb941d4b97cd0cb2e00cbf2a92261b89d2bc12b3b494b2ccf3dd046fe"} Jun 09 03:00:07.554201 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:07.554150 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22kh7" podStartSLOduration=4.485707866 podStartE2EDuration="24.55413425s" totalImagesPullingTime="20.068426384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:07.55365392 +0000 UTC m=+24.552660365" watchObservedRunningTime="2026-06-09 03:00:07.55413425 +0000 UTC m=+24.553140729" Jun 09 03:00:08.433508 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:08.433464 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hnwtf" Jun 09 03:00:08.434086 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:08.434061 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hnwtf" Jun 09 03:00:08.485799 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:08.485761 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:09.410421 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:09.410230 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:09.411129 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:09.410230 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:09.411129 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:09.410524 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 03:00:09.411129 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:09.410619 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 03:00:09.411129 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:09.410275 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:09.411129 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:09.410753 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 03:00:09.545904 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:09.545782 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:00:09.546152 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:09.546130 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerStarted","Data":"82f2845358a63fd785944beb6b15ae14c1a04d88a85c9b41b9f80a1f7e42b8d8"} Jun 09 03:00:09.546401 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:09.546381 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 03:00:09.546654 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:09.546636 2568 scope.go:117] "RemoveContainer" containerID="72b512219fa0c8e471d5a8f333d40a700e321d9a37047a8a0b493af6d1b8a748" Jun 09 03:00:09.548054 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:09.548027 2568 generic.go:356] "Generic (PLEG): container finished" podID="6834b640-f33e-4cc2-96f1-038a55c5ff71" containerID="8c3c031e45f20c0bd7489ffa1c6fca3f86017f4d2d1158d34ce20ee8c206f6fa" exitCode=0 Jun 09 03:00:09.548178 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:09.548118 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" event={"ID":"6834b640-f33e-4cc2-96f1-038a55c5ff71","Type":"ContainerDied","Data":"8c3c031e45f20c0bd7489ffa1c6fca3f86017f4d2d1158d34ce20ee8c206f6fa"} Jun 09 03:00:09.564006 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:09.563985 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 03:00:10.553691 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:10.553623 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:00:10.554127 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:10.553958 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" event={"ID":"91ad2818-5103-48f9-ad94-616c4956273d","Type":"ContainerStarted","Data":"052643b831c09a4ee768d8fa2bc858c2a24a8743abe267cf7a07bfeb16613f4e"} Jun 09 03:00:10.554127 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:10.554046 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 03:00:10.554292 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:10.554272 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 03:00:10.556368 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:10.556338 2568 generic.go:356] "Generic (PLEG): container finished" podID="6834b640-f33e-4cc2-96f1-038a55c5ff71" containerID="4753d52c332bd96d978afb9c3ec9fdfd968303146a9fa4bcf89bbe919b95eb03" exitCode=0 Jun 09 03:00:10.556490 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:10.556388 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" event={"ID":"6834b640-f33e-4cc2-96f1-038a55c5ff71","Type":"ContainerDied","Data":"4753d52c332bd96d978afb9c3ec9fdfd968303146a9fa4bcf89bbe919b95eb03"} Jun 09 03:00:10.569538 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:10.569512 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 03:00:10.579258 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:10.579214 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" podStartSLOduration=9.464032881 podStartE2EDuration="27.579197516s" totalImagesPullingTime="18.115164635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:10.578779267 +0000 UTC m=+27.577785711" watchObservedRunningTime="2026-06-09 03:00:10.579197516 +0000 UTC m=+27.578203982" Jun 09 03:00:11.384719 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:11.384531 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5qbmr"] Jun 09 03:00:11.384856 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:11.384843 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:11.384940 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:11.384923 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 03:00:11.387175 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:11.387152 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxpx7"] Jun 09 03:00:11.387309 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:11.387248 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:11.387357 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:11.387320 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 03:00:11.387911 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:11.387888 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbpvr"] Jun 09 03:00:11.388036 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:11.388003 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:11.388128 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:11.388109 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 03:00:11.561511 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:11.561458 2568 generic.go:356] "Generic (PLEG): container finished" podID="6834b640-f33e-4cc2-96f1-038a55c5ff71" containerID="9ca11cc8dcd8b7396eee91cf234691c00a24ab6a7d2c89a0af262eed232be78e" exitCode=0 Jun 09 03:00:11.561892 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:11.561537 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" event={"ID":"6834b640-f33e-4cc2-96f1-038a55c5ff71","Type":"ContainerDied","Data":"9ca11cc8dcd8b7396eee91cf234691c00a24ab6a7d2c89a0af262eed232be78e"} Jun 09 03:00:11.561892 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:11.561647 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 03:00:12.564673 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:12.564644 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 03:00:12.809453 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:12.809414 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:12.856626 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:12.856525 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:13.412464 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:13.412386 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:13.413009 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:13.412619 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 03:00:13.413123 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:13.413025 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:13.413217 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:13.413194 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 03:00:13.413861 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:13.413834 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:13.413997 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:13.413961 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 03:00:14.507540 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:14.507486 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 03:00:14.508187 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:14.507745 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 03:00:14.519050 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:14.519011 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" podUID="91ad2818-5103-48f9-ad94-616c4956273d" containerName="ovnkube-controller" probeResult="failure" output="" Jun 09 03:00:14.528648 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:14.528604 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" podUID="91ad2818-5103-48f9-ad94-616c4956273d" containerName="ovnkube-controller" probeResult="failure" output="" Jun 09 03:00:15.410487 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:15.410449 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:15.410703 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:15.410516 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:15.410703 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:15.410462 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:15.410703 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:15.410598 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qbmr" podUID="a7455a43-a416-40a2-b102-d498bf398269" Jun 09 03:00:15.410703 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:15.410672 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 03:00:15.410908 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:15.410732 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxpx7" podUID="1744ad2a-8698-4fa5-9b1d-fd6d234256d1" Jun 09 03:00:16.577322 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.577288 2568 generic.go:356] "Generic (PLEG): container finished" podID="6834b640-f33e-4cc2-96f1-038a55c5ff71" containerID="34b433cd7bb8054e79b342772716e60e81b0366e75759184ab5f3e65f1d0ff38" exitCode=0 Jun 09 03:00:16.578038 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.577332 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" event={"ID":"6834b640-f33e-4cc2-96f1-038a55c5ff71","Type":"ContainerDied","Data":"34b433cd7bb8054e79b342772716e60e81b0366e75759184ab5f3e65f1d0ff38"} Jun 09 03:00:16.870687 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.870613 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-172.ec2.internal" event="NodeReady" Jun 09 03:00:16.870859 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.870741 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 03:00:16.914202 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.914170 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-klhdv"] Jun 09 03:00:16.927427 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.927258 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dnc8q"] Jun 09 03:00:16.927427 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.927414 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:16.930139 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.930110 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 03:00:16.930284 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.930182 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 03:00:16.930284 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.930115 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27vjm\"" Jun 09 03:00:16.939417 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.939394 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnc8q" Jun 09 03:00:16.939547 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.939399 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-klhdv"] Jun 09 03:00:16.939588 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.939547 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnc8q"] Jun 09 03:00:16.942122 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.942102 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 03:00:16.942122 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.942103 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kxf98\"" Jun 09 03:00:16.942309 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.942247 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 03:00:16.943302 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:16.943289 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 03:00:17.005592 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.005557 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-tmp-dir\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.005592 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.005604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.005805 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.005680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2bpf\" (UniqueName: \"kubernetes.io/projected/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-kube-api-access-v2bpf\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.005805 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.005739 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-config-volume\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.017428 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.017401 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:17.106634 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.106602 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4120ed8e-5060-458f-b402-5aa161b47996-cert\") pod \"ingress-canary-dnc8q\" (UID: \"4120ed8e-5060-458f-b402-5aa161b47996\") " pod="openshift-ingress-canary/ingress-canary-dnc8q" Jun 09 03:00:17.106839 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.106650 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:17.106839 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.106693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-tmp-dir\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.106839 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.106727 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.106839 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.106763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2bpf\" (UniqueName: \"kubernetes.io/projected/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-kube-api-access-v2bpf\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.106839 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.106772 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 03:00:17.106839 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.106812 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-config-volume\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.106839 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.106828 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret podName:a7455a43-a416-40a2-b102-d498bf398269 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:49.106810149 +0000 UTC m=+66.105816578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret") pod "global-pull-secret-syncer-5qbmr" (UID: "a7455a43-a416-40a2-b102-d498bf398269") : object "kube-system"/"original-pull-secret" not registered Jun 09 03:00:17.107159 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.106862 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqndn\" (UniqueName: \"kubernetes.io/projected/4120ed8e-5060-458f-b402-5aa161b47996-kube-api-access-lqndn\") pod \"ingress-canary-dnc8q\" (UID: \"4120ed8e-5060-458f-b402-5aa161b47996\") " pod="openshift-ingress-canary/ingress-canary-dnc8q" Jun 09 03:00:17.107159 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.106890 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:17.107159 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.106903 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 03:00:17.107159 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.106950 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 03:00:17.107159 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.106959 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls podName:6dad5db3-bce6-4f82-8696-9c8b7afe16a3 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:17.606942515 +0000 UTC m=+34.605948959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls") pod "dns-default-klhdv" (UID: "6dad5db3-bce6-4f82-8696-9c8b7afe16a3") : secret "dns-default-metrics-tls" not found Jun 09 03:00:17.107159 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.106987 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs podName:dbfc6f31-41c5-4e02-9e38-2a3248ca1063 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:49.106972885 +0000 UTC m=+66.105979309 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs") pod "network-metrics-daemon-fbpvr" (UID: "dbfc6f31-41c5-4e02-9e38-2a3248ca1063") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 03:00:17.107159 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.107071 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-tmp-dir\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.107369 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.107343 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-config-volume\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.116776 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.116635 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2bpf\" (UniqueName: \"kubernetes.io/projected/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-kube-api-access-v2bpf\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.119868 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.119836 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:17.207972 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.207935 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqndn\" (UniqueName: \"kubernetes.io/projected/4120ed8e-5060-458f-b402-5aa161b47996-kube-api-access-lqndn\") pod \"ingress-canary-dnc8q\" (UID: \"4120ed8e-5060-458f-b402-5aa161b47996\") " pod="openshift-ingress-canary/ingress-canary-dnc8q" Jun 09 03:00:17.208152 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.207988 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4120ed8e-5060-458f-b402-5aa161b47996-cert\") pod \"ingress-canary-dnc8q\" (UID: \"4120ed8e-5060-458f-b402-5aa161b47996\") " pod="openshift-ingress-canary/ingress-canary-dnc8q" Jun 09 03:00:17.208152 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.208039 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzfp\" (UniqueName: \"kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp\") pod \"network-check-target-hxpx7\" (UID: \"1744ad2a-8698-4fa5-9b1d-fd6d234256d1\") " pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:17.208247 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.208154 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 03:00:17.208247 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.208168 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 03:00:17.208247 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.208177 2568 projected.go:196] Error preparing data for projected volume kube-api-access-5mzfp for pod openshift-network-diagnostics/network-check-target-hxpx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 03:00:17.208247 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.208228 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp podName:1744ad2a-8698-4fa5-9b1d-fd6d234256d1 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:49.208214903 +0000 UTC m=+66.207221337 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5mzfp" (UniqueName: "kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp") pod "network-check-target-hxpx7" (UID: "1744ad2a-8698-4fa5-9b1d-fd6d234256d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 03:00:17.210639 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.210608 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4120ed8e-5060-458f-b402-5aa161b47996-cert\") pod \"ingress-canary-dnc8q\" (UID: \"4120ed8e-5060-458f-b402-5aa161b47996\") " pod="openshift-ingress-canary/ingress-canary-dnc8q" Jun 09 03:00:17.215984 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.215963 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqndn\" (UniqueName: \"kubernetes.io/projected/4120ed8e-5060-458f-b402-5aa161b47996-kube-api-access-lqndn\") pod \"ingress-canary-dnc8q\" (UID: \"4120ed8e-5060-458f-b402-5aa161b47996\") " pod="openshift-ingress-canary/ingress-canary-dnc8q" Jun 09 03:00:17.247128 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.247096 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnc8q" Jun 09 03:00:17.410252 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.410210 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:17.410443 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.410268 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:17.410443 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.410329 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:17.414471 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.413461 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 03:00:17.414471 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.413866 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 03:00:17.414471 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.414008 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 03:00:17.414471 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.414108 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqjfg\"" Jun 09 03:00:17.414471 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.414265 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-stcvs\"" Jun 09 03:00:17.414471 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.414368 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 03:00:17.417126 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.417049 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnc8q"] Jun 09 03:00:17.420368 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:00:17.420345 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4120ed8e_5060_458f_b402_5aa161b47996.slice/crio-727096a28dce3254f567002519076fc0d4b61476452e82f8e6415d479380fc64 WatchSource:0}: Error finding container 727096a28dce3254f567002519076fc0d4b61476452e82f8e6415d479380fc64: Status 404 returned error can't find the container with id 727096a28dce3254f567002519076fc0d4b61476452e82f8e6415d479380fc64 Jun 09 03:00:17.582853 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.582747 2568 generic.go:356] "Generic (PLEG): container finished" podID="6834b640-f33e-4cc2-96f1-038a55c5ff71" containerID="92ecf61df3b4c10beedf26052ce00475810062cde6404c794cbd284b07b9c93b" exitCode=0 Jun 09 03:00:17.583341 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.582838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" event={"ID":"6834b640-f33e-4cc2-96f1-038a55c5ff71","Type":"ContainerDied","Data":"92ecf61df3b4c10beedf26052ce00475810062cde6404c794cbd284b07b9c93b"} Jun 09 03:00:17.584102 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.584076 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnc8q" event={"ID":"4120ed8e-5060-458f-b402-5aa161b47996","Type":"ContainerStarted","Data":"727096a28dce3254f567002519076fc0d4b61476452e82f8e6415d479380fc64"} Jun 09 03:00:17.610006 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:17.609981 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:17.610139 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.610121 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 03:00:17.610192 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:17.610183 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls podName:6dad5db3-bce6-4f82-8696-9c8b7afe16a3 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:18.610166664 +0000 UTC m=+35.609173091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls") pod "dns-default-klhdv" (UID: "6dad5db3-bce6-4f82-8696-9c8b7afe16a3") : secret "dns-default-metrics-tls" not found Jun 09 03:00:18.590323 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:18.590287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" event={"ID":"6834b640-f33e-4cc2-96f1-038a55c5ff71","Type":"ContainerStarted","Data":"05a17fcfae206b3a8a77abaa6f65ae65127733e8c4c6116271caed2f7ae7c4e0"} Jun 09 03:00:18.612347 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:18.612289 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zmx5b" podStartSLOduration=7.834757188 podStartE2EDuration="35.612269078s" totalImagesPullingTime="27.77751189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:18.610389003 +0000 UTC m=+35.609395483" watchObservedRunningTime="2026-06-09 03:00:18.612269078 +0000 UTC m=+35.611275523" Jun 09 03:00:18.616971 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:18.616934 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:18.617134 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:18.617056 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 03:00:18.617134 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:18.617111 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls podName:6dad5db3-bce6-4f82-8696-9c8b7afe16a3 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:20.617097728 +0000 UTC m=+37.616104151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls") pod "dns-default-klhdv" (UID: "6dad5db3-bce6-4f82-8696-9c8b7afe16a3") : secret "dns-default-metrics-tls" not found Jun 09 03:00:18.732316 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:18.732287 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:18.832045 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:18.832008 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:20.596332 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:20.596291 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnc8q" event={"ID":"4120ed8e-5060-458f-b402-5aa161b47996","Type":"ContainerStarted","Data":"81bf08193e303b76994701fa4065b0281fd003cc4ce56d0da6098bf282ca06de"} Jun 09 03:00:20.611174 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:20.611126 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dnc8q" podStartSLOduration=2.35443661 podStartE2EDuration="4.61111244s" totalImagesPullingTime="2.25667583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:20.610486968 +0000 UTC m=+37.609493411" watchObservedRunningTime="2026-06-09 03:00:20.61111244 +0000 UTC m=+37.610118883" Jun 09 03:00:20.633259 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:20.633226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:20.633445 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:20.633373 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 03:00:20.633445 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:20.633434 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls podName:6dad5db3-bce6-4f82-8696-9c8b7afe16a3 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:24.633418598 +0000 UTC m=+41.632425021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls") pod "dns-default-klhdv" (UID: "6dad5db3-bce6-4f82-8696-9c8b7afe16a3") : secret "dns-default-metrics-tls" not found Jun 09 03:00:22.029902 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:22.029871 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:22.073541 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:22.073512 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:24.662516 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:24.662439 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:24.662909 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:24.662600 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 03:00:24.662909 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:24.662667 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls podName:6dad5db3-bce6-4f82-8696-9c8b7afe16a3 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:32.662651406 +0000 UTC m=+49.661657829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls") pod "dns-default-klhdv" (UID: "6dad5db3-bce6-4f82-8696-9c8b7afe16a3") : secret "dns-default-metrics-tls" not found Jun 09 03:00:26.838719 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:26.838688 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:26.886434 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:26.886406 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:32.721208 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:32.721168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:32.721631 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:32.721323 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 03:00:32.721631 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:32.721400 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls podName:6dad5db3-bce6-4f82-8696-9c8b7afe16a3 nodeName:}" failed. No retries permitted until 2026-06-09 03:00:48.72138352 +0000 UTC m=+65.720389944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls") pod "dns-default-klhdv" (UID: "6dad5db3-bce6-4f82-8696-9c8b7afe16a3") : secret "dns-default-metrics-tls" not found Jun 09 03:00:44.529045 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:44.529020 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9rp4j" Jun 09 03:00:44.637080 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:44.637045 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:44.735714 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:44.735680 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:00:48.737231 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:48.737168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:00:48.737702 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:48.737306 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 03:00:48.737702 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:48.737392 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls podName:6dad5db3-bce6-4f82-8696-9c8b7afe16a3 nodeName:}" failed. No retries permitted until 2026-06-09 03:01:20.737376401 +0000 UTC m=+97.736382825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls") pod "dns-default-klhdv" (UID: "6dad5db3-bce6-4f82-8696-9c8b7afe16a3") : secret "dns-default-metrics-tls" not found Jun 09 03:00:49.139612 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.139527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:00:49.139612 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.139565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:49.142330 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.142308 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 03:00:49.142392 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.142347 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 03:00:49.150509 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:49.150476 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 03:00:49.150613 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:00:49.150553 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs podName:dbfc6f31-41c5-4e02-9e38-2a3248ca1063 nodeName:}" failed. No retries permitted until 2026-06-09 03:01:53.150537203 +0000 UTC m=+130.149543626 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs") pod "network-metrics-daemon-fbpvr" (UID: "dbfc6f31-41c5-4e02-9e38-2a3248ca1063") : secret "metrics-daemon-secret" not found Jun 09 03:00:49.154132 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.154109 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7455a43-a416-40a2-b102-d498bf398269-original-pull-secret\") pod \"global-pull-secret-syncer-5qbmr\" (UID: \"a7455a43-a416-40a2-b102-d498bf398269\") " pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:49.222589 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.222554 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qbmr" Jun 09 03:00:49.240191 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.240145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzfp\" (UniqueName: \"kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp\") pod \"network-check-target-hxpx7\" (UID: \"1744ad2a-8698-4fa5-9b1d-fd6d234256d1\") " pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:49.242802 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.242780 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 03:00:49.253862 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.253839 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 03:00:49.263486 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.263455 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mzfp\" (UniqueName: \"kubernetes.io/projected/1744ad2a-8698-4fa5-9b1d-fd6d234256d1-kube-api-access-5mzfp\") pod \"network-check-target-hxpx7\" (UID: \"1744ad2a-8698-4fa5-9b1d-fd6d234256d1\") " pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:49.343431 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.343399 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5qbmr"] Jun 09 03:00:49.347113 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:00:49.347089 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7455a43_a416_40a2_b102_d498bf398269.slice/crio-557e36d1593f82d4011095cf22816b59c18b13f51fdbed35c6370906b5e91df7 WatchSource:0}: Error finding container 557e36d1593f82d4011095cf22816b59c18b13f51fdbed35c6370906b5e91df7: Status 404 returned error can't find the container with id 557e36d1593f82d4011095cf22816b59c18b13f51fdbed35c6370906b5e91df7 Jun 09 03:00:49.531847 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.531820 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-stcvs\"" Jun 09 03:00:49.538852 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.538824 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:49.655465 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.655432 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxpx7"] Jun 09 03:00:49.659414 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:00:49.659386 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1744ad2a_8698_4fa5_9b1d_fd6d234256d1.slice/crio-ddf707203df7fd78a84f019c6bfcab9687381d032c978fc6565d9734b675f607 WatchSource:0}: Error finding container ddf707203df7fd78a84f019c6bfcab9687381d032c978fc6565d9734b675f607: Status 404 returned error can't find the container with id ddf707203df7fd78a84f019c6bfcab9687381d032c978fc6565d9734b675f607 Jun 09 03:00:49.663271 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.663233 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxpx7" event={"ID":"1744ad2a-8698-4fa5-9b1d-fd6d234256d1","Type":"ContainerStarted","Data":"ddf707203df7fd78a84f019c6bfcab9687381d032c978fc6565d9734b675f607"} Jun 09 03:00:49.664334 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:49.664316 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5qbmr" event={"ID":"a7455a43-a416-40a2-b102-d498bf398269","Type":"ContainerStarted","Data":"557e36d1593f82d4011095cf22816b59c18b13f51fdbed35c6370906b5e91df7"} Jun 09 03:00:52.673248 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:52.673217 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxpx7" event={"ID":"1744ad2a-8698-4fa5-9b1d-fd6d234256d1","Type":"ContainerStarted","Data":"6dfc202c9e1e7b68701a03c76a6d1e52d5a9d57af17d2342d53b564f5b6bff86"} Jun 09 03:00:52.673655 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:52.673359 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:00:52.688657 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:52.688608 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hxpx7" podStartSLOduration=66.96707448 podStartE2EDuration="1m9.688591707s" totalImagesPullingTime="2.721517227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:52.688200563 +0000 UTC m=+69.687207007" watchObservedRunningTime="2026-06-09 03:00:52.688591707 +0000 UTC m=+69.687598164" Jun 09 03:00:55.682606 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:55.682566 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5qbmr" event={"ID":"a7455a43-a416-40a2-b102-d498bf398269","Type":"ContainerStarted","Data":"36c5d7db55748c6e2185c1f949eef5506e8c096d89a4d95a16adb6850d84b9dd"} Jun 09 03:00:55.698162 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:00:55.698091 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5qbmr" podStartSLOduration=67.042496121 podStartE2EDuration="1m12.698076184s" totalImagesPullingTime="5.655580063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:00:55.697103164 +0000 UTC m=+72.696109604" watchObservedRunningTime="2026-06-09 03:00:55.698076184 +0000 UTC m=+72.697082661" Jun 09 03:01:20.759755 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:01:20.759721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:01:20.760069 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:01:20.759837 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 03:01:20.760069 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:01:20.759896 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls podName:6dad5db3-bce6-4f82-8696-9c8b7afe16a3 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:24.75988286 +0000 UTC m=+161.758889283 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls") pod "dns-default-klhdv" (UID: "6dad5db3-bce6-4f82-8696-9c8b7afe16a3") : secret "dns-default-metrics-tls" not found Jun 09 03:01:23.678050 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:01:23.678022 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hxpx7" Jun 09 03:01:53.176251 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:01:53.176200 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:01:53.176899 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:01:53.176380 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 03:01:53.176899 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:01:53.176468 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs podName:dbfc6f31-41c5-4e02-9e38-2a3248ca1063 nodeName:}" failed. No retries permitted until 2026-06-09 03:03:55.176446478 +0000 UTC m=+252.175452906 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs") pod "network-metrics-daemon-fbpvr" (UID: "dbfc6f31-41c5-4e02-9e38-2a3248ca1063") : secret "metrics-daemon-secret" not found Jun 09 03:02:03.029377 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:03.029339 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:19.936886 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:19.936832 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-klhdv" podUID="6dad5db3-bce6-4f82-8696-9c8b7afe16a3" Jun 09 03:02:20.433644 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:20.433601 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fbpvr" podUID="dbfc6f31-41c5-4e02-9e38-2a3248ca1063" Jun 09 03:02:20.879967 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:20.879935 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-klhdv" Jun 09 03:02:24.068064 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.067976 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq"] Jun 09 03:02:24.070908 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.070883 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp"] Jun 09 03:02:24.071058 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.071002 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.073732 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.073711 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:24.073866 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.073830 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 03:02:24.074908 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.074885 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 03:02:24.074908 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.074885 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5zdnz\"" Jun 09 03:02:24.075220 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.074923 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 03:02:24.075667 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.075643 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 03:02:24.076310 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.076290 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 03:02:24.076423 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.076321 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 03:02:24.076631 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.076612 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7"] Jun 09 03:02:24.076725 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.076615 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xhkx4\"" Jun 09 03:02:24.079480 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.079463 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-v2znj"] Jun 09 03:02:24.079593 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.079579 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7" Jun 09 03:02:24.082119 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.082102 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn"] Jun 09 03:02:24.082242 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.082226 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.085041 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085020 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.085140 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085060 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/441f01df-e470-46a7-b98b-e5a2b681f3fe-tmp\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.085140 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085116 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/441f01df-e470-46a7-b98b-e5a2b681f3fe-snapshots\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.085245 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085174 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxjcw\" (UniqueName: \"kubernetes.io/projected/231e8739-4ba2-4ff7-b6ba-4530ee6a5a63-kube-api-access-jxjcw\") pod \"service-ca-operator-6bc5ff68f5-7xdrq\" (UID: \"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.085245 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085211 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/441f01df-e470-46a7-b98b-e5a2b681f3fe-serving-cert\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.085324 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085249 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/21448262-f838-4bae-8fc6-4153bd0b03c7-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:24.085324 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085279 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/231e8739-4ba2-4ff7-b6ba-4530ee6a5a63-config\") pod \"service-ca-operator-6bc5ff68f5-7xdrq\" (UID: \"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.085391 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/231e8739-4ba2-4ff7-b6ba-4530ee6a5a63-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-7xdrq\" (UID: \"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.085391 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085370 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441f01df-e470-46a7-b98b-e5a2b681f3fe-service-ca-bundle\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.085469 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085414 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbg7v\" (UniqueName: \"kubernetes.io/projected/441f01df-e470-46a7-b98b-e5a2b681f3fe-kube-api-access-fbg7v\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.085469 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:24.085469 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.085458 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441f01df-e470-46a7-b98b-e5a2b681f3fe-trusted-ca-bundle\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.094934 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.094912 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 03:02:24.095048 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.095007 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-z72pc\"" Jun 09 03:02:24.095147 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.094936 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zqm9x\"" Jun 09 03:02:24.095645 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.095192 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 03:02:24.095645 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.095237 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 03:02:24.095645 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.094989 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 03:02:24.095645 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.094984 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 03:02:24.095645 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.095530 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 03:02:24.095941 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.095661 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 03:02:24.095941 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.095808 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 03:02:24.096096 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.096079 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-99vpt\"" Jun 09 03:02:24.096138 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.096116 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 03:02:24.102490 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.102469 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 03:02:24.104999 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.104978 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq"] Jun 09 03:02:24.105838 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.105817 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp"] Jun 09 03:02:24.106823 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.106790 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-v2znj"] Jun 09 03:02:24.107440 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.107422 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn"] Jun 09 03:02:24.113221 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.113201 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 03:02:24.115174 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.115147 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7"] Jun 09 03:02:24.168482 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.168449 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx"] Jun 09 03:02:24.171545 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.171523 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz"] Jun 09 03:02:24.171705 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.171587 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx" Jun 09 03:02:24.174063 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.174044 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v4zw2\"" Jun 09 03:02:24.174369 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.174354 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm"] Jun 09 03:02:24.174465 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.174452 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:24.176899 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.176847 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 03:02:24.177283 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.177267 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8w8qw"] Jun 09 03:02:24.177396 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.177383 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:24.177564 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.177546 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 03:02:24.178196 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.178180 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 03:02:24.178286 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.178204 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hxk2s\"" Jun 09 03:02:24.178286 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.178218 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 03:02:24.179972 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.179811 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 03:02:24.179972 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.179823 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 03:02:24.179972 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.179942 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2l7n4\"" Jun 09 03:02:24.180234 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.180213 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 03:02:24.180361 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.180307 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx"] Jun 09 03:02:24.180361 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.180333 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.182648 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.182630 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 03:02:24.182784 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.182767 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 03:02:24.183821 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.183033 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 03:02:24.183821 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.183450 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 03:02:24.184206 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.184186 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4mtzl\"" Jun 09 03:02:24.184727 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.184708 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz"] Jun 09 03:02:24.186155 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.186137 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm"] Jun 09 03:02:24.187459 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.186636 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx2bf\" (UniqueName: \"kubernetes.io/projected/2bacd0bf-14d9-48bb-bc75-d8da4a9c50bc-kube-api-access-gx2bf\") pod \"network-check-source-dbd9cf844-r2mfx\" (UID: \"2bacd0bf-14d9-48bb-bc75-d8da4a9c50bc\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx" Jun 09 03:02:24.187459 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a839c710-8579-45a6-adfa-ebb6eea7d32d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:24.187459 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187321 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/441f01df-e470-46a7-b98b-e5a2b681f3fe-tmp\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.187459 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187350 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:24.187459 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187383 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxjcw\" (UniqueName: \"kubernetes.io/projected/231e8739-4ba2-4ff7-b6ba-4530ee6a5a63-kube-api-access-jxjcw\") pod \"service-ca-operator-6bc5ff68f5-7xdrq\" (UID: \"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.187459 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187409 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vcqr\" (UniqueName: \"kubernetes.io/projected/e3580812-0e71-4a5a-a89c-54745684747b-kube-api-access-2vcqr\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.187459 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/441f01df-e470-46a7-b98b-e5a2b681f3fe-serving-cert\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.187459 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3580812-0e71-4a5a-a89c-54745684747b-trusted-ca\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.187891 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187486 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/21448262-f838-4bae-8fc6-4153bd0b03c7-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:24.187891 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187534 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/231e8739-4ba2-4ff7-b6ba-4530ee6a5a63-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-7xdrq\" (UID: \"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.187891 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187578 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbg7v\" (UniqueName: \"kubernetes.io/projected/441f01df-e470-46a7-b98b-e5a2b681f3fe-kube-api-access-fbg7v\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.187891 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187613 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:24.187891 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187659 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06f2f575-8396-47b7-a2d8-10193c494e6f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dgfdn\" (UID: \"06f2f575-8396-47b7-a2d8-10193c494e6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.187891 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187756 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/441f01df-e470-46a7-b98b-e5a2b681f3fe-tmp\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187929 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3580812-0e71-4a5a-a89c-54745684747b-config\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.187978 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188024 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441f01df-e470-46a7-b98b-e5a2b681f3fe-trusted-ca-bundle\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188051 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnczn\" (UniqueName: \"kubernetes.io/projected/06f2f575-8396-47b7-a2d8-10193c494e6f-kube-api-access-cnczn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dgfdn\" (UID: \"06f2f575-8396-47b7-a2d8-10193c494e6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188080 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhhlb\" (UniqueName: \"kubernetes.io/projected/e640c86c-5258-43e2-a070-6f2d06d76c63-kube-api-access-xhhlb\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188101 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3580812-0e71-4a5a-a89c-54745684747b-serving-cert\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188129 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwqbr\" (UniqueName: \"kubernetes.io/projected/b31d02dd-8dee-41a7-87cf-a5ef3442c56b-kube-api-access-nwqbr\") pod \"volume-data-source-validator-78dd696465-k9zd7\" (UID: \"b31d02dd-8dee-41a7-87cf-a5ef3442c56b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188156 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbgqw\" (UniqueName: \"kubernetes.io/projected/a839c710-8579-45a6-adfa-ebb6eea7d32d-kube-api-access-mbgqw\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/441f01df-e470-46a7-b98b-e5a2b681f3fe-snapshots\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188235 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/231e8739-4ba2-4ff7-b6ba-4530ee6a5a63-config\") pod \"service-ca-operator-6bc5ff68f5-7xdrq\" (UID: \"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441f01df-e470-46a7-b98b-e5a2b681f3fe-service-ca-bundle\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.188393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188289 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06f2f575-8396-47b7-a2d8-10193c494e6f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dgfdn\" (UID: \"06f2f575-8396-47b7-a2d8-10193c494e6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.188995 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.188482 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 03:02:24.188995 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.188593 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert podName:21448262-f838-4bae-8fc6-4153bd0b03c7 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:24.688569217 +0000 UTC m=+161.687575663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-lqpxp" (UID: "21448262-f838-4bae-8fc6-4153bd0b03c7") : secret "networking-console-plugin-cert" not found Jun 09 03:02:24.189137 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.189115 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/441f01df-e470-46a7-b98b-e5a2b681f3fe-snapshots\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.189217 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.188489 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/21448262-f838-4bae-8fc6-4153bd0b03c7-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:24.189217 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.189190 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441f01df-e470-46a7-b98b-e5a2b681f3fe-service-ca-bundle\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.189314 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.189258 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8w8qw"] Jun 09 03:02:24.189393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.189374 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441f01df-e470-46a7-b98b-e5a2b681f3fe-trusted-ca-bundle\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.189670 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.189642 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/231e8739-4ba2-4ff7-b6ba-4530ee6a5a63-config\") pod \"service-ca-operator-6bc5ff68f5-7xdrq\" (UID: \"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.190065 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.190044 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 03:02:24.190304 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.190267 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/231e8739-4ba2-4ff7-b6ba-4530ee6a5a63-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-7xdrq\" (UID: \"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.191660 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.191637 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/441f01df-e470-46a7-b98b-e5a2b681f3fe-serving-cert\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.205641 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.205616 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxjcw\" (UniqueName: \"kubernetes.io/projected/231e8739-4ba2-4ff7-b6ba-4530ee6a5a63-kube-api-access-jxjcw\") pod \"service-ca-operator-6bc5ff68f5-7xdrq\" (UID: \"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.205749 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.205685 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbg7v\" (UniqueName: \"kubernetes.io/projected/441f01df-e470-46a7-b98b-e5a2b681f3fe-kube-api-access-fbg7v\") pod \"insights-operator-896549976-v2znj\" (UID: \"441f01df-e470-46a7-b98b-e5a2b681f3fe\") " pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.270026 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.269989 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fd68b86df-xbhnh"] Jun 09 03:02:24.274461 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.274444 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.277045 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.277025 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 03:02:24.277045 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.277034 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 03:02:24.277303 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.277133 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 03:02:24.277303 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.277245 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jfmgd\"" Jun 09 03:02:24.285794 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.285747 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd68b86df-xbhnh"] Jun 09 03:02:24.286631 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.286608 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 03:02:24.288685 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.288664 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-bound-sa-token\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.288764 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.288695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vcqr\" (UniqueName: \"kubernetes.io/projected/e3580812-0e71-4a5a-a89c-54745684747b-kube-api-access-2vcqr\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.288764 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.288715 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3580812-0e71-4a5a-a89c-54745684747b-trusted-ca\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.288764 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.288737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-trusted-ca\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.288885 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.288836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:24.288996 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.288981 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06f2f575-8396-47b7-a2d8-10193c494e6f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dgfdn\" (UID: \"06f2f575-8396-47b7-a2d8-10193c494e6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.289048 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.288987 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 03:02:24.289117 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.289075 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls podName:e640c86c-5258-43e2-a070-6f2d06d76c63 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:24.789054618 +0000 UTC m=+161.788061054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-wvxvm" (UID: "e640c86c-5258-43e2-a070-6f2d06d76c63") : secret "samples-operator-tls" not found Jun 09 03:02:24.289117 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289095 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3580812-0e71-4a5a-a89c-54745684747b-config\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.289230 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnczn\" (UniqueName: \"kubernetes.io/projected/06f2f575-8396-47b7-a2d8-10193c494e6f-kube-api-access-cnczn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dgfdn\" (UID: \"06f2f575-8396-47b7-a2d8-10193c494e6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.289230 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhhlb\" (UniqueName: \"kubernetes.io/projected/e640c86c-5258-43e2-a070-6f2d06d76c63-kube-api-access-xhhlb\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:24.289230 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289181 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3580812-0e71-4a5a-a89c-54745684747b-serving-cert\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.289230 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289206 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8kbl\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-kube-api-access-s8kbl\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.289412 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289234 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwqbr\" (UniqueName: \"kubernetes.io/projected/b31d02dd-8dee-41a7-87cf-a5ef3442c56b-kube-api-access-nwqbr\") pod \"volume-data-source-validator-78dd696465-k9zd7\" (UID: \"b31d02dd-8dee-41a7-87cf-a5ef3442c56b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7" Jun 09 03:02:24.289412 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289258 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbgqw\" (UniqueName: \"kubernetes.io/projected/a839c710-8579-45a6-adfa-ebb6eea7d32d-kube-api-access-mbgqw\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:24.289412 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289283 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-ca-trust-extracted\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.289412 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289372 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-image-registry-private-configuration\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.289412 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289409 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06f2f575-8396-47b7-a2d8-10193c494e6f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dgfdn\" (UID: \"06f2f575-8396-47b7-a2d8-10193c494e6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289432 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-installation-pull-secrets\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx2bf\" (UniqueName: \"kubernetes.io/projected/2bacd0bf-14d9-48bb-bc75-d8da4a9c50bc-kube-api-access-gx2bf\") pod \"network-check-source-dbd9cf844-r2mfx\" (UID: \"2bacd0bf-14d9-48bb-bc75-d8da4a9c50bc\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx" Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289488 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-certificates\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289535 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a839c710-8579-45a6-adfa-ebb6eea7d32d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289602 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289648 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3580812-0e71-4a5a-a89c-54745684747b-trusted-ca\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.289818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.289863 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.289920 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls podName:a839c710-8579-45a6-adfa-ebb6eea7d32d nodeName:}" failed. No retries permitted until 2026-06-09 03:02:24.789909992 +0000 UTC m=+161.788916418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcglz" (UID: "a839c710-8579-45a6-adfa-ebb6eea7d32d") : secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.290120 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06f2f575-8396-47b7-a2d8-10193c494e6f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dgfdn\" (UID: \"06f2f575-8396-47b7-a2d8-10193c494e6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.290317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.290314 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a839c710-8579-45a6-adfa-ebb6eea7d32d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:24.290861 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.290461 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3580812-0e71-4a5a-a89c-54745684747b-config\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.291638 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.291619 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06f2f575-8396-47b7-a2d8-10193c494e6f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dgfdn\" (UID: \"06f2f575-8396-47b7-a2d8-10193c494e6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.292071 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.292055 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3580812-0e71-4a5a-a89c-54745684747b-serving-cert\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.299703 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.299682 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnczn\" (UniqueName: \"kubernetes.io/projected/06f2f575-8396-47b7-a2d8-10193c494e6f-kube-api-access-cnczn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dgfdn\" (UID: \"06f2f575-8396-47b7-a2d8-10193c494e6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.303629 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.303608 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vcqr\" (UniqueName: \"kubernetes.io/projected/e3580812-0e71-4a5a-a89c-54745684747b-kube-api-access-2vcqr\") pod \"console-operator-668fdbf85c-8w8qw\" (UID: \"e3580812-0e71-4a5a-a89c-54745684747b\") " pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.303758 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.303689 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhhlb\" (UniqueName: \"kubernetes.io/projected/e640c86c-5258-43e2-a070-6f2d06d76c63-kube-api-access-xhhlb\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:24.303951 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.303928 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:24.304437 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.304420 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwqbr\" (UniqueName: \"kubernetes.io/projected/b31d02dd-8dee-41a7-87cf-a5ef3442c56b-kube-api-access-nwqbr\") pod \"volume-data-source-validator-78dd696465-k9zd7\" (UID: \"b31d02dd-8dee-41a7-87cf-a5ef3442c56b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7" Jun 09 03:02:24.305045 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.305030 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx2bf\" (UniqueName: \"kubernetes.io/projected/2bacd0bf-14d9-48bb-bc75-d8da4a9c50bc-kube-api-access-gx2bf\") pod \"network-check-source-dbd9cf844-r2mfx\" (UID: \"2bacd0bf-14d9-48bb-bc75-d8da4a9c50bc\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx" Jun 09 03:02:24.305197 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.305182 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbgqw\" (UniqueName: \"kubernetes.io/projected/a839c710-8579-45a6-adfa-ebb6eea7d32d-kube-api-access-mbgqw\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:24.381290 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.381194 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" Jun 09 03:02:24.391197 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.391164 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-image-registry-private-configuration\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.391319 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.391216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-installation-pull-secrets\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.391319 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.391249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-certificates\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.391319 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.391296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.391474 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.391325 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-bound-sa-token\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.391474 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.391373 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-trusted-ca\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.391604 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.391578 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8kbl\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-kube-api-access-s8kbl\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.391655 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.391625 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-ca-trust-extracted\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.392040 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.392000 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-certificates\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.392040 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.392031 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 03:02:24.392179 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.392053 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd68b86df-xbhnh: secret "image-registry-tls" not found Jun 09 03:02:24.392179 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.392106 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls podName:b2d54eb5-8971-4303-b8f0-5426c00d6d4f nodeName:}" failed. No retries permitted until 2026-06-09 03:02:24.892088538 +0000 UTC m=+161.891094962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls") pod "image-registry-7fd68b86df-xbhnh" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f") : secret "image-registry-tls" not found Jun 09 03:02:24.392179 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.391998 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-ca-trust-extracted\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.392372 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.392354 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-trusted-ca\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.393128 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.393111 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7" Jun 09 03:02:24.393669 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.393644 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-image-registry-private-configuration\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.393942 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.393924 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-installation-pull-secrets\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.401075 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.401050 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-v2znj" Jun 09 03:02:24.401830 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.401813 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-bound-sa-token\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.402332 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.402309 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8kbl\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-kube-api-access-s8kbl\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.406349 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.406322 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" Jun 09 03:02:24.481768 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.481736 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx" Jun 09 03:02:24.517224 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.516920 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:24.554466 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.554429 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq"] Jun 09 03:02:24.571930 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.570826 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7"] Jun 09 03:02:24.578399 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:24.578323 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31d02dd_8dee_41a7_87cf_a5ef3442c56b.slice/crio-bf9bba4fcb08c5db545e5d80821bf8954fc6625ce229fa27228e7d91c62cd146 WatchSource:0}: Error finding container bf9bba4fcb08c5db545e5d80821bf8954fc6625ce229fa27228e7d91c62cd146: Status 404 returned error can't find the container with id bf9bba4fcb08c5db545e5d80821bf8954fc6625ce229fa27228e7d91c62cd146 Jun 09 03:02:24.649065 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.649043 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx"] Jun 09 03:02:24.651388 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:24.651361 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bacd0bf_14d9_48bb_bc75_d8da4a9c50bc.slice/crio-c99c1256835ef7a361aec0016fd6b6b073e9f27b1e62ec43f8cc61a95976029a WatchSource:0}: Error finding container c99c1256835ef7a361aec0016fd6b6b073e9f27b1e62ec43f8cc61a95976029a: Status 404 returned error can't find the container with id c99c1256835ef7a361aec0016fd6b6b073e9f27b1e62ec43f8cc61a95976029a Jun 09 03:02:24.674594 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.674563 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8w8qw"] Jun 09 03:02:24.677549 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:24.677523 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3580812_0e71_4a5a_a89c_54745684747b.slice/crio-bcc5743e6bda59dff8dc5f25841ffcc9b4b08b04d507f0bff5885237f6564948 WatchSource:0}: Error finding container bcc5743e6bda59dff8dc5f25841ffcc9b4b08b04d507f0bff5885237f6564948: Status 404 returned error can't find the container with id bcc5743e6bda59dff8dc5f25841ffcc9b4b08b04d507f0bff5885237f6564948 Jun 09 03:02:24.695199 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.695174 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:24.695336 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.695321 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 03:02:24.695393 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.695383 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert podName:21448262-f838-4bae-8fc6-4153bd0b03c7 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:25.695365708 +0000 UTC m=+162.694372136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-lqpxp" (UID: "21448262-f838-4bae-8fc6-4153bd0b03c7") : secret "networking-console-plugin-cert" not found Jun 09 03:02:24.793172 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.793141 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn"] Jun 09 03:02:24.795854 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.795662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:24.795854 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:24.795696 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f2f575_8396_47b7_a2d8_10193c494e6f.slice/crio-85157ee82afa0cd5803187a02307ffa84d4c3038c090a088217e78e238dbfc8e WatchSource:0}: Error finding container 85157ee82afa0cd5803187a02307ffa84d4c3038c090a088217e78e238dbfc8e: Status 404 returned error can't find the container with id 85157ee82afa0cd5803187a02307ffa84d4c3038c090a088217e78e238dbfc8e Jun 09 03:02:24.795854 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.795736 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:24.795854 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.795800 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:02:24.795854 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.795807 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:24.796194 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.795872 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 03:02:24.796194 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.795892 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 03:02:24.796194 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.795876 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls podName:a839c710-8579-45a6-adfa-ebb6eea7d32d nodeName:}" failed. No retries permitted until 2026-06-09 03:02:25.79585649 +0000 UTC m=+162.794862919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcglz" (UID: "a839c710-8579-45a6-adfa-ebb6eea7d32d") : secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:24.796194 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.795935 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls podName:e640c86c-5258-43e2-a070-6f2d06d76c63 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:25.795917357 +0000 UTC m=+162.794923780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-wvxvm" (UID: "e640c86c-5258-43e2-a070-6f2d06d76c63") : secret "samples-operator-tls" not found Jun 09 03:02:24.796194 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.795950 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls podName:6dad5db3-bce6-4f82-8696-9c8b7afe16a3 nodeName:}" failed. No retries permitted until 2026-06-09 03:04:26.795940558 +0000 UTC m=+283.794946981 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls") pod "dns-default-klhdv" (UID: "6dad5db3-bce6-4f82-8696-9c8b7afe16a3") : secret "dns-default-metrics-tls" not found Jun 09 03:02:24.796445 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.796224 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-v2znj"] Jun 09 03:02:24.799048 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:24.799027 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod441f01df_e470_46a7_b98b_e5a2b681f3fe.slice/crio-af2039e2def9cf232f3f8d52797f777f217faedf6fe463b042572e419444b402 WatchSource:0}: Error finding container af2039e2def9cf232f3f8d52797f777f217faedf6fe463b042572e419444b402: Status 404 returned error can't find the container with id af2039e2def9cf232f3f8d52797f777f217faedf6fe463b042572e419444b402 Jun 09 03:02:24.894439 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.894396 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx" event={"ID":"2bacd0bf-14d9-48bb-bc75-d8da4a9c50bc","Type":"ContainerStarted","Data":"de72ae66d8252e5d3888914c70d26ef9eb32716a56fb7706632effed9bf441a3"} Jun 09 03:02:24.894613 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.894463 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx" event={"ID":"2bacd0bf-14d9-48bb-bc75-d8da4a9c50bc","Type":"ContainerStarted","Data":"c99c1256835ef7a361aec0016fd6b6b073e9f27b1e62ec43f8cc61a95976029a"} Jun 09 03:02:24.895606 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.895565 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" event={"ID":"06f2f575-8396-47b7-a2d8-10193c494e6f","Type":"ContainerStarted","Data":"85157ee82afa0cd5803187a02307ffa84d4c3038c090a088217e78e238dbfc8e"} Jun 09 03:02:24.896130 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.896106 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:24.896277 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.896257 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 03:02:24.896277 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.896276 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd68b86df-xbhnh: secret "image-registry-tls" not found Jun 09 03:02:24.896452 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:24.896332 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls podName:b2d54eb5-8971-4303-b8f0-5426c00d6d4f nodeName:}" failed. No retries permitted until 2026-06-09 03:02:25.896311769 +0000 UTC m=+162.895318198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls") pod "image-registry-7fd68b86df-xbhnh" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f") : secret "image-registry-tls" not found Jun 09 03:02:24.896648 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.896627 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" event={"ID":"e3580812-0e71-4a5a-a89c-54745684747b","Type":"ContainerStarted","Data":"bcc5743e6bda59dff8dc5f25841ffcc9b4b08b04d507f0bff5885237f6564948"} Jun 09 03:02:24.897943 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.897920 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-v2znj" event={"ID":"441f01df-e470-46a7-b98b-e5a2b681f3fe","Type":"ContainerStarted","Data":"af2039e2def9cf232f3f8d52797f777f217faedf6fe463b042572e419444b402"} Jun 09 03:02:24.899019 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.898934 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7" event={"ID":"b31d02dd-8dee-41a7-87cf-a5ef3442c56b","Type":"ContainerStarted","Data":"bf9bba4fcb08c5db545e5d80821bf8954fc6625ce229fa27228e7d91c62cd146"} Jun 09 03:02:24.899989 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.899971 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" event={"ID":"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63","Type":"ContainerStarted","Data":"dad59689c07dc0d1e0d30914d1a26eb679958134c49d6aa8b8d119c54d1a98cf"} Jun 09 03:02:24.908187 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:24.908148 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-r2mfx" podStartSLOduration=0.908135831 podStartE2EDuration="908.135831ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:24.907321522 +0000 UTC m=+161.906327967" watchObservedRunningTime="2026-06-09 03:02:24.908135831 +0000 UTC m=+161.907142255" Jun 09 03:02:25.303865 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:25.303830 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:25.704265 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:25.703653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:25.704265 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:25.703845 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 03:02:25.704265 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:25.703915 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert podName:21448262-f838-4bae-8fc6-4153bd0b03c7 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:27.703895108 +0000 UTC m=+164.702901531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-lqpxp" (UID: "21448262-f838-4bae-8fc6-4153bd0b03c7") : secret "networking-console-plugin-cert" not found Jun 09 03:02:25.804566 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:25.804526 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:25.804756 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:25.804617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:25.804827 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:25.804808 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 03:02:25.804886 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:25.804869 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls podName:e640c86c-5258-43e2-a070-6f2d06d76c63 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:27.804850572 +0000 UTC m=+164.803857000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-wvxvm" (UID: "e640c86c-5258-43e2-a070-6f2d06d76c63") : secret "samples-operator-tls" not found Jun 09 03:02:25.805281 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:25.805260 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:25.805377 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:25.805318 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls podName:a839c710-8579-45a6-adfa-ebb6eea7d32d nodeName:}" failed. No retries permitted until 2026-06-09 03:02:27.805302467 +0000 UTC m=+164.804308896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcglz" (UID: "a839c710-8579-45a6-adfa-ebb6eea7d32d") : secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:25.905776 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:25.905639 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:25.905776 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:25.905744 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 03:02:25.905776 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:25.905761 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd68b86df-xbhnh: secret "image-registry-tls" not found Jun 09 03:02:25.906054 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:25.905813 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls podName:b2d54eb5-8971-4303-b8f0-5426c00d6d4f nodeName:}" failed. No retries permitted until 2026-06-09 03:02:27.905797239 +0000 UTC m=+164.904803666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls") pod "image-registry-7fd68b86df-xbhnh" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f") : secret "image-registry-tls" not found Jun 09 03:02:26.908773 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:26.908731 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7" event={"ID":"b31d02dd-8dee-41a7-87cf-a5ef3442c56b","Type":"ContainerStarted","Data":"b89170e664f2ca1467aacdcc64aff9ff34c72edf5e0ac14e6f2c71382209a4a6"} Jun 09 03:02:26.924908 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:26.924841 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-k9zd7" podStartSLOduration=1.3146953749999999 podStartE2EDuration="2.924821093s" totalImagesPullingTime="1.610125718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:26.922642667 +0000 UTC m=+163.921649114" watchObservedRunningTime="2026-06-09 03:02:26.924821093 +0000 UTC m=+163.923827538" Jun 09 03:02:26.989040 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:26.988999 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:27.721851 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:27.721809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:27.722049 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:27.721992 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 03:02:27.722117 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:27.722073 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert podName:21448262-f838-4bae-8fc6-4153bd0b03c7 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:31.722050899 +0000 UTC m=+168.721057324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-lqpxp" (UID: "21448262-f838-4bae-8fc6-4153bd0b03c7") : secret "networking-console-plugin-cert" not found Jun 09 03:02:27.822717 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:27.822678 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:27.822921 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:27.822802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:27.822921 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:27.822858 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 03:02:27.822921 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:27.822908 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:27.823058 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:27.822937 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls podName:e640c86c-5258-43e2-a070-6f2d06d76c63 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:31.822917363 +0000 UTC m=+168.821923786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-wvxvm" (UID: "e640c86c-5258-43e2-a070-6f2d06d76c63") : secret "samples-operator-tls" not found Jun 09 03:02:27.823058 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:27.822956 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls podName:a839c710-8579-45a6-adfa-ebb6eea7d32d nodeName:}" failed. No retries permitted until 2026-06-09 03:02:31.822947232 +0000 UTC m=+168.821953663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcglz" (UID: "a839c710-8579-45a6-adfa-ebb6eea7d32d") : secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:27.923714 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:27.923671 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:27.924188 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:27.923833 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 03:02:27.924188 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:27.923852 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd68b86df-xbhnh: secret "image-registry-tls" not found Jun 09 03:02:27.924188 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:27.923915 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls podName:b2d54eb5-8971-4303-b8f0-5426c00d6d4f nodeName:}" failed. No retries permitted until 2026-06-09 03:02:31.923894548 +0000 UTC m=+168.922900974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls") pod "image-registry-7fd68b86df-xbhnh" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f") : secret "image-registry-tls" not found Jun 09 03:02:28.918071 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:28.918019 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" event={"ID":"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63","Type":"ContainerStarted","Data":"1077fa3a498070f54f4da902dc5ee2b5ac445115e5b4a8ba04d2929870c41b87"} Jun 09 03:02:28.919761 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:28.919708 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" event={"ID":"06f2f575-8396-47b7-a2d8-10193c494e6f","Type":"ContainerStarted","Data":"9ce2fa30a5b0917fb1c2440617e8c8d26d2df2187fc142ac7e7c520d72744366"} Jun 09 03:02:28.921415 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:28.921394 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/0.log" Jun 09 03:02:28.921539 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:28.921438 2568 generic.go:356] "Generic (PLEG): container finished" podID="e3580812-0e71-4a5a-a89c-54745684747b" containerID="d3e9998dbdef25f0370fcbef69df84b39189c917bcc425a26a0e91d5987ee4ff" exitCode=255 Jun 09 03:02:28.921607 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:28.921529 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" event={"ID":"e3580812-0e71-4a5a-a89c-54745684747b","Type":"ContainerDied","Data":"d3e9998dbdef25f0370fcbef69df84b39189c917bcc425a26a0e91d5987ee4ff"} Jun 09 03:02:28.921856 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:28.921678 2568 scope.go:117] "RemoveContainer" containerID="d3e9998dbdef25f0370fcbef69df84b39189c917bcc425a26a0e91d5987ee4ff" Jun 09 03:02:28.923421 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:28.923398 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-v2znj" event={"ID":"441f01df-e470-46a7-b98b-e5a2b681f3fe","Type":"ContainerStarted","Data":"91923f4551ef7026e2eca64b6d2199cb7170631bf7a946b3c4487e4c29afc4f2"} Jun 09 03:02:28.933290 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:28.933147 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" podStartSLOduration=1.002878849 podStartE2EDuration="4.933129568s" totalImagesPullingTime="3.930250719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:28.932451311 +0000 UTC m=+165.931457771" watchObservedRunningTime="2026-06-09 03:02:28.933129568 +0000 UTC m=+165.932136014" Jun 09 03:02:28.948219 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:28.948158 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-v2znj" podStartSLOduration=1.234035155 podStartE2EDuration="4.948135579s" totalImagesPullingTime="3.714100424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:28.946891127 +0000 UTC m=+165.945897573" watchObservedRunningTime="2026-06-09 03:02:28.948135579 +0000 UTC m=+165.947142024" Jun 09 03:02:28.965720 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:28.965631 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" podStartSLOduration=1.250088475 podStartE2EDuration="4.965609051s" totalImagesPullingTime="3.715520576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:28.964409815 +0000 UTC m=+165.963416259" watchObservedRunningTime="2026-06-09 03:02:28.965609051 +0000 UTC m=+165.964615497" Jun 09 03:02:29.818577 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.818522 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:29.868363 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.868329 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:29.927723 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.927699 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/1.log" Jun 09 03:02:29.928147 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.928127 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/0.log" Jun 09 03:02:29.928318 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.928168 2568 generic.go:356] "Generic (PLEG): container finished" podID="e3580812-0e71-4a5a-a89c-54745684747b" containerID="385753433e71217045d6e2169a1044fe396ff80bcff87d23f7271971a4092659" exitCode=255 Jun 09 03:02:29.928318 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.928271 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" event={"ID":"e3580812-0e71-4a5a-a89c-54745684747b","Type":"ContainerDied","Data":"385753433e71217045d6e2169a1044fe396ff80bcff87d23f7271971a4092659"} Jun 09 03:02:29.928462 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.928325 2568 scope.go:117] "RemoveContainer" containerID="d3e9998dbdef25f0370fcbef69df84b39189c917bcc425a26a0e91d5987ee4ff" Jun 09 03:02:29.928875 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.928583 2568 scope.go:117] "RemoveContainer" containerID="385753433e71217045d6e2169a1044fe396ff80bcff87d23f7271971a4092659" Jun 09 03:02:29.928875 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:29.928785 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8w8qw_openshift-console-operator(e3580812-0e71-4a5a-a89c-54745684747b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" podUID="e3580812-0e71-4a5a-a89c-54745684747b" Jun 09 03:02:29.985159 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.985122 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:29.985666 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.985541 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns"] Jun 09 03:02:29.990360 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.990336 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns" Jun 09 03:02:29.992833 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.992809 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 03:02:29.992954 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.992896 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 03:02:29.993020 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.992901 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xcstm\"" Jun 09 03:02:29.997615 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:29.997397 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns"] Jun 09 03:02:30.040294 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.040260 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:30.045027 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.044995 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtczd\" (UniqueName: \"kubernetes.io/projected/93aadb40-03a5-479a-bc7d-145a5a9bd54e-kube-api-access-rtczd\") pod \"migrator-955ffdf5f-rshns\" (UID: \"93aadb40-03a5-479a-bc7d-145a5a9bd54e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns" Jun 09 03:02:30.141215 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.141139 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:30.146320 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.146282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtczd\" (UniqueName: \"kubernetes.io/projected/93aadb40-03a5-479a-bc7d-145a5a9bd54e-kube-api-access-rtczd\") pod \"migrator-955ffdf5f-rshns\" (UID: \"93aadb40-03a5-479a-bc7d-145a5a9bd54e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns" Jun 09 03:02:30.153707 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.153677 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtczd\" (UniqueName: \"kubernetes.io/projected/93aadb40-03a5-479a-bc7d-145a5a9bd54e-kube-api-access-rtczd\") pod \"migrator-955ffdf5f-rshns\" (UID: \"93aadb40-03a5-479a-bc7d-145a5a9bd54e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns" Jun 09 03:02:30.242602 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.242571 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:30.300931 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.300889 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns" Jun 09 03:02:30.426807 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.426785 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns"] Jun 09 03:02:30.429279 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:30.429247 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93aadb40_03a5_479a_bc7d_145a5a9bd54e.slice/crio-593d0085d5487dc26484a5dbbb61b12d0e7214c3d1c28c5c397ffaa605d269d9 WatchSource:0}: Error finding container 593d0085d5487dc26484a5dbbb61b12d0e7214c3d1c28c5c397ffaa605d269d9: Status 404 returned error can't find the container with id 593d0085d5487dc26484a5dbbb61b12d0e7214c3d1c28c5c397ffaa605d269d9 Jun 09 03:02:30.622282 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.622246 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:30.900855 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.900770 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:30.933826 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.933797 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/1.log" Jun 09 03:02:30.934281 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.934259 2568 scope.go:117] "RemoveContainer" containerID="385753433e71217045d6e2169a1044fe396ff80bcff87d23f7271971a4092659" Jun 09 03:02:30.934517 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:30.934472 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8w8qw_openshift-console-operator(e3580812-0e71-4a5a-a89c-54745684747b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" podUID="e3580812-0e71-4a5a-a89c-54745684747b" Jun 09 03:02:30.935287 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.935262 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns" event={"ID":"93aadb40-03a5-479a-bc7d-145a5a9bd54e","Type":"ContainerStarted","Data":"593d0085d5487dc26484a5dbbb61b12d0e7214c3d1c28c5c397ffaa605d269d9"} Jun 09 03:02:30.952086 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:30.952059 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:31.729570 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:31.729539 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jnj47_fd66dde4-da1d-49c1-b791-dca66777bd71/dns-node-resolver/0.log" Jun 09 03:02:31.761682 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:31.761646 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:31.761882 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:31.761815 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 03:02:31.761933 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:31.761888 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert podName:21448262-f838-4bae-8fc6-4153bd0b03c7 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:39.761865246 +0000 UTC m=+176.760871672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-lqpxp" (UID: "21448262-f838-4bae-8fc6-4153bd0b03c7") : secret "networking-console-plugin-cert" not found Jun 09 03:02:31.862680 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:31.862655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:31.862793 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:31.862712 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:31.862849 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:31.862800 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 03:02:31.862849 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:31.862801 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:31.862931 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:31.862871 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls podName:e640c86c-5258-43e2-a070-6f2d06d76c63 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:39.862851421 +0000 UTC m=+176.861857865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-wvxvm" (UID: "e640c86c-5258-43e2-a070-6f2d06d76c63") : secret "samples-operator-tls" not found Jun 09 03:02:31.862931 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:31.862887 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls podName:a839c710-8579-45a6-adfa-ebb6eea7d32d nodeName:}" failed. No retries permitted until 2026-06-09 03:02:39.862880201 +0000 UTC m=+176.861886630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcglz" (UID: "a839c710-8579-45a6-adfa-ebb6eea7d32d") : secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:31.940152 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:31.940121 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns" event={"ID":"93aadb40-03a5-479a-bc7d-145a5a9bd54e","Type":"ContainerStarted","Data":"5d0162e8f27ba65ab986a4aa7404df70b1b42d917ac87ac24b8ee8aefbaa99f6"} Jun 09 03:02:31.963088 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:31.963069 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:31.963224 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:31.963205 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 03:02:31.963224 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:31.963223 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fd68b86df-xbhnh: secret "image-registry-tls" not found Jun 09 03:02:31.963364 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:31.963277 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls podName:b2d54eb5-8971-4303-b8f0-5426c00d6d4f nodeName:}" failed. No retries permitted until 2026-06-09 03:02:39.963259287 +0000 UTC m=+176.962265713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls") pod "image-registry-7fd68b86df-xbhnh" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f") : secret "image-registry-tls" not found Jun 09 03:02:32.410452 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:32.410414 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:02:32.529563 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:32.529530 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5vd6f_f00933df-8470-4be5-8679-54ba6a748b3d/node-ca/0.log" Jun 09 03:02:32.544365 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:32.544321 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:32.593931 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:32.593900 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:32.949343 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:32.949311 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns" event={"ID":"93aadb40-03a5-479a-bc7d-145a5a9bd54e","Type":"ContainerStarted","Data":"13558acac397077534e6b696ae6ea3f2421b3f974600a2b310490a425f73a390"} Jun 09 03:02:32.963810 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:32.963762 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rshns" podStartSLOduration=2.543578664 podStartE2EDuration="3.963746522s" totalImagesPullingTime="1.420167858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:32.96290319 +0000 UTC m=+169.961909635" watchObservedRunningTime="2026-06-09 03:02:32.963746522 +0000 UTC m=+169.962752994" Jun 09 03:02:33.028092 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:33.028055 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:33.129156 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:33.129106 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:33.329478 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:33.329402 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnc8q_4120ed8e-5060-458f-b402-5aa161b47996/serve-healthcheck-canary/0.log" Jun 09 03:02:33.484651 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:33.484598 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:34.518117 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:34.518077 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:34.518548 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:34.518135 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:34.518548 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:34.518487 2568 scope.go:117] "RemoveContainer" containerID="385753433e71217045d6e2169a1044fe396ff80bcff87d23f7271971a4092659" Jun 09 03:02:34.518714 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:34.518692 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8w8qw_openshift-console-operator(e3580812-0e71-4a5a-a89c-54745684747b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" podUID="e3580812-0e71-4a5a-a89c-54745684747b" Jun 09 03:02:36.018643 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:36.018609 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:36.112152 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:36.112120 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:36.173446 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:36.173406 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:36.228199 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:36.228170 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:36.289384 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:36.289304 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:36.391211 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:36.391181 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:36.474341 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:36.474310 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:36.728383 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:36.728352 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:37.722800 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:37.722769 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:38.117937 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:38.117851 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:38.316251 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:38.316214 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:38.515681 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:38.515646 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:38.920349 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:38.920318 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:39.450747 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:39.450677 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:39.551438 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:39.551403 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:39.826091 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:39.825994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:39.826245 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:39.826123 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 03:02:39.826245 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:39.826190 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert podName:21448262-f838-4bae-8fc6-4153bd0b03c7 nodeName:}" failed. No retries permitted until 2026-06-09 03:02:55.826171305 +0000 UTC m=+192.825177728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-lqpxp" (UID: "21448262-f838-4bae-8fc6-4153bd0b03c7") : secret "networking-console-plugin-cert" not found Jun 09 03:02:39.918526 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:39.918473 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:39.926605 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:39.926577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:39.926913 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:39.926637 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:39.926913 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:39.926720 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:39.926913 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:39.926776 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls podName:a839c710-8579-45a6-adfa-ebb6eea7d32d nodeName:}" failed. No retries permitted until 2026-06-09 03:02:55.926760459 +0000 UTC m=+192.925766882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fcglz" (UID: "a839c710-8579-45a6-adfa-ebb6eea7d32d") : secret "cluster-monitoring-operator-tls" not found Jun 09 03:02:39.929026 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:39.929005 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e640c86c-5258-43e2-a070-6f2d06d76c63-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wvxvm\" (UID: \"e640c86c-5258-43e2-a070-6f2d06d76c63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:40.014817 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.014780 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:40.027943 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.027912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:40.030255 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.030222 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls\") pod \"image-registry-7fd68b86df-xbhnh\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:40.104868 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.104776 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" Jun 09 03:02:40.115249 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.115224 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:40.187870 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.187841 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:40.237199 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.237167 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm"] Jun 09 03:02:40.317200 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.317163 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:40.328201 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.328097 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd68b86df-xbhnh"] Jun 09 03:02:40.330487 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:40.330454 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d54eb5_8971_4303_b8f0_5426c00d6d4f.slice/crio-c3407d4074eb918d7b27b64514f617fbc1ae7d60b5248c8823a65ba286a93877 WatchSource:0}: Error finding container c3407d4074eb918d7b27b64514f617fbc1ae7d60b5248c8823a65ba286a93877: Status 404 returned error can't find the container with id c3407d4074eb918d7b27b64514f617fbc1ae7d60b5248c8823a65ba286a93877 Jun 09 03:02:40.575252 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.575218 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:40.713184 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.713126 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:40.912812 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.912775 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:40.975321 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.975216 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" event={"ID":"b2d54eb5-8971-4303-b8f0-5426c00d6d4f","Type":"ContainerStarted","Data":"11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6"} Jun 09 03:02:40.975321 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.975274 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" event={"ID":"b2d54eb5-8971-4303-b8f0-5426c00d6d4f","Type":"ContainerStarted","Data":"c3407d4074eb918d7b27b64514f617fbc1ae7d60b5248c8823a65ba286a93877"} Jun 09 03:02:40.975321 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.975305 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:02:40.976328 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.976308 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" event={"ID":"e640c86c-5258-43e2-a070-6f2d06d76c63","Type":"ContainerStarted","Data":"1d76c85e6f33e50a011c5dd89a215cbdfba9f621af2cb1457af703a261764ef6"} Jun 09 03:02:40.993607 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:40.993544 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" podStartSLOduration=16.993527796 podStartE2EDuration="16.993527796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:40.991701962 +0000 UTC m=+177.990708411" watchObservedRunningTime="2026-06-09 03:02:40.993527796 +0000 UTC m=+177.992534243" Jun 09 03:02:41.119820 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:41.119780 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:42.120928 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:42.120893 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:42.515299 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:42.515256 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:42.645121 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:42.645086 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:42.717092 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:42.717063 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:42.840331 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:42.840239 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:42.942903 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:42.942874 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:43.118338 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:43.118249 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:43.986974 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:43.986936 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" event={"ID":"e640c86c-5258-43e2-a070-6f2d06d76c63","Type":"ContainerStarted","Data":"5e911b50c4292000406f4734c85a19debe2b562a91f620533137a4a08ae07a36"} Jun 09 03:02:43.987349 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:43.986994 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" event={"ID":"e640c86c-5258-43e2-a070-6f2d06d76c63","Type":"ContainerStarted","Data":"b86fab55b27046b89536912d2ade64d0c1842dac5ca99a6fe8075884b42bb3ea"} Jun 09 03:02:44.002902 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:44.002852 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wvxvm" podStartSLOduration=17.127996604 podStartE2EDuration="20.002837612s" totalImagesPullingTime="2.874841008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:44.001669026 +0000 UTC m=+181.000675471" watchObservedRunningTime="2026-06-09 03:02:44.002837612 +0000 UTC m=+181.001844088" Jun 09 03:02:44.317827 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:44.317745 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:44.512983 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:44.512930 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:44.714165 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:44.714133 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:44.912293 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:44.912259 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:45.117883 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:45.117803 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:46.113068 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:46.113040 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:46.314420 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:46.314390 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:46.512473 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:46.512428 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:46.715597 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:46.715560 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:49.818070 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:49.818036 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:49.867701 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:49.867664 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:50.410818 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:50.410775 2568 scope.go:117] "RemoveContainer" containerID="385753433e71217045d6e2169a1044fe396ff80bcff87d23f7271971a4092659" Jun 09 03:02:51.012686 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:51.012656 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:02:51.013108 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:51.013093 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/1.log" Jun 09 03:02:51.013155 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:51.013127 2568 generic.go:356] "Generic (PLEG): container finished" podID="e3580812-0e71-4a5a-a89c-54745684747b" containerID="c980c088c27aa2e021f6740c7e2312ebf0eea416f4b07388d5d54cdc4928756e" exitCode=255 Jun 09 03:02:51.013200 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:51.013176 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" event={"ID":"e3580812-0e71-4a5a-a89c-54745684747b","Type":"ContainerDied","Data":"c980c088c27aa2e021f6740c7e2312ebf0eea416f4b07388d5d54cdc4928756e"} Jun 09 03:02:51.013248 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:51.013223 2568 scope.go:117] "RemoveContainer" containerID="385753433e71217045d6e2169a1044fe396ff80bcff87d23f7271971a4092659" Jun 09 03:02:51.013559 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:51.013532 2568 scope.go:117] "RemoveContainer" containerID="c980c088c27aa2e021f6740c7e2312ebf0eea416f4b07388d5d54cdc4928756e" Jun 09 03:02:51.013758 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:51.013739 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-8w8qw_openshift-console-operator(e3580812-0e71-4a5a-a89c-54745684747b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" podUID="e3580812-0e71-4a5a-a89c-54745684747b" Jun 09 03:02:52.017766 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:52.017739 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:02:53.526895 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.526862 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hl4dx"] Jun 09 03:02:53.530027 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.530004 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.531606 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.531578 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fd68b86df-xbhnh"] Jun 09 03:02:53.532508 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.532471 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 03:02:53.532812 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.532793 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k87k5\"" Jun 09 03:02:53.532919 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.532880 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 03:02:53.542716 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.542692 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hl4dx"] Jun 09 03:02:53.562215 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.562184 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-844d889dc8-jn44p"] Jun 09 03:02:53.565473 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.565452 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.578859 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.578835 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844d889dc8-jn44p"] Jun 09 03:02:53.600897 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.600870 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:53.644398 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644359 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32d9bd51-7a3b-41b4-9986-1d98bd901296-data-volume\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.644627 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644404 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-868mm\" (UniqueName: \"kubernetes.io/projected/97a80e2c-170f-4125-81d5-8b0c2442c9af-kube-api-access-868mm\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.644627 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644438 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97a80e2c-170f-4125-81d5-8b0c2442c9af-bound-sa-token\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.644627 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32d9bd51-7a3b-41b4-9986-1d98bd901296-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.644627 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644535 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97a80e2c-170f-4125-81d5-8b0c2442c9af-ca-trust-extracted\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.644627 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97a80e2c-170f-4125-81d5-8b0c2442c9af-registry-tls\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.644627 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644612 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32d9bd51-7a3b-41b4-9986-1d98bd901296-crio-socket\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.644848 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644697 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97a80e2c-170f-4125-81d5-8b0c2442c9af-installation-pull-secrets\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.644848 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644724 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32d9bd51-7a3b-41b4-9986-1d98bd901296-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.644848 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644750 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpxkb\" (UniqueName: \"kubernetes.io/projected/32d9bd51-7a3b-41b4-9986-1d98bd901296-kube-api-access-mpxkb\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.644848 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97a80e2c-170f-4125-81d5-8b0c2442c9af-image-registry-private-configuration\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.644848 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644823 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97a80e2c-170f-4125-81d5-8b0c2442c9af-registry-certificates\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.644848 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.644847 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97a80e2c-170f-4125-81d5-8b0c2442c9af-trusted-ca\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.700048 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.700016 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:53.745590 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.745555 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpxkb\" (UniqueName: \"kubernetes.io/projected/32d9bd51-7a3b-41b4-9986-1d98bd901296-kube-api-access-mpxkb\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.745759 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.745597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97a80e2c-170f-4125-81d5-8b0c2442c9af-image-registry-private-configuration\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.745759 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.745624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97a80e2c-170f-4125-81d5-8b0c2442c9af-registry-certificates\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.745759 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.745641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97a80e2c-170f-4125-81d5-8b0c2442c9af-trusted-ca\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.745759 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.745683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32d9bd51-7a3b-41b4-9986-1d98bd901296-data-volume\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.745759 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.745704 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-868mm\" (UniqueName: \"kubernetes.io/projected/97a80e2c-170f-4125-81d5-8b0c2442c9af-kube-api-access-868mm\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.745759 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.745726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97a80e2c-170f-4125-81d5-8b0c2442c9af-bound-sa-token\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.745759 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.745753 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32d9bd51-7a3b-41b4-9986-1d98bd901296-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.746097 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.745788 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97a80e2c-170f-4125-81d5-8b0c2442c9af-ca-trust-extracted\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.746097 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.745970 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97a80e2c-170f-4125-81d5-8b0c2442c9af-registry-tls\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.746097 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.746045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32d9bd51-7a3b-41b4-9986-1d98bd901296-crio-socket\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.746239 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.746105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97a80e2c-170f-4125-81d5-8b0c2442c9af-installation-pull-secrets\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.746239 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.746123 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32d9bd51-7a3b-41b4-9986-1d98bd901296-data-volume\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.746239 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.746136 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32d9bd51-7a3b-41b4-9986-1d98bd901296-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.746239 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.746199 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32d9bd51-7a3b-41b4-9986-1d98bd901296-crio-socket\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.746435 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.746419 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32d9bd51-7a3b-41b4-9986-1d98bd901296-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.746666 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.746644 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97a80e2c-170f-4125-81d5-8b0c2442c9af-registry-certificates\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.746756 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.746701 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97a80e2c-170f-4125-81d5-8b0c2442c9af-trusted-ca\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.746999 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.746975 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97a80e2c-170f-4125-81d5-8b0c2442c9af-ca-trust-extracted\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.748702 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.748667 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97a80e2c-170f-4125-81d5-8b0c2442c9af-image-registry-private-configuration\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.748702 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.748685 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32d9bd51-7a3b-41b4-9986-1d98bd901296-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.748879 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.748861 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97a80e2c-170f-4125-81d5-8b0c2442c9af-installation-pull-secrets\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.748958 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.748941 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97a80e2c-170f-4125-81d5-8b0c2442c9af-registry-tls\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.753771 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.753748 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpxkb\" (UniqueName: \"kubernetes.io/projected/32d9bd51-7a3b-41b4-9986-1d98bd901296-kube-api-access-mpxkb\") pod \"insights-runtime-extractor-hl4dx\" (UID: \"32d9bd51-7a3b-41b4-9986-1d98bd901296\") " pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.754873 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.754853 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-868mm\" (UniqueName: \"kubernetes.io/projected/97a80e2c-170f-4125-81d5-8b0c2442c9af-kube-api-access-868mm\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.755120 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.755105 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97a80e2c-170f-4125-81d5-8b0c2442c9af-bound-sa-token\") pod \"image-registry-844d889dc8-jn44p\" (UID: \"97a80e2c-170f-4125-81d5-8b0c2442c9af\") " pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.840553 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.840440 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hl4dx" Jun 09 03:02:53.875075 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.875041 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:53.977113 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:53.977076 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hl4dx"] Jun 09 03:02:53.980785 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:53.980753 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d9bd51_7a3b_41b4_9986_1d98bd901296.slice/crio-9716f749884c2e79b2190a7c5cb48ef2f8ffa00f3d12d06d1fbcfd7c1e58ae82 WatchSource:0}: Error finding container 9716f749884c2e79b2190a7c5cb48ef2f8ffa00f3d12d06d1fbcfd7c1e58ae82: Status 404 returned error can't find the container with id 9716f749884c2e79b2190a7c5cb48ef2f8ffa00f3d12d06d1fbcfd7c1e58ae82 Jun 09 03:02:54.008828 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:54.008764 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844d889dc8-jn44p"] Jun 09 03:02:54.013610 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:54.013580 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a80e2c_170f_4125_81d5_8b0c2442c9af.slice/crio-49870d6bdf2c316611cede38ea498c59bd20d7f68051ada5451c51178857fccd WatchSource:0}: Error finding container 49870d6bdf2c316611cede38ea498c59bd20d7f68051ada5451c51178857fccd: Status 404 returned error can't find the container with id 49870d6bdf2c316611cede38ea498c59bd20d7f68051ada5451c51178857fccd Jun 09 03:02:54.026790 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:54.026765 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl4dx" event={"ID":"32d9bd51-7a3b-41b4-9986-1d98bd901296","Type":"ContainerStarted","Data":"9716f749884c2e79b2190a7c5cb48ef2f8ffa00f3d12d06d1fbcfd7c1e58ae82"} Jun 09 03:02:54.027771 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:54.027741 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" event={"ID":"97a80e2c-170f-4125-81d5-8b0c2442c9af","Type":"ContainerStarted","Data":"49870d6bdf2c316611cede38ea498c59bd20d7f68051ada5451c51178857fccd"} Jun 09 03:02:54.517966 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:54.517929 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:54.518161 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:54.518006 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:02:54.518341 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:54.518305 2568 scope.go:117] "RemoveContainer" containerID="c980c088c27aa2e021f6740c7e2312ebf0eea416f4b07388d5d54cdc4928756e" Jun 09 03:02:54.518518 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:02:54.518478 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-8w8qw_openshift-console-operator(e3580812-0e71-4a5a-a89c-54745684747b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" podUID="e3580812-0e71-4a5a-a89c-54745684747b" Jun 09 03:02:55.032238 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.032195 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" event={"ID":"97a80e2c-170f-4125-81d5-8b0c2442c9af","Type":"ContainerStarted","Data":"9cdf2bb47e8d04d20747fba9470e98bbeb8bd7d57e3c10a148472ed580841e90"} Jun 09 03:02:55.032702 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.032273 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:02:55.034053 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.034031 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl4dx" event={"ID":"32d9bd51-7a3b-41b4-9986-1d98bd901296","Type":"ContainerStarted","Data":"9d49d55b850b2898acf2d2bbbf60fa2e24bb30ac91ecb57522da98e24a6a488f"} Jun 09 03:02:55.034157 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.034078 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl4dx" event={"ID":"32d9bd51-7a3b-41b4-9986-1d98bd901296","Type":"ContainerStarted","Data":"ed8982aabde6c6734d33fdbeeaa011c72e00fe495818b60abee01641e8844c35"} Jun 09 03:02:55.049613 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.049568 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" podStartSLOduration=2.049553089 podStartE2EDuration="2.049553089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:55.049354492 +0000 UTC m=+192.048360939" watchObservedRunningTime="2026-06-09 03:02:55.049553089 +0000 UTC m=+192.048559533" Jun 09 03:02:55.864883 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.864843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:55.867554 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.867528 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21448262-f838-4bae-8fc6-4153bd0b03c7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-lqpxp\" (UID: \"21448262-f838-4bae-8fc6-4153bd0b03c7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:55.890355 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.890321 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xhkx4\"" Jun 09 03:02:55.898316 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.898278 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" Jun 09 03:02:55.965426 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.965384 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:55.967895 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.967866 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a839c710-8579-45a6-adfa-ebb6eea7d32d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fcglz\" (UID: \"a839c710-8579-45a6-adfa-ebb6eea7d32d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:55.994026 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:55.993989 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hxk2s\"" Jun 09 03:02:56.002237 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:56.002199 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" Jun 09 03:02:56.447552 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:56.447482 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp"] Jun 09 03:02:56.451988 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:56.451961 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21448262_f838_4bae_8fc6_4153bd0b03c7.slice/crio-caaf33ab3ba63cdcb385abc436a0c70d40b2edf023885d883164ae38fc1d48e3 WatchSource:0}: Error finding container caaf33ab3ba63cdcb385abc436a0c70d40b2edf023885d883164ae38fc1d48e3: Status 404 returned error can't find the container with id caaf33ab3ba63cdcb385abc436a0c70d40b2edf023885d883164ae38fc1d48e3 Jun 09 03:02:56.465353 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:56.465318 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz"] Jun 09 03:02:56.467275 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:02:56.467245 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda839c710_8579_45a6_adfa_ebb6eea7d32d.slice/crio-a211a3810c9a390a07077ed73d0468629b92d9ee044fc6845f9a83c501337dd4 WatchSource:0}: Error finding container a211a3810c9a390a07077ed73d0468629b92d9ee044fc6845f9a83c501337dd4: Status 404 returned error can't find the container with id a211a3810c9a390a07077ed73d0468629b92d9ee044fc6845f9a83c501337dd4 Jun 09 03:02:57.043148 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:57.043112 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl4dx" event={"ID":"32d9bd51-7a3b-41b4-9986-1d98bd901296","Type":"ContainerStarted","Data":"4e2350b1cca1b562563707f56636edf2e4b8cc3907fe7db7fc127abf5d61787d"} Jun 09 03:02:57.044283 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:57.044259 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" event={"ID":"a839c710-8579-45a6-adfa-ebb6eea7d32d","Type":"ContainerStarted","Data":"a211a3810c9a390a07077ed73d0468629b92d9ee044fc6845f9a83c501337dd4"} Jun 09 03:02:57.045287 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:57.045264 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" event={"ID":"21448262-f838-4bae-8fc6-4153bd0b03c7","Type":"ContainerStarted","Data":"caaf33ab3ba63cdcb385abc436a0c70d40b2edf023885d883164ae38fc1d48e3"} Jun 09 03:02:57.060250 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:57.060198 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hl4dx" podStartSLOduration=1.784252701 podStartE2EDuration="4.060183635s" totalImagesPullingTime="2.275930934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 03:02:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:57.058431909 +0000 UTC m=+194.057438357" watchObservedRunningTime="2026-06-09 03:02:57.060183635 +0000 UTC m=+194.059190082" Jun 09 03:02:57.085257 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:57.085229 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:58.051762 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:58.051669 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" event={"ID":"21448262-f838-4bae-8fc6-4153bd0b03c7","Type":"ContainerStarted","Data":"1bcc078fe6d0fcae23740b530143ca3e49d9e0da22849819b4667faff27f3320"} Jun 09 03:02:58.067105 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:58.067054 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-lqpxp" podStartSLOduration=32.789425775 podStartE2EDuration="34.067038509s" totalImagesPullingTime="1.277612734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:58.065526624 +0000 UTC m=+195.064533067" watchObservedRunningTime="2026-06-09 03:02:58.067038509 +0000 UTC m=+195.066044988" Jun 09 03:02:58.148925 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:58.148876 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:58.249461 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:58.249418 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:58.763849 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:58.763763 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:58.864805 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:58.864774 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:58.927416 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:58.927376 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:02:59.057541 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:59.057427 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" event={"ID":"a839c710-8579-45a6-adfa-ebb6eea7d32d","Type":"ContainerStarted","Data":"34a5756fd99b8dd5f163010268c5d9163c9d77ce98fb5ca9fc5ec7211f72f2a8"} Jun 09 03:02:59.073795 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:59.073740 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fcglz" podStartSLOduration=33.102811893 podStartE2EDuration="35.073723097s" totalImagesPullingTime="1.970911204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:02:59.071884479 +0000 UTC m=+196.070890936" watchObservedRunningTime="2026-06-09 03:02:59.073723097 +0000 UTC m=+196.072729541" Jun 09 03:02:59.353056 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:02:59.352959 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:02.944689 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:02.944653 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:02.973130 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:02.973093 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xglkm"] Jun 09 03:03:02.977952 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:02.977934 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:02.980625 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:02.980601 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 03:03:02.980770 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:02.980638 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 03:03:02.981742 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:02.981724 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 03:03:02.982051 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:02.982036 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lsgnb\"" Jun 09 03:03:02.986609 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:02.986588 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xglkm"] Jun 09 03:03:02.998865 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:02.998837 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:03.126400 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.126358 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2659cfe6-7a96-44c8-aade-c0d1308da1b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.126609 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.126421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2659cfe6-7a96-44c8-aade-c0d1308da1b7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.126609 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.126445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkln5\" (UniqueName: \"kubernetes.io/projected/2659cfe6-7a96-44c8-aade-c0d1308da1b7-kube-api-access-wkln5\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.126609 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.126468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2659cfe6-7a96-44c8-aade-c0d1308da1b7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.227253 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.227163 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2659cfe6-7a96-44c8-aade-c0d1308da1b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.227253 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.227221 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2659cfe6-7a96-44c8-aade-c0d1308da1b7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.227253 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.227243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkln5\" (UniqueName: \"kubernetes.io/projected/2659cfe6-7a96-44c8-aade-c0d1308da1b7-kube-api-access-wkln5\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.227582 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.227267 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2659cfe6-7a96-44c8-aade-c0d1308da1b7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.227582 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:03:03.227370 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 09 03:03:03.227582 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:03:03.227418 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2659cfe6-7a96-44c8-aade-c0d1308da1b7-prometheus-operator-tls podName:2659cfe6-7a96-44c8-aade-c0d1308da1b7 nodeName:}" failed. No retries permitted until 2026-06-09 03:03:03.727404157 +0000 UTC m=+200.726410580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2659cfe6-7a96-44c8-aade-c0d1308da1b7-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-xglkm" (UID: "2659cfe6-7a96-44c8-aade-c0d1308da1b7") : secret "prometheus-operator-tls" not found Jun 09 03:03:03.227983 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.227957 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2659cfe6-7a96-44c8-aade-c0d1308da1b7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.229622 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.229605 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2659cfe6-7a96-44c8-aade-c0d1308da1b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.235399 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.235380 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkln5\" (UniqueName: \"kubernetes.io/projected/2659cfe6-7a96-44c8-aade-c0d1308da1b7-kube-api-access-wkln5\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.337758 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.337723 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:03.537258 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.537172 2568 patch_prober.go:28] interesting pod/image-registry-7fd68b86df-xbhnh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 03:03:03.537258 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.537232 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" podUID="b2d54eb5-8971-4303-b8f0-5426c00d6d4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:03:03.730797 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.730754 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2659cfe6-7a96-44c8-aade-c0d1308da1b7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.733119 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.733094 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2659cfe6-7a96-44c8-aade-c0d1308da1b7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xglkm\" (UID: \"2659cfe6-7a96-44c8-aade-c0d1308da1b7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:03.888149 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:03.888059 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" Jun 09 03:03:04.015129 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:04.015103 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xglkm"] Jun 09 03:03:04.017341 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:03:04.017319 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2659cfe6_7a96_44c8_aade_c0d1308da1b7.slice/crio-5233b4b220e50e8ad9c81487ac101a5dcd7746660941478bc8fa59a05b694f52 WatchSource:0}: Error finding container 5233b4b220e50e8ad9c81487ac101a5dcd7746660941478bc8fa59a05b694f52: Status 404 returned error can't find the container with id 5233b4b220e50e8ad9c81487ac101a5dcd7746660941478bc8fa59a05b694f52 Jun 09 03:03:04.074109 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:04.074073 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" event={"ID":"2659cfe6-7a96-44c8-aade-c0d1308da1b7","Type":"ContainerStarted","Data":"5233b4b220e50e8ad9c81487ac101a5dcd7746660941478bc8fa59a05b694f52"} Jun 09 03:03:05.616732 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:05.616700 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:06.082941 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:06.082908 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" event={"ID":"2659cfe6-7a96-44c8-aade-c0d1308da1b7","Type":"ContainerStarted","Data":"dae7151f6212d7dc4259774993465dbafee659bbc4fac7615da8a85d51531186"} Jun 09 03:03:06.083115 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:06.082959 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" event={"ID":"2659cfe6-7a96-44c8-aade-c0d1308da1b7","Type":"ContainerStarted","Data":"952a3ccce94f98d56a66ce75a58bb81d9971bc5177357804f8c509306928f583"} Jun 09 03:03:06.099291 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:06.099243 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xglkm" podStartSLOduration=2.7373801159999998 podStartE2EDuration="4.099225302s" totalImagesPullingTime="1.361845186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:03:06.098774059 +0000 UTC m=+203.097780504" watchObservedRunningTime="2026-06-09 03:03:06.099225302 +0000 UTC m=+203.098231746" Jun 09 03:03:06.410197 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:06.410116 2568 scope.go:117] "RemoveContainer" containerID="c980c088c27aa2e021f6740c7e2312ebf0eea416f4b07388d5d54cdc4928756e" Jun 09 03:03:06.410339 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:03:06.410271 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-8w8qw_openshift-console-operator(e3580812-0e71-4a5a-a89c-54745684747b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" podUID="e3580812-0e71-4a5a-a89c-54745684747b" Jun 09 03:03:08.069797 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.069766 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:08.270285 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.270240 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:08.329607 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.329526 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r5wqw"] Jun 09 03:03:08.332979 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.332960 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.336081 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.336060 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 03:03:08.336206 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.336060 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 03:03:08.338849 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.338831 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 03:03:08.338988 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.338966 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7k8xb\"" Jun 09 03:03:08.375408 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.375372 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:08.435116 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.435087 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:08.470721 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.470689 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20901f4b-4dcd-4ba0-a109-7987e4c72060-root\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.470844 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.470741 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz6rt\" (UniqueName: \"kubernetes.io/projected/20901f4b-4dcd-4ba0-a109-7987e4c72060-kube-api-access-vz6rt\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.470844 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.470793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20901f4b-4dcd-4ba0-a109-7987e4c72060-sys\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.470930 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.470865 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-textfile\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.470930 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.470885 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.470996 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.470956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-wtmp\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.470996 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.470975 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-tls\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.470996 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.470992 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20901f4b-4dcd-4ba0-a109-7987e4c72060-metrics-client-ca\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.471099 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.471015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.534380 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.534349 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:08.571480 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571446 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571641 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571488 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20901f4b-4dcd-4ba0-a109-7987e4c72060-root\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571641 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571537 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz6rt\" (UniqueName: \"kubernetes.io/projected/20901f4b-4dcd-4ba0-a109-7987e4c72060-kube-api-access-vz6rt\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571641 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571554 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20901f4b-4dcd-4ba0-a109-7987e4c72060-sys\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571641 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571622 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20901f4b-4dcd-4ba0-a109-7987e4c72060-sys\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571641 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571628 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20901f4b-4dcd-4ba0-a109-7987e4c72060-root\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571882 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571668 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-textfile\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571882 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571882 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-wtmp\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571882 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571745 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-tls\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571882 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571770 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20901f4b-4dcd-4ba0-a109-7987e4c72060-metrics-client-ca\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571882 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571862 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-wtmp\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.571882 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:03:08.571874 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 03:03:08.572205 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:03:08.571954 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-tls podName:20901f4b-4dcd-4ba0-a109-7987e4c72060 nodeName:}" failed. No retries permitted until 2026-06-09 03:03:09.071930477 +0000 UTC m=+206.070936913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-tls") pod "node-exporter-r5wqw" (UID: "20901f4b-4dcd-4ba0-a109-7987e4c72060") : secret "node-exporter-tls" not found Jun 09 03:03:08.572205 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.571994 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-textfile\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.572205 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.572187 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.572319 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.572253 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20901f4b-4dcd-4ba0-a109-7987e4c72060-metrics-client-ca\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.573953 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.573933 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.579548 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.579528 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz6rt\" (UniqueName: \"kubernetes.io/projected/20901f4b-4dcd-4ba0-a109-7987e4c72060-kube-api-access-vz6rt\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:08.639769 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.639676 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:08.735815 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.735779 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:08.836283 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:08.836228 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:09.075931 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:09.075886 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-tls\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:09.078206 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:09.078183 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20901f4b-4dcd-4ba0-a109-7987e4c72060-node-exporter-tls\") pod \"node-exporter-r5wqw\" (UID: \"20901f4b-4dcd-4ba0-a109-7987e4c72060\") " pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:09.242698 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:09.242661 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r5wqw" Jun 09 03:03:09.255702 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:03:09.255672 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20901f4b_4dcd_4ba0_a109_7987e4c72060.slice/crio-8acfccb67887f2823b03688e69d858d806aa91c1b129d1be149c2d8e439e9565 WatchSource:0}: Error finding container 8acfccb67887f2823b03688e69d858d806aa91c1b129d1be149c2d8e439e9565: Status 404 returned error can't find the container with id 8acfccb67887f2823b03688e69d858d806aa91c1b129d1be149c2d8e439e9565 Jun 09 03:03:09.281515 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:09.281465 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:09.353251 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:09.353159 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:09.491018 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:09.490978 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:10.100024 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:10.099984 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5wqw" event={"ID":"20901f4b-4dcd-4ba0-a109-7987e4c72060","Type":"ContainerStarted","Data":"8acfccb67887f2823b03688e69d858d806aa91c1b129d1be149c2d8e439e9565"} Jun 09 03:03:11.104931 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:11.104901 2568 generic.go:356] "Generic (PLEG): container finished" podID="20901f4b-4dcd-4ba0-a109-7987e4c72060" containerID="1408977e14e7c0f417cd39c1216c5ab49ed00d920435ddf1726ca80b4bd5815b" exitCode=0 Jun 09 03:03:11.105349 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:11.104978 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5wqw" event={"ID":"20901f4b-4dcd-4ba0-a109-7987e4c72060","Type":"ContainerDied","Data":"1408977e14e7c0f417cd39c1216c5ab49ed00d920435ddf1726ca80b4bd5815b"} Jun 09 03:03:11.205270 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:11.205242 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:11.264489 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:11.264417 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:11.439072 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:11.439039 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:11.586095 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:11.586059 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:12.109989 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:12.109957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5wqw" event={"ID":"20901f4b-4dcd-4ba0-a109-7987e4c72060","Type":"ContainerStarted","Data":"99f823dc5e3440de55f43521328e348172ebdabfcbd93de2fee733ebd6f3ffa4"} Jun 09 03:03:12.110366 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:12.110013 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5wqw" event={"ID":"20901f4b-4dcd-4ba0-a109-7987e4c72060","Type":"ContainerStarted","Data":"256e0930453956697dcf809909393484a7156939cd88ae297229c5034dbf0a2c"} Jun 09 03:03:12.129423 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:12.129376 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r5wqw" podStartSLOduration=2.922665 podStartE2EDuration="4.129358956s" totalImagesPullingTime="1.141171163s" totalInitContainerRuntime="65.522793ms" isStatefulPod=true podCreationTimestamp="2026-06-09 03:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:03:12.127588889 +0000 UTC m=+209.126595334" watchObservedRunningTime="2026-06-09 03:03:12.129358956 +0000 UTC m=+209.128365411" Jun 09 03:03:13.077633 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:13.077605 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:13.426144 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:13.426106 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:13.536110 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:13.536076 2568 patch_prober.go:28] interesting pod/image-registry-7fd68b86df-xbhnh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 03:03:13.536270 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:13.536128 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" podUID="b2d54eb5-8971-4303-b8f0-5426c00d6d4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:03:13.879717 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:13.879637 2568 patch_prober.go:28] interesting pod/image-registry-844d889dc8-jn44p container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 03:03:13.879717 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:13.879687 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" podUID="97a80e2c-170f-4125-81d5-8b0c2442c9af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:03:14.429145 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:14.429111 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:16.042558 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:16.042526 2568 patch_prober.go:28] interesting pod/image-registry-844d889dc8-jn44p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 03:03:16.042981 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:16.042581 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" podUID="97a80e2c-170f-4125-81d5-8b0c2442c9af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:03:18.554513 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.554453 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" podUID="b2d54eb5-8971-4303-b8f0-5426c00d6d4f" containerName="registry" containerID="cri-o://11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6" gracePeriod=30 Jun 09 03:03:18.785006 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.784980 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:03:18.855201 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.855106 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls\") pod \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " Jun 09 03:03:18.855201 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.855151 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-ca-trust-extracted\") pod \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " Jun 09 03:03:18.855201 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.855181 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-bound-sa-token\") pod \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " Jun 09 03:03:18.855201 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.855207 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-certificates\") pod \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " Jun 09 03:03:18.855534 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.855225 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-image-registry-private-configuration\") pod \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " Jun 09 03:03:18.855534 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.855243 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-installation-pull-secrets\") pod \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " Jun 09 03:03:18.855534 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.855260 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8kbl\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-kube-api-access-s8kbl\") pod \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " Jun 09 03:03:18.855534 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.855281 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-trusted-ca\") pod \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\" (UID: \"b2d54eb5-8971-4303-b8f0-5426c00d6d4f\") " Jun 09 03:03:18.855841 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.855787 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b2d54eb5-8971-4303-b8f0-5426c00d6d4f" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:03:18.855963 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.855878 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b2d54eb5-8971-4303-b8f0-5426c00d6d4f" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:03:18.857923 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.857865 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-kube-api-access-s8kbl" (OuterVolumeSpecName: "kube-api-access-s8kbl") pod "b2d54eb5-8971-4303-b8f0-5426c00d6d4f" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f"). InnerVolumeSpecName "kube-api-access-s8kbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 03:03:18.857923 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.857909 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b2d54eb5-8971-4303-b8f0-5426c00d6d4f" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 03:03:18.858080 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.857939 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b2d54eb5-8971-4303-b8f0-5426c00d6d4f" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 03:03:18.858080 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.857966 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b2d54eb5-8971-4303-b8f0-5426c00d6d4f" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 03:03:18.858080 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.858010 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b2d54eb5-8971-4303-b8f0-5426c00d6d4f" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 03:03:18.863215 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.863195 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b2d54eb5-8971-4303-b8f0-5426c00d6d4f" (UID: "b2d54eb5-8971-4303-b8f0-5426c00d6d4f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 03:03:18.956443 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.956408 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-trusted-ca\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:03:18.956443 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.956435 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-tls\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:03:18.956443 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.956444 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-ca-trust-extracted\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:03:18.956443 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.956453 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-bound-sa-token\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:03:18.956727 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.956461 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-registry-certificates\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:03:18.956727 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.956470 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-image-registry-private-configuration\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:03:18.956727 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.956481 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-installation-pull-secrets\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:03:18.956727 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:18.956491 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8kbl\" (UniqueName: \"kubernetes.io/projected/b2d54eb5-8971-4303-b8f0-5426c00d6d4f-kube-api-access-s8kbl\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:03:19.137145 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:19.137053 2568 generic.go:356] "Generic (PLEG): container finished" podID="b2d54eb5-8971-4303-b8f0-5426c00d6d4f" containerID="11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6" exitCode=0 Jun 09 03:03:19.137145 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:19.137097 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" event={"ID":"b2d54eb5-8971-4303-b8f0-5426c00d6d4f","Type":"ContainerDied","Data":"11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6"} Jun 09 03:03:19.137145 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:19.137101 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" Jun 09 03:03:19.137145 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:19.137137 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd68b86df-xbhnh" event={"ID":"b2d54eb5-8971-4303-b8f0-5426c00d6d4f","Type":"ContainerDied","Data":"c3407d4074eb918d7b27b64514f617fbc1ae7d60b5248c8823a65ba286a93877"} Jun 09 03:03:19.137458 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:19.137156 2568 scope.go:117] "RemoveContainer" containerID="11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6" Jun 09 03:03:19.145398 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:19.145381 2568 scope.go:117] "RemoveContainer" containerID="11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6" Jun 09 03:03:19.145702 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:03:19.145684 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6\": container with ID starting with 11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6 not found: ID does not exist" containerID="11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6" Jun 09 03:03:19.145776 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:19.145708 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6"} err="failed to get container status \"11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6\": rpc error: code = NotFound desc = could not find container \"11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6\": container with ID starting with 11b8b058ce0ff26a7f12fcdf226334383075c7a1db49941d90c3a74d210400f6 not found: ID does not exist" Jun 09 03:03:19.156977 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:19.156949 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fd68b86df-xbhnh"] Jun 09 03:03:19.160304 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:19.160282 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fd68b86df-xbhnh"] Jun 09 03:03:19.415740 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:19.415708 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2d54eb5-8971-4303-b8f0-5426c00d6d4f" path="/var/lib/kubelet/pods/b2d54eb5-8971-4303-b8f0-5426c00d6d4f/volumes" Jun 09 03:03:20.410248 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:20.410211 2568 scope.go:117] "RemoveContainer" containerID="c980c088c27aa2e021f6740c7e2312ebf0eea416f4b07388d5d54cdc4928756e" Jun 09 03:03:21.086104 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.086013 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-6plxr"] Jun 09 03:03:21.086390 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.086372 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d54eb5-8971-4303-b8f0-5426c00d6d4f" containerName="registry" Jun 09 03:03:21.086472 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.086391 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d54eb5-8971-4303-b8f0-5426c00d6d4f" containerName="registry" Jun 09 03:03:21.086557 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.086516 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2d54eb5-8971-4303-b8f0-5426c00d6d4f" containerName="registry" Jun 09 03:03:21.089543 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.089522 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-6plxr" Jun 09 03:03:21.092203 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.092179 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7qcgt\"" Jun 09 03:03:21.092333 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.092240 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 03:03:21.092333 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.092276 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 03:03:21.097744 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.097705 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:21.097930 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.097909 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-6plxr"] Jun 09 03:03:21.151058 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.151032 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:03:21.151224 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.151132 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" event={"ID":"e3580812-0e71-4a5a-a89c-54745684747b","Type":"ContainerStarted","Data":"d88f62f14a913cf15beadbbd1f615f03c5986bc31f7c5a28c175d8a5c619ad36"} Jun 09 03:03:21.151407 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.151374 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:03:21.155986 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.155964 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" Jun 09 03:03:21.168333 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.168293 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-8w8qw" podStartSLOduration=53.339646615 podStartE2EDuration="57.168279132s" totalImagesPullingTime="3.828632517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:03:21.167564867 +0000 UTC m=+218.166571331" watchObservedRunningTime="2026-06-09 03:03:21.168279132 +0000 UTC m=+218.167285577" Jun 09 03:03:21.175566 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.175532 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cckxw\" (UniqueName: \"kubernetes.io/projected/5055dee1-09b1-409b-a0c0-4ba74eaf8d11-kube-api-access-cckxw\") pod \"downloads-6657875f97-6plxr\" (UID: \"5055dee1-09b1-409b-a0c0-4ba74eaf8d11\") " pod="openshift-console/downloads-6657875f97-6plxr" Jun 09 03:03:21.185868 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.185844 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:21.277310 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.277270 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cckxw\" (UniqueName: \"kubernetes.io/projected/5055dee1-09b1-409b-a0c0-4ba74eaf8d11-kube-api-access-cckxw\") pod \"downloads-6657875f97-6plxr\" (UID: \"5055dee1-09b1-409b-a0c0-4ba74eaf8d11\") " pod="openshift-console/downloads-6657875f97-6plxr" Jun 09 03:03:21.287084 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.287020 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cckxw\" (UniqueName: \"kubernetes.io/projected/5055dee1-09b1-409b-a0c0-4ba74eaf8d11-kube-api-access-cckxw\") pod \"downloads-6657875f97-6plxr\" (UID: \"5055dee1-09b1-409b-a0c0-4ba74eaf8d11\") " pod="openshift-console/downloads-6657875f97-6plxr" Jun 09 03:03:21.379443 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.379356 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:21.399233 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.399186 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-6plxr" Jun 09 03:03:21.554562 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.554460 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-6plxr"] Jun 09 03:03:21.560310 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:03:21.560279 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5055dee1_09b1_409b_a0c0_4ba74eaf8d11.slice/crio-422646139ad2a4bdf4faab3646e1b8b2c04b0c191afad4376db06134a5f4225c WatchSource:0}: Error finding container 422646139ad2a4bdf4faab3646e1b8b2c04b0c191afad4376db06134a5f4225c: Status 404 returned error can't find the container with id 422646139ad2a4bdf4faab3646e1b8b2c04b0c191afad4376db06134a5f4225c Jun 09 03:03:21.589335 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.589300 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:21.757222 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.757191 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:21.806189 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:21.806157 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:22.156593 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:22.156506 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-6plxr" event={"ID":"5055dee1-09b1-409b-a0c0-4ba74eaf8d11","Type":"ContainerStarted","Data":"422646139ad2a4bdf4faab3646e1b8b2c04b0c191afad4376db06134a5f4225c"} Jun 09 03:03:22.160003 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:22.159977 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:22.203913 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:22.203878 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:22.771258 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:22.771226 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:22.965447 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:22.965417 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:23.066432 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:23.066344 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:23.397710 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:23.397617 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:23.449175 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:23.449138 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:23.880227 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:23.880188 2568 patch_prober.go:28] interesting pod/image-registry-844d889dc8-jn44p container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 03:03:23.880698 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:23.880250 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" podUID="97a80e2c-170f-4125-81d5-8b0c2442c9af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:03:23.977466 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:23.977428 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:24.030226 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:24.030197 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:26.043474 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:26.043437 2568 patch_prober.go:28] interesting pod/image-registry-844d889dc8-jn44p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 03:03:26.043906 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:26.043519 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" podUID="97a80e2c-170f-4125-81d5-8b0c2442c9af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:03:28.096407 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:28.096371 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:28.145203 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:28.145173 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:31.193678 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.193647 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bfd94bd8c-5xsk6"] Jun 09 03:03:31.233233 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.233193 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bfd94bd8c-5xsk6"] Jun 09 03:03:31.233399 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.233318 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.236658 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.236637 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fhrvm\"" Jun 09 03:03:31.236658 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.236647 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 03:03:31.236854 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.236637 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 03:03:31.237856 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.237842 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 03:03:31.237937 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.237904 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 03:03:31.238001 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.237984 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 03:03:31.373008 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.372970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-serving-cert\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.373008 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.373013 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-console-config\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.373216 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.373095 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-service-ca\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.373216 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.373142 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n76s\" (UniqueName: \"kubernetes.io/projected/81068c68-7b3f-436d-a462-384925c1b674-kube-api-access-9n76s\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.373216 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.373173 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-oauth-config\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.373334 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.373226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-oauth-serving-cert\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.474392 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.474301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-oauth-serving-cert\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.474587 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.474416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-serving-cert\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.474587 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.474450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-console-config\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.474587 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.474507 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-service-ca\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.474587 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.474536 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n76s\" (UniqueName: \"kubernetes.io/projected/81068c68-7b3f-436d-a462-384925c1b674-kube-api-access-9n76s\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.474587 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.474565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-oauth-config\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.475203 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.475145 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-oauth-serving-cert\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.475327 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.475219 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-service-ca\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.475327 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.475273 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-console-config\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.477101 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.477074 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-oauth-config\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.477256 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.477235 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-serving-cert\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.484629 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.484591 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n76s\" (UniqueName: \"kubernetes.io/projected/81068c68-7b3f-436d-a462-384925c1b674-kube-api-access-9n76s\") pod \"console-5bfd94bd8c-5xsk6\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.542904 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.542868 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:31.676955 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:31.676920 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bfd94bd8c-5xsk6"] Jun 09 03:03:31.680100 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:03:31.680075 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81068c68_7b3f_436d_a462_384925c1b674.slice/crio-59b2e2c0ccd3f333b61db2e1af2535517e8bdba58a7fe0120348ff40ac504a02 WatchSource:0}: Error finding container 59b2e2c0ccd3f333b61db2e1af2535517e8bdba58a7fe0120348ff40ac504a02: Status 404 returned error can't find the container with id 59b2e2c0ccd3f333b61db2e1af2535517e8bdba58a7fe0120348ff40ac504a02 Jun 09 03:03:32.198386 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:32.198353 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bfd94bd8c-5xsk6" event={"ID":"81068c68-7b3f-436d-a462-384925c1b674","Type":"ContainerStarted","Data":"59b2e2c0ccd3f333b61db2e1af2535517e8bdba58a7fe0120348ff40ac504a02"} Jun 09 03:03:33.586130 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.586100 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665ccd6775-6scnt"] Jun 09 03:03:33.589811 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.589786 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.592036 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.591996 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:33.598915 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.598695 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 03:03:33.600217 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.600195 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665ccd6775-6scnt"] Jun 09 03:03:33.643185 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.643152 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:33.694284 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.694246 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl2p7\" (UniqueName: \"kubernetes.io/projected/7aca83d8-b984-4939-b36e-c0dc680a4ab3-kube-api-access-sl2p7\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.694489 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.694379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-oauth-config\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.694489 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.694413 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-service-ca\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.694649 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.694526 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-trusted-ca-bundle\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.694649 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.694591 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-config\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.694649 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.694628 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-serving-cert\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.694803 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.694650 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-oauth-serving-cert\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.795751 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.795711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2p7\" (UniqueName: \"kubernetes.io/projected/7aca83d8-b984-4939-b36e-c0dc680a4ab3-kube-api-access-sl2p7\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.795934 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.795797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-oauth-config\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.795934 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.795821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-service-ca\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.795934 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.795875 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-trusted-ca-bundle\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.795934 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.795921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-config\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.796120 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.795953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-serving-cert\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.796120 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.795978 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-oauth-serving-cert\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.796812 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.796782 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-service-ca\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.796942 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.796782 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-config\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.796942 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.796853 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-oauth-serving-cert\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.797070 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.797043 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-trusted-ca-bundle\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.799049 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.799029 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-oauth-config\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.799197 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.799177 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-serving-cert\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.804263 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.804245 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl2p7\" (UniqueName: \"kubernetes.io/projected/7aca83d8-b984-4939-b36e-c0dc680a4ab3-kube-api-access-sl2p7\") pod \"console-665ccd6775-6scnt\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:33.881449 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.881343 2568 patch_prober.go:28] interesting pod/image-registry-844d889dc8-jn44p container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 03:03:33.881449 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.881426 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" podUID="97a80e2c-170f-4125-81d5-8b0c2442c9af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:03:33.881691 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.881480 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:03:33.882108 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.882076 2568 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"9cdf2bb47e8d04d20747fba9470e98bbeb8bd7d57e3c10a148472ed580841e90"} pod="openshift-image-registry/image-registry-844d889dc8-jn44p" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 03:03:33.886203 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.886173 2568 patch_prober.go:28] interesting pod/image-registry-844d889dc8-jn44p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 03:03:33.886347 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.886225 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" podUID="97a80e2c-170f-4125-81d5-8b0c2442c9af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:03:33.902584 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:33.902557 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:36.184231 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:36.184188 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:38.545748 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:38.545715 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:38.596781 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:38.596735 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:39.982421 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:39.982387 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:40.032185 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:40.032150 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:40.428798 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:40.428754 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:40.483774 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:40.483742 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:41.512239 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:41.512207 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665ccd6775-6scnt"] Jun 09 03:03:41.517133 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:03:41.517099 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aca83d8_b984_4939_b36e_c0dc680a4ab3.slice/crio-268e36889cda92f7d1116be8e0d308e3c0bf276d5aa2f68a5b736c5e2f533700 WatchSource:0}: Error finding container 268e36889cda92f7d1116be8e0d308e3c0bf276d5aa2f68a5b736c5e2f533700: Status 404 returned error can't find the container with id 268e36889cda92f7d1116be8e0d308e3c0bf276d5aa2f68a5b736c5e2f533700 Jun 09 03:03:42.241587 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:42.241545 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665ccd6775-6scnt" event={"ID":"7aca83d8-b984-4939-b36e-c0dc680a4ab3","Type":"ContainerStarted","Data":"56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda"} Jun 09 03:03:42.241762 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:42.241619 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665ccd6775-6scnt" event={"ID":"7aca83d8-b984-4939-b36e-c0dc680a4ab3","Type":"ContainerStarted","Data":"268e36889cda92f7d1116be8e0d308e3c0bf276d5aa2f68a5b736c5e2f533700"} Jun 09 03:03:42.243375 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:42.243339 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-6plxr" event={"ID":"5055dee1-09b1-409b-a0c0-4ba74eaf8d11","Type":"ContainerStarted","Data":"6f8728127dc353d221077d54ccba8a6c0b334539dd5583c6f0357f66aa624ee0"} Jun 09 03:03:42.244014 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:42.243994 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-6plxr" Jun 09 03:03:42.246539 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:42.246511 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bfd94bd8c-5xsk6" event={"ID":"81068c68-7b3f-436d-a462-384925c1b674","Type":"ContainerStarted","Data":"0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7"} Jun 09 03:03:42.258998 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:42.258842 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665ccd6775-6scnt" podStartSLOduration=9.258820702 podStartE2EDuration="9.258820702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:03:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:03:42.2578387 +0000 UTC m=+239.256845179" watchObservedRunningTime="2026-06-09 03:03:42.258820702 +0000 UTC m=+239.257827149" Jun 09 03:03:42.259873 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:42.259845 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-6plxr" Jun 09 03:03:42.273965 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:42.273909 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-6plxr" podStartSLOduration=1.419363251 podStartE2EDuration="21.273894658s" totalImagesPullingTime="19.854531407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:03:42.272673513 +0000 UTC m=+239.271679960" watchObservedRunningTime="2026-06-09 03:03:42.273894658 +0000 UTC m=+239.272901102" Jun 09 03:03:42.289938 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:42.289884 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bfd94bd8c-5xsk6" podStartSLOduration=1.589238998 podStartE2EDuration="11.28986737s" totalImagesPullingTime="9.700628372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:03:42.288250998 +0000 UTC m=+239.287257446" watchObservedRunningTime="2026-06-09 03:03:42.28986737 +0000 UTC m=+239.288873814" Jun 09 03:03:43.886947 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:43.886908 2568 patch_prober.go:28] interesting pod/image-registry-844d889dc8-jn44p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 03:03:43.887371 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:43.886977 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" podUID="97a80e2c-170f-4125-81d5-8b0c2442c9af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:03:43.902796 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:43.902758 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:43.902980 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:43.902843 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:03:43.903913 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:43.903886 2568 patch_prober.go:28] interesting pod/console-665ccd6775-6scnt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 09 03:03:43.904078 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:43.903932 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-665ccd6775-6scnt" podUID="7aca83d8-b984-4939-b36e-c0dc680a4ab3" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 09 03:03:49.195193 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:49.195158 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:49.241249 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:49.241213 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:51.543587 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:51.543467 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:51.543587 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:51.543541 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:03:51.544871 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:51.544850 2568 patch_prober.go:28] interesting pod/console-5bfd94bd8c-5xsk6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 09 03:03:51.544934 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:51.544894 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bfd94bd8c-5xsk6" podUID="81068c68-7b3f-436d-a462-384925c1b674" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 09 03:03:53.887322 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:53.887237 2568 patch_prober.go:28] interesting pod/image-registry-844d889dc8-jn44p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 03:03:53.887322 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:53.887293 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" podUID="97a80e2c-170f-4125-81d5-8b0c2442c9af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:03:53.903592 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:53.903555 2568 patch_prober.go:28] interesting pod/console-665ccd6775-6scnt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 09 03:03:53.903773 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:53.903610 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-665ccd6775-6scnt" podUID="7aca83d8-b984-4939-b36e-c0dc680a4ab3" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 09 03:03:55.207460 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.207418 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:03:55.209662 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.209641 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbfc6f31-41c5-4e02-9e38-2a3248ca1063-metrics-certs\") pod \"network-metrics-daemon-fbpvr\" (UID: \"dbfc6f31-41c5-4e02-9e38-2a3248ca1063\") " pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:03:55.214925 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.214899 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqjfg\"" Jun 09 03:03:55.221936 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.221916 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbpvr" Jun 09 03:03:55.303413 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.302487 2568 generic.go:356] "Generic (PLEG): container finished" podID="231e8739-4ba2-4ff7-b6ba-4530ee6a5a63" containerID="1077fa3a498070f54f4da902dc5ee2b5ac445115e5b4a8ba04d2929870c41b87" exitCode=0 Jun 09 03:03:55.303413 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.302629 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" event={"ID":"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63","Type":"ContainerDied","Data":"1077fa3a498070f54f4da902dc5ee2b5ac445115e5b4a8ba04d2929870c41b87"} Jun 09 03:03:55.303413 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.302985 2568 scope.go:117] "RemoveContainer" containerID="1077fa3a498070f54f4da902dc5ee2b5ac445115e5b4a8ba04d2929870c41b87" Jun 09 03:03:55.305688 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.305623 2568 generic.go:356] "Generic (PLEG): container finished" podID="06f2f575-8396-47b7-a2d8-10193c494e6f" containerID="9ce2fa30a5b0917fb1c2440617e8c8d26d2df2187fc142ac7e7c520d72744366" exitCode=0 Jun 09 03:03:55.305878 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.305822 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" event={"ID":"06f2f575-8396-47b7-a2d8-10193c494e6f","Type":"ContainerDied","Data":"9ce2fa30a5b0917fb1c2440617e8c8d26d2df2187fc142ac7e7c520d72744366"} Jun 09 03:03:55.307274 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.307195 2568 scope.go:117] "RemoveContainer" containerID="9ce2fa30a5b0917fb1c2440617e8c8d26d2df2187fc142ac7e7c520d72744366" Jun 09 03:03:55.309084 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.309050 2568 generic.go:356] "Generic (PLEG): container finished" podID="441f01df-e470-46a7-b98b-e5a2b681f3fe" containerID="91923f4551ef7026e2eca64b6d2199cb7170631bf7a946b3c4487e4c29afc4f2" exitCode=0 Jun 09 03:03:55.309084 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.309072 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-v2znj" event={"ID":"441f01df-e470-46a7-b98b-e5a2b681f3fe","Type":"ContainerDied","Data":"91923f4551ef7026e2eca64b6d2199cb7170631bf7a946b3c4487e4c29afc4f2"} Jun 09 03:03:55.309395 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.309351 2568 scope.go:117] "RemoveContainer" containerID="91923f4551ef7026e2eca64b6d2199cb7170631bf7a946b3c4487e4c29afc4f2" Jun 09 03:03:55.378878 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:55.378815 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbpvr"] Jun 09 03:03:55.384869 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:03:55.384840 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfc6f31_41c5_4e02_9e38_2a3248ca1063.slice/crio-6d5fd9d72b61518bddff82c8664ab213e009d732301691ce36fc6475876c3af5 WatchSource:0}: Error finding container 6d5fd9d72b61518bddff82c8664ab213e009d732301691ce36fc6475876c3af5: Status 404 returned error can't find the container with id 6d5fd9d72b61518bddff82c8664ab213e009d732301691ce36fc6475876c3af5 Jun 09 03:03:56.316101 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:56.316070 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dgfdn" event={"ID":"06f2f575-8396-47b7-a2d8-10193c494e6f","Type":"ContainerStarted","Data":"c72ad49924be47070dfc4a6580f84975e0bc8c0172969b07bec6f9d8d06dcade"} Jun 09 03:03:56.317225 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:56.317202 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbpvr" event={"ID":"dbfc6f31-41c5-4e02-9e38-2a3248ca1063","Type":"ContainerStarted","Data":"6d5fd9d72b61518bddff82c8664ab213e009d732301691ce36fc6475876c3af5"} Jun 09 03:03:56.318919 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:56.318897 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-v2znj" event={"ID":"441f01df-e470-46a7-b98b-e5a2b681f3fe","Type":"ContainerStarted","Data":"805dd534ab634a7bf80586726d9e1344e7cd4abd1d0e2d666b86a696798c980e"} Jun 09 03:03:56.320629 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:56.320609 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xdrq" event={"ID":"231e8739-4ba2-4ff7-b6ba-4530ee6a5a63","Type":"ContainerStarted","Data":"1bb9b4ac1ccad9412a25d76e24883752b3fce9330dfda3c03fde87f93d8f32d9"} Jun 09 03:03:57.326423 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:57.326299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbpvr" event={"ID":"dbfc6f31-41c5-4e02-9e38-2a3248ca1063","Type":"ContainerStarted","Data":"519f9ecbbf0e5ac6d05034070e72175cbbb1874dc830e51dd1d9428ce81af341"} Jun 09 03:03:57.326976 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:57.326428 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbpvr" event={"ID":"dbfc6f31-41c5-4e02-9e38-2a3248ca1063","Type":"ContainerStarted","Data":"6487d36b4c2a26e2d11c8d8549e02e9b5b166a5426d1f056c15a74a075678eb3"} Jun 09 03:03:57.343198 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:57.343140 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fbpvr" podStartSLOduration=253.035652902 podStartE2EDuration="4m14.343122211s" totalImagesPullingTime="1.307469309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:03:57.341544927 +0000 UTC m=+254.340551372" watchObservedRunningTime="2026-06-09 03:03:57.343122211 +0000 UTC m=+254.342128697" Jun 09 03:03:57.422752 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:57.422715 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:57.512590 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:57.512561 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:57.560579 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:57.560542 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:58.680917 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:58.680889 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:58.781574 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:58.781541 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:03:58.906173 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:58.906137 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" podUID="97a80e2c-170f-4125-81d5-8b0c2442c9af" containerName="registry" containerID="cri-o://9cdf2bb47e8d04d20747fba9470e98bbeb8bd7d57e3c10a148472ed580841e90" gracePeriod=30 Jun 09 03:03:59.611145 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:03:59.611116 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-fcglz_a839c710-8579-45a6-adfa-ebb6eea7d32d/cluster-monitoring-operator/0.log" Jun 09 03:04:00.340975 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:00.340894 2568 generic.go:356] "Generic (PLEG): container finished" podID="97a80e2c-170f-4125-81d5-8b0c2442c9af" containerID="9cdf2bb47e8d04d20747fba9470e98bbeb8bd7d57e3c10a148472ed580841e90" exitCode=0 Jun 09 03:04:00.341346 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:00.340980 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" event={"ID":"97a80e2c-170f-4125-81d5-8b0c2442c9af","Type":"ContainerDied","Data":"9cdf2bb47e8d04d20747fba9470e98bbeb8bd7d57e3c10a148472ed580841e90"} Jun 09 03:04:00.341346 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:00.341050 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" event={"ID":"97a80e2c-170f-4125-81d5-8b0c2442c9af","Type":"ContainerStarted","Data":"8f62f79faecff3c4701bf200eea97be1e076b927f37eedf3f49d31da1d967e8d"} Jun 09 03:04:00.341346 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:00.341241 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:04:01.543824 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:01.543783 2568 patch_prober.go:28] interesting pod/console-5bfd94bd8c-5xsk6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 09 03:04:01.544231 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:01.543846 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bfd94bd8c-5xsk6" podUID="81068c68-7b3f-436d-a462-384925c1b674" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 09 03:04:02.009246 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:02.009213 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5wqw_20901f4b-4dcd-4ba0-a109-7987e4c72060/init-textfile/0.log" Jun 09 03:04:02.209940 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:02.209913 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5wqw_20901f4b-4dcd-4ba0-a109-7987e4c72060/node-exporter/0.log" Jun 09 03:04:02.409134 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:02.408996 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5wqw_20901f4b-4dcd-4ba0-a109-7987e4c72060/kube-rbac-proxy/0.log" Jun 09 03:04:03.903516 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:03.903461 2568 patch_prober.go:28] interesting pod/console-665ccd6775-6scnt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 09 03:04:03.903971 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:03.903543 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-665ccd6775-6scnt" podUID="7aca83d8-b984-4939-b36e-c0dc680a4ab3" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 09 03:04:04.617447 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:04.617399 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xglkm_2659cfe6-7a96-44c8-aade-c0d1308da1b7/prometheus-operator/0.log" Jun 09 03:04:04.809103 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:04.809041 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xglkm_2659cfe6-7a96-44c8-aade-c0d1308da1b7/kube-rbac-proxy/0.log" Jun 09 03:04:06.409430 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:06.409381 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-lqpxp_21448262-f838-4bae-8fc6-4153bd0b03c7/networking-console-plugin/0.log" Jun 09 03:04:06.609126 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:06.609099 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:04:06.811724 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:06.811695 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/3.log" Jun 09 03:04:07.009289 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:07.009256 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bfd94bd8c-5xsk6_81068c68-7b3f-436d-a462-384925c1b674/console/0.log" Jun 09 03:04:07.209924 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:07.209900 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-665ccd6775-6scnt_7aca83d8-b984-4939-b36e-c0dc680a4ab3/console/0.log" Jun 09 03:04:07.410132 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:07.410105 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-6plxr_5055dee1-09b1-409b-a0c0-4ba74eaf8d11/download-server/0.log" Jun 09 03:04:08.389860 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:08.389800 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:08.491387 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:08.491352 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:09.009340 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:09.009313 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jnj47_fd66dde4-da1d-49c1-b791-dca66777bd71/dns-node-resolver/0.log" Jun 09 03:04:09.609781 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:09.609756 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-844d889dc8-jn44p_97a80e2c-170f-4125-81d5-8b0c2442c9af/registry/1.log" Jun 09 03:04:09.809329 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:09.809299 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5vd6f_f00933df-8470-4be5-8679-54ba6a748b3d/node-ca/0.log" Jun 09 03:04:10.609471 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:10.609440 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnc8q_4120ed8e-5060-458f-b402-5aa161b47996/serve-healthcheck-canary/0.log" Jun 09 03:04:11.543820 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:11.543786 2568 patch_prober.go:28] interesting pod/console-5bfd94bd8c-5xsk6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 09 03:04:11.544197 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:11.543844 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bfd94bd8c-5xsk6" podUID="81068c68-7b3f-436d-a462-384925c1b674" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 09 03:04:13.908101 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:13.908063 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:04:13.912018 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:13.911994 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:04:13.965837 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:13.965795 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bfd94bd8c-5xsk6"] Jun 09 03:04:14.061266 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:14.061209 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:14.108813 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:14.108774 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:14.161438 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:14.161398 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:14.211660 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:14.211528 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:14.823437 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:14.823381 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:14.872111 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:14.872078 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:16.542414 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:16.542383 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:16.594170 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:16.594134 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:16.720115 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:16.720079 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:16.769014 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:16.768979 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:19.670172 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:19.670138 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:19.767539 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:19.767506 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:19.868127 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:19.868098 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:21.349044 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:21.349016 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-844d889dc8-jn44p" Jun 09 03:04:21.467275 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:21.467240 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:21.567525 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:21.567465 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:23.880963 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:04:23.880922 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-klhdv" podUID="6dad5db3-bce6-4f82-8696-9c8b7afe16a3" Jun 09 03:04:24.436164 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:24.436133 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-klhdv" Jun 09 03:04:26.525851 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:26.525817 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:26.577650 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:26.577617 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:26.885166 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:26.885055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:04:26.887370 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:26.887336 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dad5db3-bce6-4f82-8696-9c8b7afe16a3-metrics-tls\") pod \"dns-default-klhdv\" (UID: \"6dad5db3-bce6-4f82-8696-9c8b7afe16a3\") " pod="openshift-dns/dns-default-klhdv" Jun 09 03:04:27.139709 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:27.139625 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27vjm\"" Jun 09 03:04:27.147713 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:27.147690 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-klhdv" Jun 09 03:04:27.276109 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:27.276075 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-klhdv"] Jun 09 03:04:27.279208 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:04:27.279181 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dad5db3_bce6_4f82_8696_9c8b7afe16a3.slice/crio-e218e76ff08ec17fc87d789ec1098832de2fdd86b451743dff45cb8c58ce235a WatchSource:0}: Error finding container e218e76ff08ec17fc87d789ec1098832de2fdd86b451743dff45cb8c58ce235a: Status 404 returned error can't find the container with id e218e76ff08ec17fc87d789ec1098832de2fdd86b451743dff45cb8c58ce235a Jun 09 03:04:27.433777 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:27.433739 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:27.450826 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:27.450738 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-klhdv" event={"ID":"6dad5db3-bce6-4f82-8696-9c8b7afe16a3","Type":"ContainerStarted","Data":"e218e76ff08ec17fc87d789ec1098832de2fdd86b451743dff45cb8c58ce235a"} Jun 09 03:04:28.101441 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:28.101402 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:29.460790 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:29.460757 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-klhdv" event={"ID":"6dad5db3-bce6-4f82-8696-9c8b7afe16a3","Type":"ContainerStarted","Data":"ef00a464810a56aacccd770ffce557dc9f95734d1428276c54fa78e44b406567"} Jun 09 03:04:29.461298 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:29.460807 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-klhdv" event={"ID":"6dad5db3-bce6-4f82-8696-9c8b7afe16a3","Type":"ContainerStarted","Data":"7e0f06b671909c510b3084dc0dd0ddc7982b2f8d79d18e0920dec03cc9fae7dc"} Jun 09 03:04:29.461298 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:29.460848 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-klhdv" Jun 09 03:04:29.479596 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:29.479539 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-klhdv" podStartSLOduration=251.891857397 podStartE2EDuration="4m13.479518835s" totalImagesPullingTime="1.587661438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:04:29.477151125 +0000 UTC m=+286.476157808" watchObservedRunningTime="2026-06-09 03:04:29.479518835 +0000 UTC m=+286.478525282" Jun 09 03:04:34.609972 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:34.609931 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:34.705415 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:34.705374 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:35.575753 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:35.575722 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:35.676972 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:35.676934 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:36.423734 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.423702 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f798ff6b7-s7dzb"] Jun 09 03:04:36.427631 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.427606 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.438421 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.438395 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f798ff6b7-s7dzb"] Jun 09 03:04:36.470416 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.470386 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:36.571269 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.571235 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:36.576043 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.576016 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-trusted-ca-bundle\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.576195 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.576057 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq7jd\" (UniqueName: \"kubernetes.io/projected/3ea2a85d-f57b-4931-adb4-452ad355b9de-kube-api-access-lq7jd\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.576195 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.576084 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-service-ca\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.576195 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.576166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-serving-cert\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.576301 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.576222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-oauth-serving-cert\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.576301 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.576253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-oauth-config\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.576301 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.576288 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-config\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.677072 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.676967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-service-ca\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.677072 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.677038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-serving-cert\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.677637 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.677078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-oauth-serving-cert\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.677637 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.677105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-oauth-config\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.677637 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.677136 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-config\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.677637 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.677176 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-trusted-ca-bundle\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.677637 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.677219 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq7jd\" (UniqueName: \"kubernetes.io/projected/3ea2a85d-f57b-4931-adb4-452ad355b9de-kube-api-access-lq7jd\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.678396 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.678369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-service-ca\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.678601 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.678413 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-oauth-serving-cert\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.678601 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.678413 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-config\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.678768 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.678751 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-trusted-ca-bundle\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.680456 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.680429 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-oauth-config\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.680943 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.680920 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-serving-cert\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.686280 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.686254 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq7jd\" (UniqueName: \"kubernetes.io/projected/3ea2a85d-f57b-4931-adb4-452ad355b9de-kube-api-access-lq7jd\") pod \"console-f798ff6b7-s7dzb\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.738203 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.738168 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:36.903203 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:36.903178 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f798ff6b7-s7dzb"] Jun 09 03:04:37.494946 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:37.494913 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f798ff6b7-s7dzb" event={"ID":"3ea2a85d-f57b-4931-adb4-452ad355b9de","Type":"ContainerStarted","Data":"44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10"} Jun 09 03:04:37.495122 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:37.494961 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f798ff6b7-s7dzb" event={"ID":"3ea2a85d-f57b-4931-adb4-452ad355b9de","Type":"ContainerStarted","Data":"8ff6edccce2c0ede0784ff808a2e0126ca863e5641f953283164e0336f60e089"} Jun 09 03:04:37.512442 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:37.512392 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f798ff6b7-s7dzb" podStartSLOduration=1.512375518 podStartE2EDuration="1.512375518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:04:37.51080405 +0000 UTC m=+294.509810495" watchObservedRunningTime="2026-06-09 03:04:37.512375518 +0000 UTC m=+294.511381961" Jun 09 03:04:38.546567 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:38.546530 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:38.595515 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:38.595476 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:38.987930 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:38.987871 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bfd94bd8c-5xsk6" podUID="81068c68-7b3f-436d-a462-384925c1b674" containerName="console" containerID="cri-o://0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7" gracePeriod=15 Jun 09 03:04:39.242081 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.242015 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:04:39.297511 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.297466 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-service-ca\") pod \"81068c68-7b3f-436d-a462-384925c1b674\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " Jun 09 03:04:39.297697 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.297534 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-oauth-config\") pod \"81068c68-7b3f-436d-a462-384925c1b674\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " Jun 09 03:04:39.297697 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.297559 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-console-config\") pod \"81068c68-7b3f-436d-a462-384925c1b674\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " Jun 09 03:04:39.297697 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.297594 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-serving-cert\") pod \"81068c68-7b3f-436d-a462-384925c1b674\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " Jun 09 03:04:39.297697 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.297622 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n76s\" (UniqueName: \"kubernetes.io/projected/81068c68-7b3f-436d-a462-384925c1b674-kube-api-access-9n76s\") pod \"81068c68-7b3f-436d-a462-384925c1b674\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " Jun 09 03:04:39.297952 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.297924 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-service-ca" (OuterVolumeSpecName: "service-ca") pod "81068c68-7b3f-436d-a462-384925c1b674" (UID: "81068c68-7b3f-436d-a462-384925c1b674"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:04:39.297952 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.297941 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-console-config" (OuterVolumeSpecName: "console-config") pod "81068c68-7b3f-436d-a462-384925c1b674" (UID: "81068c68-7b3f-436d-a462-384925c1b674"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:04:39.299951 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.299900 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81068c68-7b3f-436d-a462-384925c1b674" (UID: "81068c68-7b3f-436d-a462-384925c1b674"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 03:04:39.300089 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.299994 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81068c68-7b3f-436d-a462-384925c1b674-kube-api-access-9n76s" (OuterVolumeSpecName: "kube-api-access-9n76s") pod "81068c68-7b3f-436d-a462-384925c1b674" (UID: "81068c68-7b3f-436d-a462-384925c1b674"). InnerVolumeSpecName "kube-api-access-9n76s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 03:04:39.300089 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.299970 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81068c68-7b3f-436d-a462-384925c1b674" (UID: "81068c68-7b3f-436d-a462-384925c1b674"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 03:04:39.398099 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.398059 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-oauth-serving-cert\") pod \"81068c68-7b3f-436d-a462-384925c1b674\" (UID: \"81068c68-7b3f-436d-a462-384925c1b674\") " Jun 09 03:04:39.398278 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.398189 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-oauth-config\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:04:39.398278 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.398200 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-console-config\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:04:39.398278 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.398210 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81068c68-7b3f-436d-a462-384925c1b674-console-serving-cert\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:04:39.398278 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.398218 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n76s\" (UniqueName: \"kubernetes.io/projected/81068c68-7b3f-436d-a462-384925c1b674-kube-api-access-9n76s\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:04:39.398278 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.398227 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-service-ca\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:04:39.398479 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.398455 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81068c68-7b3f-436d-a462-384925c1b674" (UID: "81068c68-7b3f-436d-a462-384925c1b674"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:04:39.466882 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.466846 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-klhdv" Jun 09 03:04:39.499285 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.499195 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81068c68-7b3f-436d-a462-384925c1b674-oauth-serving-cert\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:04:39.503764 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.503735 2568 generic.go:356] "Generic (PLEG): container finished" podID="81068c68-7b3f-436d-a462-384925c1b674" containerID="0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7" exitCode=0 Jun 09 03:04:39.503912 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.503789 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bfd94bd8c-5xsk6" Jun 09 03:04:39.503912 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.503796 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bfd94bd8c-5xsk6" event={"ID":"81068c68-7b3f-436d-a462-384925c1b674","Type":"ContainerDied","Data":"0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7"} Jun 09 03:04:39.503912 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.503859 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bfd94bd8c-5xsk6" event={"ID":"81068c68-7b3f-436d-a462-384925c1b674","Type":"ContainerDied","Data":"59b2e2c0ccd3f333b61db2e1af2535517e8bdba58a7fe0120348ff40ac504a02"} Jun 09 03:04:39.503912 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.503890 2568 scope.go:117] "RemoveContainer" containerID="0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7" Jun 09 03:04:39.514242 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.514215 2568 scope.go:117] "RemoveContainer" containerID="0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7" Jun 09 03:04:39.514602 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:04:39.514574 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7\": container with ID starting with 0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7 not found: ID does not exist" containerID="0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7" Jun 09 03:04:39.514748 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.514607 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7"} err="failed to get container status \"0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7\": rpc error: code = NotFound desc = could not find container \"0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7\": container with ID starting with 0c1647cf81538e27a7b733fe96592aa62bad4088d64e9b5ab6c4ff340bc1e8f7 not found: ID does not exist" Jun 09 03:04:39.519366 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.519341 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bfd94bd8c-5xsk6"] Jun 09 03:04:39.522952 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:39.522929 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bfd94bd8c-5xsk6"] Jun 09 03:04:41.414708 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:41.414676 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81068c68-7b3f-436d-a462-384925c1b674" path="/var/lib/kubelet/pods/81068c68-7b3f-436d-a462-384925c1b674/volumes" Jun 09 03:04:43.349164 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:43.349134 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:04:43.351602 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:43.351572 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:04:43.355916 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:43.355893 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:04:43.363153 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:43.358679 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:04:43.367975 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:43.367955 2568 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 03:04:46.738355 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:46.738289 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:46.738355 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:46.738373 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:46.742963 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:46.742938 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:47.539650 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:47.539618 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:04:47.582048 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:47.582006 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665ccd6775-6scnt"] Jun 09 03:04:47.678749 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:47.678698 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:47.735394 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:47.735365 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:47.788993 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:47.788954 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:48.577019 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:48.576987 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:48.623454 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:48.623419 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:53.545159 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:53.545113 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:04:53.594584 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:04:53.594527 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:12.605534 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.605443 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-665ccd6775-6scnt" podUID="7aca83d8-b984-4939-b36e-c0dc680a4ab3" containerName="console" containerID="cri-o://56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda" gracePeriod=15 Jun 09 03:05:12.844132 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.844104 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:05:12.982485 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.982436 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-serving-cert\") pod \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " Jun 09 03:05:12.982485 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.982519 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-trusted-ca-bundle\") pod \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " Jun 09 03:05:12.982774 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.982545 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-oauth-config\") pod \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " Jun 09 03:05:12.982774 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.982575 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-oauth-serving-cert\") pod \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " Jun 09 03:05:12.982774 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.982607 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl2p7\" (UniqueName: \"kubernetes.io/projected/7aca83d8-b984-4939-b36e-c0dc680a4ab3-kube-api-access-sl2p7\") pod \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " Jun 09 03:05:12.982774 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.982634 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-config\") pod \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " Jun 09 03:05:12.982774 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.982685 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-service-ca\") pod \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\" (UID: \"7aca83d8-b984-4939-b36e-c0dc680a4ab3\") " Jun 09 03:05:12.983043 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.982991 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7aca83d8-b984-4939-b36e-c0dc680a4ab3" (UID: "7aca83d8-b984-4939-b36e-c0dc680a4ab3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:05:12.983131 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.983088 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7aca83d8-b984-4939-b36e-c0dc680a4ab3" (UID: "7aca83d8-b984-4939-b36e-c0dc680a4ab3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:05:12.983131 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.983131 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-service-ca" (OuterVolumeSpecName: "service-ca") pod "7aca83d8-b984-4939-b36e-c0dc680a4ab3" (UID: "7aca83d8-b984-4939-b36e-c0dc680a4ab3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:05:12.983348 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.983161 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-config" (OuterVolumeSpecName: "console-config") pod "7aca83d8-b984-4939-b36e-c0dc680a4ab3" (UID: "7aca83d8-b984-4939-b36e-c0dc680a4ab3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:05:12.984808 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.984775 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aca83d8-b984-4939-b36e-c0dc680a4ab3-kube-api-access-sl2p7" (OuterVolumeSpecName: "kube-api-access-sl2p7") pod "7aca83d8-b984-4939-b36e-c0dc680a4ab3" (UID: "7aca83d8-b984-4939-b36e-c0dc680a4ab3"). InnerVolumeSpecName "kube-api-access-sl2p7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 03:05:12.984906 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.984832 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7aca83d8-b984-4939-b36e-c0dc680a4ab3" (UID: "7aca83d8-b984-4939-b36e-c0dc680a4ab3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 03:05:12.984906 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:12.984869 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7aca83d8-b984-4939-b36e-c0dc680a4ab3" (UID: "7aca83d8-b984-4939-b36e-c0dc680a4ab3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 03:05:13.083786 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.083749 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-serving-cert\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:05:13.083786 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.083779 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-trusted-ca-bundle\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:05:13.083786 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.083789 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-oauth-config\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:05:13.083786 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.083797 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-oauth-serving-cert\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:05:13.084053 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.083807 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl2p7\" (UniqueName: \"kubernetes.io/projected/7aca83d8-b984-4939-b36e-c0dc680a4ab3-kube-api-access-sl2p7\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:05:13.084053 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.083817 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-console-config\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:05:13.084053 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.083825 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7aca83d8-b984-4939-b36e-c0dc680a4ab3-service-ca\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:05:13.635196 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.635157 2568 generic.go:356] "Generic (PLEG): container finished" podID="7aca83d8-b984-4939-b36e-c0dc680a4ab3" containerID="56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda" exitCode=0 Jun 09 03:05:13.635703 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.635205 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665ccd6775-6scnt" Jun 09 03:05:13.635703 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.635245 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665ccd6775-6scnt" event={"ID":"7aca83d8-b984-4939-b36e-c0dc680a4ab3","Type":"ContainerDied","Data":"56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda"} Jun 09 03:05:13.635703 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.635294 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665ccd6775-6scnt" event={"ID":"7aca83d8-b984-4939-b36e-c0dc680a4ab3","Type":"ContainerDied","Data":"268e36889cda92f7d1116be8e0d308e3c0bf276d5aa2f68a5b736c5e2f533700"} Jun 09 03:05:13.635703 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.635325 2568 scope.go:117] "RemoveContainer" containerID="56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda" Jun 09 03:05:13.643534 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.643517 2568 scope.go:117] "RemoveContainer" containerID="56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda" Jun 09 03:05:13.643814 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:05:13.643793 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda\": container with ID starting with 56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda not found: ID does not exist" containerID="56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda" Jun 09 03:05:13.643882 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.643822 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda"} err="failed to get container status \"56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda\": rpc error: code = NotFound desc = could not find container \"56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda\": container with ID starting with 56f5d15a82cd15273b8438506ba9d0e46035084a429f3a9eccf6ed31ab688dda not found: ID does not exist" Jun 09 03:05:13.651621 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.651596 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665ccd6775-6scnt"] Jun 09 03:05:13.654775 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:13.654747 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-665ccd6775-6scnt"] Jun 09 03:05:14.088248 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:14.088212 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:15.414742 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:15.414708 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aca83d8-b984-4939-b36e-c0dc680a4ab3" path="/var/lib/kubelet/pods/7aca83d8-b984-4939-b36e-c0dc680a4ab3/volumes" Jun 09 03:05:26.182920 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:26.182840 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:42.639143 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:42.639103 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:42.685067 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:42.685033 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:44.844416 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.844380 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f4db9fc87-7wd4b"] Jun 09 03:05:44.844796 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.844732 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81068c68-7b3f-436d-a462-384925c1b674" containerName="console" Jun 09 03:05:44.844796 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.844745 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="81068c68-7b3f-436d-a462-384925c1b674" containerName="console" Jun 09 03:05:44.844796 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.844753 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aca83d8-b984-4939-b36e-c0dc680a4ab3" containerName="console" Jun 09 03:05:44.844796 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.844758 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aca83d8-b984-4939-b36e-c0dc680a4ab3" containerName="console" Jun 09 03:05:44.844918 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.844818 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aca83d8-b984-4939-b36e-c0dc680a4ab3" containerName="console" Jun 09 03:05:44.844918 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.844830 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="81068c68-7b3f-436d-a462-384925c1b674" containerName="console" Jun 09 03:05:44.849643 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.849621 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:44.860201 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.860176 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f4db9fc87-7wd4b"] Jun 09 03:05:44.883145 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.883108 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:44.931459 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.931426 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:44.932926 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.932907 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-trusted-ca-bundle\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:44.933003 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.932936 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-serving-cert\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:44.933003 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.932956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-config\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:44.933084 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.933030 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-oauth-config\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:44.933084 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.933071 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-service-ca\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:44.933160 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.933099 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-oauth-serving-cert\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:44.933195 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:44.933162 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8v6m\" (UniqueName: \"kubernetes.io/projected/b250a422-3eb6-45b2-b309-3573ab1ad3aa-kube-api-access-h8v6m\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.033556 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.033517 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8v6m\" (UniqueName: \"kubernetes.io/projected/b250a422-3eb6-45b2-b309-3573ab1ad3aa-kube-api-access-h8v6m\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.033556 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.033562 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-trusted-ca-bundle\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.033849 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.033581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-serving-cert\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.033849 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.033599 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-config\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.033849 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.033624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-oauth-config\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.033849 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.033647 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-service-ca\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.033849 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.033667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-oauth-serving-cert\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.034464 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.034441 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-service-ca\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.034597 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.034544 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-trusted-ca-bundle\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.034597 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.034567 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-config\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.034670 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.034648 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-oauth-serving-cert\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.036107 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.036088 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-oauth-config\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.036283 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.036265 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-serving-cert\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.041314 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.041295 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8v6m\" (UniqueName: \"kubernetes.io/projected/b250a422-3eb6-45b2-b309-3573ab1ad3aa-kube-api-access-h8v6m\") pod \"console-7f4db9fc87-7wd4b\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.159270 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.159174 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:45.299793 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.299761 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f4db9fc87-7wd4b"] Jun 09 03:05:45.303075 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:05:45.303052 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb250a422_3eb6_45b2_b309_3573ab1ad3aa.slice/crio-28370b137eddc28d96fc2f7ecf499779ae5b1c10d1a7c574be607619db90cab9 WatchSource:0}: Error finding container 28370b137eddc28d96fc2f7ecf499779ae5b1c10d1a7c574be607619db90cab9: Status 404 returned error can't find the container with id 28370b137eddc28d96fc2f7ecf499779ae5b1c10d1a7c574be607619db90cab9 Jun 09 03:05:45.758484 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.758447 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4db9fc87-7wd4b" event={"ID":"b250a422-3eb6-45b2-b309-3573ab1ad3aa","Type":"ContainerStarted","Data":"e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69"} Jun 09 03:05:45.758725 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.758559 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4db9fc87-7wd4b" event={"ID":"b250a422-3eb6-45b2-b309-3573ab1ad3aa","Type":"ContainerStarted","Data":"28370b137eddc28d96fc2f7ecf499779ae5b1c10d1a7c574be607619db90cab9"} Jun 09 03:05:45.775409 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:45.775349 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f4db9fc87-7wd4b" podStartSLOduration=1.775332873 podStartE2EDuration="1.775332873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:05:45.774742137 +0000 UTC m=+362.773748581" watchObservedRunningTime="2026-06-09 03:05:45.775332873 +0000 UTC m=+362.774339317" Jun 09 03:05:53.349449 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:53.349416 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:54.563031 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:54.562995 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:54.612775 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:54.612747 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:55.159925 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:55.159894 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:55.160117 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:55.160045 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:55.164777 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:55.164756 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:55.801167 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:55.801140 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:05:55.842915 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:55.842882 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f798ff6b7-s7dzb"] Jun 09 03:05:55.935677 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:55.935628 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:55.980577 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:55.980542 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:56.036593 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:56.036555 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:05:56.137130 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:05:56.137042 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:06:08.556794 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:08.556759 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:06:08.656746 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:08.656708 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:06:08.959613 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:08.959574 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:06:20.863262 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:20.863216 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f798ff6b7-s7dzb" podUID="3ea2a85d-f57b-4931-adb4-452ad355b9de" containerName="console" containerID="cri-o://44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10" gracePeriod=15 Jun 09 03:06:21.120974 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.120947 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:06:21.244942 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.244903 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq7jd\" (UniqueName: \"kubernetes.io/projected/3ea2a85d-f57b-4931-adb4-452ad355b9de-kube-api-access-lq7jd\") pod \"3ea2a85d-f57b-4931-adb4-452ad355b9de\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " Jun 09 03:06:21.245130 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.244952 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-config\") pod \"3ea2a85d-f57b-4931-adb4-452ad355b9de\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " Jun 09 03:06:21.245130 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.244988 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-trusted-ca-bundle\") pod \"3ea2a85d-f57b-4931-adb4-452ad355b9de\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " Jun 09 03:06:21.245130 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.245020 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-serving-cert\") pod \"3ea2a85d-f57b-4931-adb4-452ad355b9de\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " Jun 09 03:06:21.245130 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.245053 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-service-ca\") pod \"3ea2a85d-f57b-4931-adb4-452ad355b9de\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " Jun 09 03:06:21.245130 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.245091 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-oauth-serving-cert\") pod \"3ea2a85d-f57b-4931-adb4-452ad355b9de\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " Jun 09 03:06:21.245130 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.245117 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-oauth-config\") pod \"3ea2a85d-f57b-4931-adb4-452ad355b9de\" (UID: \"3ea2a85d-f57b-4931-adb4-452ad355b9de\") " Jun 09 03:06:21.245574 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.245538 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-config" (OuterVolumeSpecName: "console-config") pod "3ea2a85d-f57b-4931-adb4-452ad355b9de" (UID: "3ea2a85d-f57b-4931-adb4-452ad355b9de"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:06:21.245574 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.245546 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-service-ca" (OuterVolumeSpecName: "service-ca") pod "3ea2a85d-f57b-4931-adb4-452ad355b9de" (UID: "3ea2a85d-f57b-4931-adb4-452ad355b9de"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:06:21.245759 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.245552 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3ea2a85d-f57b-4931-adb4-452ad355b9de" (UID: "3ea2a85d-f57b-4931-adb4-452ad355b9de"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:06:21.245759 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.245565 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3ea2a85d-f57b-4931-adb4-452ad355b9de" (UID: "3ea2a85d-f57b-4931-adb4-452ad355b9de"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:06:21.247166 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.247138 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3ea2a85d-f57b-4931-adb4-452ad355b9de" (UID: "3ea2a85d-f57b-4931-adb4-452ad355b9de"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 03:06:21.247642 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.247620 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3ea2a85d-f57b-4931-adb4-452ad355b9de" (UID: "3ea2a85d-f57b-4931-adb4-452ad355b9de"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 03:06:21.247642 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.247631 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ea2a85d-f57b-4931-adb4-452ad355b9de-kube-api-access-lq7jd" (OuterVolumeSpecName: "kube-api-access-lq7jd") pod "3ea2a85d-f57b-4931-adb4-452ad355b9de" (UID: "3ea2a85d-f57b-4931-adb4-452ad355b9de"). InnerVolumeSpecName "kube-api-access-lq7jd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 03:06:21.345940 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.345853 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq7jd\" (UniqueName: \"kubernetes.io/projected/3ea2a85d-f57b-4931-adb4-452ad355b9de-kube-api-access-lq7jd\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:06:21.345940 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.345886 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-config\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:06:21.345940 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.345900 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-trusted-ca-bundle\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:06:21.345940 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.345916 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-serving-cert\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:06:21.345940 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.345929 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-service-ca\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:06:21.345940 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.345943 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ea2a85d-f57b-4931-adb4-452ad355b9de-oauth-serving-cert\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:06:21.346232 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.345955 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ea2a85d-f57b-4931-adb4-452ad355b9de-console-oauth-config\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:06:21.903253 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.903213 2568 generic.go:356] "Generic (PLEG): container finished" podID="3ea2a85d-f57b-4931-adb4-452ad355b9de" containerID="44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10" exitCode=0 Jun 09 03:06:21.903742 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.903264 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f798ff6b7-s7dzb" Jun 09 03:06:21.903742 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.903300 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f798ff6b7-s7dzb" event={"ID":"3ea2a85d-f57b-4931-adb4-452ad355b9de","Type":"ContainerDied","Data":"44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10"} Jun 09 03:06:21.903742 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.903366 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f798ff6b7-s7dzb" event={"ID":"3ea2a85d-f57b-4931-adb4-452ad355b9de","Type":"ContainerDied","Data":"8ff6edccce2c0ede0784ff808a2e0126ca863e5641f953283164e0336f60e089"} Jun 09 03:06:21.903742 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.903409 2568 scope.go:117] "RemoveContainer" containerID="44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10" Jun 09 03:06:21.911671 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.911650 2568 scope.go:117] "RemoveContainer" containerID="44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10" Jun 09 03:06:21.911922 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:06:21.911903 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10\": container with ID starting with 44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10 not found: ID does not exist" containerID="44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10" Jun 09 03:06:21.911989 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.911930 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10"} err="failed to get container status \"44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10\": rpc error: code = NotFound desc = could not find container \"44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10\": container with ID starting with 44c864b5fc0af268eee590acec40d94b51c2dbe40c79fa042210a6e5d8cdfa10 not found: ID does not exist" Jun 09 03:06:21.919202 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.919176 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f798ff6b7-s7dzb"] Jun 09 03:06:21.922350 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:21.922320 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f798ff6b7-s7dzb"] Jun 09 03:06:23.416127 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:23.416091 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ea2a85d-f57b-4931-adb4-452ad355b9de" path="/var/lib/kubelet/pods/3ea2a85d-f57b-4931-adb4-452ad355b9de/volumes" Jun 09 03:06:48.012851 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:48.012813 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:06:48.113853 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:06:48.113817 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:18.976397 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:18.976354 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:20.338804 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:20.338756 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:22.592668 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:22.592628 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:22.638706 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:22.638668 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:24.760299 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:24.760248 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:24.859869 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:24.859829 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:25.596778 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:25.596742 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:26.797603 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:26.797568 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:27.129789 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.129711 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-q5s68"] Jun 09 03:07:27.130006 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.129994 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea2a85d-f57b-4931-adb4-452ad355b9de" containerName="console" Jun 09 03:07:27.130047 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.130009 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea2a85d-f57b-4931-adb4-452ad355b9de" containerName="console" Jun 09 03:07:27.130082 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.130069 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ea2a85d-f57b-4931-adb4-452ad355b9de" containerName="console" Jun 09 03:07:27.132913 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.132895 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" Jun 09 03:07:27.136115 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.136092 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6wzx5\"" Jun 09 03:07:27.136396 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.136380 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 03:07:27.137539 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.137525 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 03:07:27.148921 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.148897 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-q5s68"] Jun 09 03:07:27.257425 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.257393 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsgbs\" (UniqueName: \"kubernetes.io/projected/e318e7a9-0b62-47a3-af7d-7552737b4f10-kube-api-access-fsgbs\") pod \"cert-manager-webhook-7dc76cbb94-q5s68\" (UID: \"e318e7a9-0b62-47a3-af7d-7552737b4f10\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" Jun 09 03:07:27.257619 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.257444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e318e7a9-0b62-47a3-af7d-7552737b4f10-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-q5s68\" (UID: \"e318e7a9-0b62-47a3-af7d-7552737b4f10\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" Jun 09 03:07:27.357996 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.357953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsgbs\" (UniqueName: \"kubernetes.io/projected/e318e7a9-0b62-47a3-af7d-7552737b4f10-kube-api-access-fsgbs\") pod \"cert-manager-webhook-7dc76cbb94-q5s68\" (UID: \"e318e7a9-0b62-47a3-af7d-7552737b4f10\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" Jun 09 03:07:27.358168 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.358015 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e318e7a9-0b62-47a3-af7d-7552737b4f10-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-q5s68\" (UID: \"e318e7a9-0b62-47a3-af7d-7552737b4f10\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" Jun 09 03:07:27.366313 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.366276 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e318e7a9-0b62-47a3-af7d-7552737b4f10-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-q5s68\" (UID: \"e318e7a9-0b62-47a3-af7d-7552737b4f10\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" Jun 09 03:07:27.366520 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.366453 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsgbs\" (UniqueName: \"kubernetes.io/projected/e318e7a9-0b62-47a3-af7d-7552737b4f10-kube-api-access-fsgbs\") pod \"cert-manager-webhook-7dc76cbb94-q5s68\" (UID: \"e318e7a9-0b62-47a3-af7d-7552737b4f10\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" Jun 09 03:07:27.456504 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.456472 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" Jun 09 03:07:27.588111 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.583349 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-q5s68"] Jun 09 03:07:27.589158 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:27.589133 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 03:07:28.071050 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:28.071010 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:28.157226 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:28.157194 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" event={"ID":"e318e7a9-0b62-47a3-af7d-7552737b4f10","Type":"ContainerStarted","Data":"1f3f60c88ac0ceae4563a7feaca5a3858e9b6cb8b2b6ced441ccf7322fa25531"} Jun 09 03:07:28.862742 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:28.862673 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:29.783909 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:29.783864 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:29.884844 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:29.884807 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:31.173299 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:31.173263 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" event={"ID":"e318e7a9-0b62-47a3-af7d-7552737b4f10","Type":"ContainerStarted","Data":"92001294ededef379205f11966268b38d20f27e5b9f16ae9a74bb7501c8d761a"} Jun 09 03:07:31.173721 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:31.173335 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" Jun 09 03:07:31.189476 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:31.189417 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" podStartSLOduration=1.123477605 podStartE2EDuration="4.189403324s" totalImagesPullingTime="3.065925719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:07:31.188012423 +0000 UTC m=+468.187018867" watchObservedRunningTime="2026-06-09 03:07:31.189403324 +0000 UTC m=+468.188409769" Jun 09 03:07:35.288921 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:35.288889 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:35.391988 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:35.391957 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:36.472282 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:36.472252 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:36.798488 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:36.798401 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:36.895533 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:36.895474 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:37.179046 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:37.179016 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-q5s68" Jun 09 03:07:43.984015 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:43.983983 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:44.083706 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:44.083675 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:45.572020 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.571983 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-rx75n"] Jun 09 03:07:45.578446 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.578419 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-rx75n" Jun 09 03:07:45.580790 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.580766 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lrllv\"" Jun 09 03:07:45.583802 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.583772 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-rx75n"] Jun 09 03:07:45.707622 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.707581 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kws6n\" (UniqueName: \"kubernetes.io/projected/bf2560fe-6e28-41ec-9d30-e84d3cf31574-kube-api-access-kws6n\") pod \"cert-manager-59c77684cc-rx75n\" (UID: \"bf2560fe-6e28-41ec-9d30-e84d3cf31574\") " pod="cert-manager/cert-manager-59c77684cc-rx75n" Jun 09 03:07:45.707809 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.707661 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf2560fe-6e28-41ec-9d30-e84d3cf31574-bound-sa-token\") pod \"cert-manager-59c77684cc-rx75n\" (UID: \"bf2560fe-6e28-41ec-9d30-e84d3cf31574\") " pod="cert-manager/cert-manager-59c77684cc-rx75n" Jun 09 03:07:45.808881 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.808848 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf2560fe-6e28-41ec-9d30-e84d3cf31574-bound-sa-token\") pod \"cert-manager-59c77684cc-rx75n\" (UID: \"bf2560fe-6e28-41ec-9d30-e84d3cf31574\") " pod="cert-manager/cert-manager-59c77684cc-rx75n" Jun 09 03:07:45.809042 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.808905 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kws6n\" (UniqueName: \"kubernetes.io/projected/bf2560fe-6e28-41ec-9d30-e84d3cf31574-kube-api-access-kws6n\") pod \"cert-manager-59c77684cc-rx75n\" (UID: \"bf2560fe-6e28-41ec-9d30-e84d3cf31574\") " pod="cert-manager/cert-manager-59c77684cc-rx75n" Jun 09 03:07:45.816361 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.816332 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf2560fe-6e28-41ec-9d30-e84d3cf31574-bound-sa-token\") pod \"cert-manager-59c77684cc-rx75n\" (UID: \"bf2560fe-6e28-41ec-9d30-e84d3cf31574\") " pod="cert-manager/cert-manager-59c77684cc-rx75n" Jun 09 03:07:45.816512 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.816474 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kws6n\" (UniqueName: \"kubernetes.io/projected/bf2560fe-6e28-41ec-9d30-e84d3cf31574-kube-api-access-kws6n\") pod \"cert-manager-59c77684cc-rx75n\" (UID: \"bf2560fe-6e28-41ec-9d30-e84d3cf31574\") " pod="cert-manager/cert-manager-59c77684cc-rx75n" Jun 09 03:07:45.873808 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.873714 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:45.888206 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:45.888176 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-rx75n" Jun 09 03:07:46.018482 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:46.018277 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-rx75n"] Jun 09 03:07:46.021244 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:07:46.021219 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf2560fe_6e28_41ec_9d30_e84d3cf31574.slice/crio-4e077e0238bddde61f0cb61d4f16f5e08cb039a48577dc2fc9d2ce15b72b0cbb WatchSource:0}: Error finding container 4e077e0238bddde61f0cb61d4f16f5e08cb039a48577dc2fc9d2ce15b72b0cbb: Status 404 returned error can't find the container with id 4e077e0238bddde61f0cb61d4f16f5e08cb039a48577dc2fc9d2ce15b72b0cbb Jun 09 03:07:46.155361 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:46.155272 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:07:46.233097 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:46.233062 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-rx75n" event={"ID":"bf2560fe-6e28-41ec-9d30-e84d3cf31574","Type":"ContainerStarted","Data":"d0d4b2392aa40133609878789f436bc4cddc215ad98cd7e075d8a15f5230e714"} Jun 09 03:07:46.233292 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:46.233103 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-rx75n" event={"ID":"bf2560fe-6e28-41ec-9d30-e84d3cf31574","Type":"ContainerStarted","Data":"4e077e0238bddde61f0cb61d4f16f5e08cb039a48577dc2fc9d2ce15b72b0cbb"} Jun 09 03:07:46.252139 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:07:46.252082 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-rx75n" podStartSLOduration=1.252064562 podStartE2EDuration="1.252064562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:07:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:07:46.251165868 +0000 UTC m=+483.250172315" watchObservedRunningTime="2026-06-09 03:07:46.252064562 +0000 UTC m=+483.251071007" Jun 09 03:08:01.392106 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:01.392067 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:01.506107 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:01.506067 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:02.017097 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.017067 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:02.188990 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.188955 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:02.290240 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.290157 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:02.317708 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.317677 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq"] Jun 09 03:08:02.320923 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.320905 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.325675 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.325653 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 03:08:02.327729 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.327700 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 03:08:02.327864 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.327757 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 03:08:02.327864 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.327706 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vl2w5\"" Jun 09 03:08:02.327864 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.327829 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 03:08:02.339216 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.339186 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq"] Jun 09 03:08:02.350211 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.350182 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07949c29-71bf-4662-8767-3cd3373294fd-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.350353 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.350227 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07949c29-71bf-4662-8767-3cd3373294fd-tmp\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.350353 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.350246 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07949c29-71bf-4662-8767-3cd3373294fd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.350353 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.350290 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg4z2\" (UniqueName: \"kubernetes.io/projected/07949c29-71bf-4662-8767-3cd3373294fd-kube-api-access-mg4z2\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.350353 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.350320 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07949c29-71bf-4662-8767-3cd3373294fd-manifests\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.429423 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.429379 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:02.451261 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.451212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07949c29-71bf-4662-8767-3cd3373294fd-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.451261 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.451263 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07949c29-71bf-4662-8767-3cd3373294fd-tmp\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.451425 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.451378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07949c29-71bf-4662-8767-3cd3373294fd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.451469 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.451432 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4z2\" (UniqueName: \"kubernetes.io/projected/07949c29-71bf-4662-8767-3cd3373294fd-kube-api-access-mg4z2\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.451529 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.451480 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07949c29-71bf-4662-8767-3cd3373294fd-manifests\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.451887 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.451866 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07949c29-71bf-4662-8767-3cd3373294fd-manifests\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.453463 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.453436 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07949c29-71bf-4662-8767-3cd3373294fd-tmp\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.453726 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.453710 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07949c29-71bf-4662-8767-3cd3373294fd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.453796 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.453732 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07949c29-71bf-4662-8767-3cd3373294fd-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.459453 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.459429 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg4z2\" (UniqueName: \"kubernetes.io/projected/07949c29-71bf-4662-8767-3cd3373294fd-kube-api-access-mg4z2\") pod \"opendatahub-operator-controller-manager-86bfbb9599-jl7mq\" (UID: \"07949c29-71bf-4662-8767-3cd3373294fd\") " pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.530802 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.530759 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:02.631331 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.631246 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:02.631543 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.631380 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:02.732477 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.732442 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:02.775624 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.775522 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq"] Jun 09 03:08:02.778506 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:08:02.778460 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07949c29_71bf_4662_8767_3cd3373294fd.slice/crio-9937d6d4cce81cb2431d9753c29c6d7edbc8f065cfd121b4885baef6847b207b WatchSource:0}: Error finding container 9937d6d4cce81cb2431d9753c29c6d7edbc8f065cfd121b4885baef6847b207b: Status 404 returned error can't find the container with id 9937d6d4cce81cb2431d9753c29c6d7edbc8f065cfd121b4885baef6847b207b Jun 09 03:08:02.839389 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.839356 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:02.931817 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:02.931779 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:03.032701 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:03.032668 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:03.303166 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:03.303067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" event={"ID":"07949c29-71bf-4662-8767-3cd3373294fd","Type":"ContainerStarted","Data":"9937d6d4cce81cb2431d9753c29c6d7edbc8f065cfd121b4885baef6847b207b"} Jun 09 03:08:06.319949 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:06.319906 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" event={"ID":"07949c29-71bf-4662-8767-3cd3373294fd","Type":"ContainerStarted","Data":"2ff8e8250d2d6bf174f5725f4ee2e13b0e0abb5e71c1da390d059a9d5494068f"} Jun 09 03:08:06.922229 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:06.922197 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:07.022770 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:07.022734 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:07.325566 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:07.325464 2568 generic.go:356] "Generic (PLEG): container finished" podID="07949c29-71bf-4662-8767-3cd3373294fd" containerID="2ff8e8250d2d6bf174f5725f4ee2e13b0e0abb5e71c1da390d059a9d5494068f" exitCode=0 Jun 09 03:08:07.325566 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:07.325523 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" event={"ID":"07949c29-71bf-4662-8767-3cd3373294fd","Type":"ContainerDied","Data":"2ff8e8250d2d6bf174f5725f4ee2e13b0e0abb5e71c1da390d059a9d5494068f"} Jun 09 03:08:08.332103 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:08.332068 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" event={"ID":"07949c29-71bf-4662-8767-3cd3373294fd","Type":"ContainerStarted","Data":"01a31692ca409b2b6eb7cfbe5c0c62e011b8441506ed9e9b926f9512c96920ec"} Jun 09 03:08:08.332469 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:08.332157 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:08.354566 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:08.354491 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" podStartSLOduration=2.270389368 podStartE2EDuration="6.35447143s" totalImagesPullingTime="3.13994608s" totalInitContainerRuntime="944.135982ms" isStatefulPod=false podCreationTimestamp="2026-06-09 03:08:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:08:08.352968673 +0000 UTC m=+505.351975140" watchObservedRunningTime="2026-06-09 03:08:08.35447143 +0000 UTC m=+505.353477874" Jun 09 03:08:11.437991 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:11.437954 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:11.487919 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:11.487882 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:13.488987 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:13.488952 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:13.589454 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:13.589418 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:19.340967 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:19.340936 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86bfbb9599-jl7mq" Jun 09 03:08:20.976642 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:20.976604 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:21.076163 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.076087 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:21.209694 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.209658 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:21.305305 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.305270 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:21.397710 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.397612 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:21.415381 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.415350 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm"] Jun 09 03:08:21.428463 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.428433 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm"] Jun 09 03:08:21.428653 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.428561 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.431231 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.431212 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 03:08:21.431408 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.431213 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 03:08:21.431408 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.431258 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vmv7m\"" Jun 09 03:08:21.431408 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.431309 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 03:08:21.431589 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.431515 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 03:08:21.512406 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.512365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5d6529d-21ff-4bb5-8d0f-8f2d433d0443-tmp\") pod \"kube-auth-proxy-86bb47f4b7-tmbpm\" (UID: \"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443\") " pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.512632 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.512457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5d6529d-21ff-4bb5-8d0f-8f2d433d0443-tls-certs\") pod \"kube-auth-proxy-86bb47f4b7-tmbpm\" (UID: \"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443\") " pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.512632 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.512485 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xq99\" (UniqueName: \"kubernetes.io/projected/e5d6529d-21ff-4bb5-8d0f-8f2d433d0443-kube-api-access-6xq99\") pod \"kube-auth-proxy-86bb47f4b7-tmbpm\" (UID: \"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443\") " pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.557794 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.557757 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:21.558524 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.558486 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-2bhpm"] Jun 09 03:08:21.561809 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.561791 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:21.564272 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.564250 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 03:08:21.564380 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.564319 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cw8k4\"" Jun 09 03:08:21.571981 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.571961 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-2bhpm"] Jun 09 03:08:21.613249 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.613213 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf5390d0-c41f-446b-bec8-1259c9e7ae05-cert\") pod \"odh-model-controller-6dc94f689f-2bhpm\" (UID: \"bf5390d0-c41f-446b-bec8-1259c9e7ae05\") " pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:21.613439 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.613275 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5d6529d-21ff-4bb5-8d0f-8f2d433d0443-tls-certs\") pod \"kube-auth-proxy-86bb47f4b7-tmbpm\" (UID: \"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443\") " pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.613439 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.613344 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xq99\" (UniqueName: \"kubernetes.io/projected/e5d6529d-21ff-4bb5-8d0f-8f2d433d0443-kube-api-access-6xq99\") pod \"kube-auth-proxy-86bb47f4b7-tmbpm\" (UID: \"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443\") " pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.613439 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.613387 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5d6529d-21ff-4bb5-8d0f-8f2d433d0443-tmp\") pod \"kube-auth-proxy-86bb47f4b7-tmbpm\" (UID: \"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443\") " pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.613655 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.613444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxth2\" (UniqueName: \"kubernetes.io/projected/bf5390d0-c41f-446b-bec8-1259c9e7ae05-kube-api-access-jxth2\") pod \"odh-model-controller-6dc94f689f-2bhpm\" (UID: \"bf5390d0-c41f-446b-bec8-1259c9e7ae05\") " pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:21.616133 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.616102 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5d6529d-21ff-4bb5-8d0f-8f2d433d0443-tmp\") pod \"kube-auth-proxy-86bb47f4b7-tmbpm\" (UID: \"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443\") " pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.616468 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.616445 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5d6529d-21ff-4bb5-8d0f-8f2d433d0443-tls-certs\") pod \"kube-auth-proxy-86bb47f4b7-tmbpm\" (UID: \"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443\") " pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.621043 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.621014 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xq99\" (UniqueName: \"kubernetes.io/projected/e5d6529d-21ff-4bb5-8d0f-8f2d433d0443-kube-api-access-6xq99\") pod \"kube-auth-proxy-86bb47f4b7-tmbpm\" (UID: \"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443\") " pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.650524 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.650428 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:21.714505 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.714465 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxth2\" (UniqueName: \"kubernetes.io/projected/bf5390d0-c41f-446b-bec8-1259c9e7ae05-kube-api-access-jxth2\") pod \"odh-model-controller-6dc94f689f-2bhpm\" (UID: \"bf5390d0-c41f-446b-bec8-1259c9e7ae05\") " pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:21.714672 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.714566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf5390d0-c41f-446b-bec8-1259c9e7ae05-cert\") pod \"odh-model-controller-6dc94f689f-2bhpm\" (UID: \"bf5390d0-c41f-446b-bec8-1259c9e7ae05\") " pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:21.714744 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:08:21.714724 2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 03:08:21.714812 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:08:21.714802 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf5390d0-c41f-446b-bec8-1259c9e7ae05-cert podName:bf5390d0-c41f-446b-bec8-1259c9e7ae05 nodeName:}" failed. No retries permitted until 2026-06-09 03:08:22.214782778 +0000 UTC m=+519.213789204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf5390d0-c41f-446b-bec8-1259c9e7ae05-cert") pod "odh-model-controller-6dc94f689f-2bhpm" (UID: "bf5390d0-c41f-446b-bec8-1259c9e7ae05") : secret "odh-model-controller-webhook-cert" not found Jun 09 03:08:21.725161 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.725129 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxth2\" (UniqueName: \"kubernetes.io/projected/bf5390d0-c41f-446b-bec8-1259c9e7ae05-kube-api-access-jxth2\") pod \"odh-model-controller-6dc94f689f-2bhpm\" (UID: \"bf5390d0-c41f-446b-bec8-1259c9e7ae05\") " pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:21.738958 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.738928 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" Jun 09 03:08:21.752663 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.752587 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:21.844981 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.844923 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:21.870125 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.870045 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm"] Jun 09 03:08:21.873335 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:08:21.873311 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d6529d_21ff_4bb5_8d0f_8f2d433d0443.slice/crio-ebbbb773bedd257ad50f19a63d12979bb3584ddcb3a26e9355305e6c1fce91e5 WatchSource:0}: Error finding container ebbbb773bedd257ad50f19a63d12979bb3584ddcb3a26e9355305e6c1fce91e5: Status 404 returned error can't find the container with id ebbbb773bedd257ad50f19a63d12979bb3584ddcb3a26e9355305e6c1fce91e5 Jun 09 03:08:21.937989 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.937958 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:21.981569 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.981541 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-fhv8m"] Jun 09 03:08:21.986020 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.986000 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:21.988370 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.988347 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 03:08:21.988487 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.988416 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-4q4fb\"" Jun 09 03:08:21.995651 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:21.995627 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-fhv8m"] Jun 09 03:08:22.118739 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.118694 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mkkl\" (UniqueName: \"kubernetes.io/projected/8c11ee0e-817e-4a08-9425-cc14e9f01368-kube-api-access-5mkkl\") pod \"model-serving-api-5dd488fc48-fhv8m\" (UID: \"8c11ee0e-817e-4a08-9425-cc14e9f01368\") " pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:22.118891 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.118772 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c11ee0e-817e-4a08-9425-cc14e9f01368-tls-certs\") pod \"model-serving-api-5dd488fc48-fhv8m\" (UID: \"8c11ee0e-817e-4a08-9425-cc14e9f01368\") " pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:22.219411 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.219322 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mkkl\" (UniqueName: \"kubernetes.io/projected/8c11ee0e-817e-4a08-9425-cc14e9f01368-kube-api-access-5mkkl\") pod \"model-serving-api-5dd488fc48-fhv8m\" (UID: \"8c11ee0e-817e-4a08-9425-cc14e9f01368\") " pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:22.219411 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.219390 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf5390d0-c41f-446b-bec8-1259c9e7ae05-cert\") pod \"odh-model-controller-6dc94f689f-2bhpm\" (UID: \"bf5390d0-c41f-446b-bec8-1259c9e7ae05\") " pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:22.219411 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.219411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c11ee0e-817e-4a08-9425-cc14e9f01368-tls-certs\") pod \"model-serving-api-5dd488fc48-fhv8m\" (UID: \"8c11ee0e-817e-4a08-9425-cc14e9f01368\") " pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:22.219699 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:08:22.219566 2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 09 03:08:22.219699 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:08:22.219628 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c11ee0e-817e-4a08-9425-cc14e9f01368-tls-certs podName:8c11ee0e-817e-4a08-9425-cc14e9f01368 nodeName:}" failed. No retries permitted until 2026-06-09 03:08:22.719607034 +0000 UTC m=+519.718613457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8c11ee0e-817e-4a08-9425-cc14e9f01368-tls-certs") pod "model-serving-api-5dd488fc48-fhv8m" (UID: "8c11ee0e-817e-4a08-9425-cc14e9f01368") : secret "model-serving-api-tls" not found Jun 09 03:08:22.221901 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.221875 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf5390d0-c41f-446b-bec8-1259c9e7ae05-cert\") pod \"odh-model-controller-6dc94f689f-2bhpm\" (UID: \"bf5390d0-c41f-446b-bec8-1259c9e7ae05\") " pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:22.233710 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.233685 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mkkl\" (UniqueName: \"kubernetes.io/projected/8c11ee0e-817e-4a08-9425-cc14e9f01368-kube-api-access-5mkkl\") pod \"model-serving-api-5dd488fc48-fhv8m\" (UID: \"8c11ee0e-817e-4a08-9425-cc14e9f01368\") " pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:22.312754 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.312719 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:22.395259 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.395216 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" event={"ID":"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443","Type":"ContainerStarted","Data":"ebbbb773bedd257ad50f19a63d12979bb3584ddcb3a26e9355305e6c1fce91e5"} Jun 09 03:08:22.472401 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.472301 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:22.636597 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.636560 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-2bhpm"] Jun 09 03:08:22.641082 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:08:22.639705 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5390d0_c41f_446b_bec8_1259c9e7ae05.slice/crio-f281a84c5d16be46659353255f8f2e0d6cd5f24c0cb7102e7f5186a5ed2b2e44 WatchSource:0}: Error finding container f281a84c5d16be46659353255f8f2e0d6cd5f24c0cb7102e7f5186a5ed2b2e44: Status 404 returned error can't find the container with id f281a84c5d16be46659353255f8f2e0d6cd5f24c0cb7102e7f5186a5ed2b2e44 Jun 09 03:08:22.728356 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.728260 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c11ee0e-817e-4a08-9425-cc14e9f01368-tls-certs\") pod \"model-serving-api-5dd488fc48-fhv8m\" (UID: \"8c11ee0e-817e-4a08-9425-cc14e9f01368\") " pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:22.731233 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.731203 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c11ee0e-817e-4a08-9425-cc14e9f01368-tls-certs\") pod \"model-serving-api-5dd488fc48-fhv8m\" (UID: \"8c11ee0e-817e-4a08-9425-cc14e9f01368\") " pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:22.898355 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:22.898315 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:23.073304 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:23.073277 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-fhv8m"] Jun 09 03:08:23.403636 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:23.403555 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" event={"ID":"bf5390d0-c41f-446b-bec8-1259c9e7ae05","Type":"ContainerStarted","Data":"f281a84c5d16be46659353255f8f2e0d6cd5f24c0cb7102e7f5186a5ed2b2e44"} Jun 09 03:08:23.861170 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:08:23.861129 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c11ee0e_817e_4a08_9425_cc14e9f01368.slice/crio-457abbbd7948858768bcb35e3b197145c8a8a43cacd67c33ccdd0d38873f696e WatchSource:0}: Error finding container 457abbbd7948858768bcb35e3b197145c8a8a43cacd67c33ccdd0d38873f696e: Status 404 returned error can't find the container with id 457abbbd7948858768bcb35e3b197145c8a8a43cacd67c33ccdd0d38873f696e Jun 09 03:08:24.409840 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:24.409799 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" event={"ID":"8c11ee0e-817e-4a08-9425-cc14e9f01368","Type":"ContainerStarted","Data":"457abbbd7948858768bcb35e3b197145c8a8a43cacd67c33ccdd0d38873f696e"} Jun 09 03:08:27.425768 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:27.425735 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" event={"ID":"bf5390d0-c41f-446b-bec8-1259c9e7ae05","Type":"ContainerStarted","Data":"b86d732f88464c158fe73e9f5287297f1811fe70c214588e22ea607984f8c615"} Jun 09 03:08:27.426200 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:27.425830 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:27.427332 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:27.427309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" event={"ID":"8c11ee0e-817e-4a08-9425-cc14e9f01368","Type":"ContainerStarted","Data":"88978d51ac06d63d5b447dafffc569d826790a11fc7f0ef1f10522704ffd55df"} Jun 09 03:08:27.427643 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:27.427348 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:27.428824 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:27.428805 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" event={"ID":"e5d6529d-21ff-4bb5-8d0f-8f2d433d0443","Type":"ContainerStarted","Data":"b44bb2d83aad3d60cbd19cea394828645bcf86204dc7df67418701bd8c68aac6"} Jun 09 03:08:27.446236 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:27.446186 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" podStartSLOduration=2.657058217 podStartE2EDuration="6.446170098s" totalImagesPullingTime="3.789111881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:08:27.444935642 +0000 UTC m=+524.443942087" watchObservedRunningTime="2026-06-09 03:08:27.446170098 +0000 UTC m=+524.445176543" Jun 09 03:08:27.479576 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:27.479524 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" podStartSLOduration=3.878478916 podStartE2EDuration="6.479488645s" totalImagesPullingTime="2.601009729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:08:27.477727143 +0000 UTC m=+524.476733587" watchObservedRunningTime="2026-06-09 03:08:27.479488645 +0000 UTC m=+524.478495090" Jun 09 03:08:27.509717 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:27.509663 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86bb47f4b7-tmbpm" podStartSLOduration=2.320252472 podStartE2EDuration="6.509647162s" totalImagesPullingTime="4.18939469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:08:27.507599673 +0000 UTC m=+524.506606128" watchObservedRunningTime="2026-06-09 03:08:27.509647162 +0000 UTC m=+524.508653609" Jun 09 03:08:30.666649 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.666606 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:30.724754 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.724722 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6c59s"] Jun 09 03:08:30.728062 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.728043 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:08:30.731288 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.731258 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jch4j\"" Jun 09 03:08:30.731288 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.731281 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 03:08:30.762817 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.762785 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6c59s"] Jun 09 03:08:30.776643 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.776614 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4"] Jun 09 03:08:30.779766 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.779750 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:08:30.786738 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.786711 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 03:08:30.786872 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.786838 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-29wfx\"" Jun 09 03:08:30.803737 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.803705 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7176902c-1232-401e-813f-bc6bddd5cee9-cert\") pod \"kserve-controller-manager-69fc866d76-6c59s\" (UID: \"7176902c-1232-401e-813f-bc6bddd5cee9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:08:30.803883 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.803745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z26gv\" (UniqueName: \"kubernetes.io/projected/7176902c-1232-401e-813f-bc6bddd5cee9-kube-api-access-z26gv\") pod \"kserve-controller-manager-69fc866d76-6c59s\" (UID: \"7176902c-1232-401e-813f-bc6bddd5cee9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:08:30.810718 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.810687 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4"] Jun 09 03:08:30.811034 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.811012 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:30.910907 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.910860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpkb5\" (UniqueName: \"kubernetes.io/projected/1621b729-03c8-4fda-9305-0c25c62294f6-kube-api-access-qpkb5\") pod \"llmisvc-controller-manager-864bfd7bc9-8q5x4\" (UID: \"1621b729-03c8-4fda-9305-0c25c62294f6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:08:30.911118 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.910916 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7176902c-1232-401e-813f-bc6bddd5cee9-cert\") pod \"kserve-controller-manager-69fc866d76-6c59s\" (UID: \"7176902c-1232-401e-813f-bc6bddd5cee9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:08:30.911118 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.910979 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z26gv\" (UniqueName: \"kubernetes.io/projected/7176902c-1232-401e-813f-bc6bddd5cee9-kube-api-access-z26gv\") pod \"kserve-controller-manager-69fc866d76-6c59s\" (UID: \"7176902c-1232-401e-813f-bc6bddd5cee9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:08:30.911118 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:08:30.911023 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 09 03:08:30.911118 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.911066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1621b729-03c8-4fda-9305-0c25c62294f6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8q5x4\" (UID: \"1621b729-03c8-4fda-9305-0c25c62294f6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:08:30.911118 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:08:30.911087 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7176902c-1232-401e-813f-bc6bddd5cee9-cert podName:7176902c-1232-401e-813f-bc6bddd5cee9 nodeName:}" failed. No retries permitted until 2026-06-09 03:08:31.411065123 +0000 UTC m=+528.410071559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7176902c-1232-401e-813f-bc6bddd5cee9-cert") pod "kserve-controller-manager-69fc866d76-6c59s" (UID: "7176902c-1232-401e-813f-bc6bddd5cee9") : secret "kserve-webhook-server-cert" not found Jun 09 03:08:30.922951 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:30.922877 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z26gv\" (UniqueName: \"kubernetes.io/projected/7176902c-1232-401e-813f-bc6bddd5cee9-kube-api-access-z26gv\") pod \"kserve-controller-manager-69fc866d76-6c59s\" (UID: \"7176902c-1232-401e-813f-bc6bddd5cee9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:08:31.012677 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.012634 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1621b729-03c8-4fda-9305-0c25c62294f6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8q5x4\" (UID: \"1621b729-03c8-4fda-9305-0c25c62294f6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:08:31.012858 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.012698 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpkb5\" (UniqueName: \"kubernetes.io/projected/1621b729-03c8-4fda-9305-0c25c62294f6-kube-api-access-qpkb5\") pod \"llmisvc-controller-manager-864bfd7bc9-8q5x4\" (UID: \"1621b729-03c8-4fda-9305-0c25c62294f6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:08:31.012858 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:08:31.012793 2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 09 03:08:31.012930 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:08:31.012874 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1621b729-03c8-4fda-9305-0c25c62294f6-cert podName:1621b729-03c8-4fda-9305-0c25c62294f6 nodeName:}" failed. No retries permitted until 2026-06-09 03:08:31.512854787 +0000 UTC m=+528.511861218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1621b729-03c8-4fda-9305-0c25c62294f6-cert") pod "llmisvc-controller-manager-864bfd7bc9-8q5x4" (UID: "1621b729-03c8-4fda-9305-0c25c62294f6") : secret "llmisvc-webhook-server-cert" not found Jun 09 03:08:31.021927 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.021895 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpkb5\" (UniqueName: \"kubernetes.io/projected/1621b729-03c8-4fda-9305-0c25c62294f6-kube-api-access-qpkb5\") pod \"llmisvc-controller-manager-864bfd7bc9-8q5x4\" (UID: \"1621b729-03c8-4fda-9305-0c25c62294f6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:08:31.038311 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.038281 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:31.311725 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.311639 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:31.417083 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.417050 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7176902c-1232-401e-813f-bc6bddd5cee9-cert\") pod \"kserve-controller-manager-69fc866d76-6c59s\" (UID: \"7176902c-1232-401e-813f-bc6bddd5cee9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:08:31.419532 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.419511 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7176902c-1232-401e-813f-bc6bddd5cee9-cert\") pod \"kserve-controller-manager-69fc866d76-6c59s\" (UID: \"7176902c-1232-401e-813f-bc6bddd5cee9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:08:31.518489 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.518445 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1621b729-03c8-4fda-9305-0c25c62294f6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8q5x4\" (UID: \"1621b729-03c8-4fda-9305-0c25c62294f6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:08:31.520834 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.520806 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1621b729-03c8-4fda-9305-0c25c62294f6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8q5x4\" (UID: \"1621b729-03c8-4fda-9305-0c25c62294f6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:08:31.638345 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.638253 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:08:31.689708 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.689673 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:08:31.783870 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.783754 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6c59s"] Jun 09 03:08:31.786461 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:08:31.786431 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7176902c_1232_401e_813f_bc6bddd5cee9.slice/crio-ab5ccc6c10f9dc0b4cf23ec4fdbf64605bb7b59d119e903d397304e024f34d8f WatchSource:0}: Error finding container ab5ccc6c10f9dc0b4cf23ec4fdbf64605bb7b59d119e903d397304e024f34d8f: Status 404 returned error can't find the container with id ab5ccc6c10f9dc0b4cf23ec4fdbf64605bb7b59d119e903d397304e024f34d8f Jun 09 03:08:31.834026 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.834002 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4"] Jun 09 03:08:31.836333 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:08:31.836302 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1621b729_03c8_4fda_9305_0c25c62294f6.slice/crio-82cda19d0d09c8ede5a62c8ac9fb917aca74b3f560775ababe5d66372c498522 WatchSource:0}: Error finding container 82cda19d0d09c8ede5a62c8ac9fb917aca74b3f560775ababe5d66372c498522: Status 404 returned error can't find the container with id 82cda19d0d09c8ede5a62c8ac9fb917aca74b3f560775ababe5d66372c498522 Jun 09 03:08:31.991794 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:31.991762 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:32.088878 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:32.088840 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:32.453524 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:32.453470 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" event={"ID":"1621b729-03c8-4fda-9305-0c25c62294f6","Type":"ContainerStarted","Data":"82cda19d0d09c8ede5a62c8ac9fb917aca74b3f560775ababe5d66372c498522"} Jun 09 03:08:32.455105 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:32.455068 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" event={"ID":"7176902c-1232-401e-813f-bc6bddd5cee9","Type":"ContainerStarted","Data":"ab5ccc6c10f9dc0b4cf23ec4fdbf64605bb7b59d119e903d397304e024f34d8f"} Jun 09 03:08:35.471772 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:35.471725 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" event={"ID":"1621b729-03c8-4fda-9305-0c25c62294f6","Type":"ContainerStarted","Data":"ba02ae3ce9a03099382c7c1897cfc585718f38169d1b9c9bf9af8009d7e6694f"} Jun 09 03:08:35.472224 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:35.471803 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:08:35.473252 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:35.473230 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" event={"ID":"7176902c-1232-401e-813f-bc6bddd5cee9","Type":"ContainerStarted","Data":"fce2b25c67b8e050edaf570f17d70a7e1e3e27b8af87eb505051948fbdcfa2f3"} Jun 09 03:08:35.473326 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:35.473292 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:08:35.488316 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:35.488267 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" podStartSLOduration=2.349593012 podStartE2EDuration="5.488251156s" totalImagesPullingTime="3.138658144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:08:35.486963863 +0000 UTC m=+532.485970328" watchObservedRunningTime="2026-06-09 03:08:35.488251156 +0000 UTC m=+532.487257602" Jun 09 03:08:35.504058 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:35.504003 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" podStartSLOduration=2.319343193 podStartE2EDuration="5.503987791s" totalImagesPullingTime="3.184644598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:08:35.502662092 +0000 UTC m=+532.501668531" watchObservedRunningTime="2026-06-09 03:08:35.503987791 +0000 UTC m=+532.502994235" Jun 09 03:08:37.954755 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:37.954722 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:38.053305 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:38.053270 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:38.436007 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:38.435974 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-2bhpm" Jun 09 03:08:38.437746 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:38.437726 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-fhv8m" Jun 09 03:08:39.148933 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:39.148892 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:39.245978 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:39.245944 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:39.640101 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:39.640065 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:39.740736 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:39.740699 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:40.302001 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.301966 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:40.561554 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.561462 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp"] Jun 09 03:08:40.565080 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.565053 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" Jun 09 03:08:40.567623 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.567595 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 03:08:40.567623 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.567609 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 03:08:40.567623 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.567595 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-fn8xq\"" Jun 09 03:08:40.580303 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.580276 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp"] Jun 09 03:08:40.713372 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.713329 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq7pw\" (UniqueName: \"kubernetes.io/projected/33e101e6-300b-4d8b-82b0-8e24acded8c2-kube-api-access-cq7pw\") pod \"servicemesh-operator3-57f65f65fb-wz7kp\" (UID: \"33e101e6-300b-4d8b-82b0-8e24acded8c2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" Jun 09 03:08:40.713586 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.713379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/33e101e6-300b-4d8b-82b0-8e24acded8c2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-wz7kp\" (UID: \"33e101e6-300b-4d8b-82b0-8e24acded8c2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" Jun 09 03:08:40.814032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.813949 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq7pw\" (UniqueName: \"kubernetes.io/projected/33e101e6-300b-4d8b-82b0-8e24acded8c2-kube-api-access-cq7pw\") pod \"servicemesh-operator3-57f65f65fb-wz7kp\" (UID: \"33e101e6-300b-4d8b-82b0-8e24acded8c2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" Jun 09 03:08:40.814032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.813988 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/33e101e6-300b-4d8b-82b0-8e24acded8c2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-wz7kp\" (UID: \"33e101e6-300b-4d8b-82b0-8e24acded8c2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" Jun 09 03:08:40.816587 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.816562 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/33e101e6-300b-4d8b-82b0-8e24acded8c2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-wz7kp\" (UID: \"33e101e6-300b-4d8b-82b0-8e24acded8c2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" Jun 09 03:08:40.822062 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.822038 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq7pw\" (UniqueName: \"kubernetes.io/projected/33e101e6-300b-4d8b-82b0-8e24acded8c2-kube-api-access-cq7pw\") pod \"servicemesh-operator3-57f65f65fb-wz7kp\" (UID: \"33e101e6-300b-4d8b-82b0-8e24acded8c2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" Jun 09 03:08:40.874944 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:40.874895 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" Jun 09 03:08:41.014828 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:41.014799 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp"] Jun 09 03:08:41.018004 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:08:41.017965 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e101e6_300b_4d8b_82b0_8e24acded8c2.slice/crio-6fa7209edb3e4dae80bc5a8e94d06e0f953ac6440f7b90a3ac88d47433767d0b WatchSource:0}: Error finding container 6fa7209edb3e4dae80bc5a8e94d06e0f953ac6440f7b90a3ac88d47433767d0b: Status 404 returned error can't find the container with id 6fa7209edb3e4dae80bc5a8e94d06e0f953ac6440f7b90a3ac88d47433767d0b Jun 09 03:08:41.501963 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:41.501919 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" event={"ID":"33e101e6-300b-4d8b-82b0-8e24acded8c2","Type":"ContainerStarted","Data":"6fa7209edb3e4dae80bc5a8e94d06e0f953ac6440f7b90a3ac88d47433767d0b"} Jun 09 03:08:43.514100 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:43.514067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" event={"ID":"33e101e6-300b-4d8b-82b0-8e24acded8c2","Type":"ContainerStarted","Data":"6c06ad2b9d96a715a62a8ca998c39608f8681ffa63bbb972f451fe9588a15649"} Jun 09 03:08:43.514583 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:43.514180 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" Jun 09 03:08:43.534305 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:43.534238 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" podStartSLOduration=1.125378679 podStartE2EDuration="3.534216851s" totalImagesPullingTime="2.408838172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:08:43.532513053 +0000 UTC m=+540.531519504" watchObservedRunningTime="2026-06-09 03:08:43.534216851 +0000 UTC m=+540.533223297" Jun 09 03:08:47.938796 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:47.938760 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:48.037391 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:48.037347 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:50.129140 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.129107 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd"] Jun 09 03:08:50.132617 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.132594 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.134548 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.134513 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:50.135275 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.135245 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 03:08:50.135415 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.135244 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 03:08:50.135415 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.135396 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tgfvr\"" Jun 09 03:08:50.135563 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.135412 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 03:08:50.135563 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.135444 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 03:08:50.144628 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.144560 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd"] Jun 09 03:08:50.187178 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.187139 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d1082894-2b31-4ad4-8b71-667c3b106603-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.187358 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.187195 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1082894-2b31-4ad4-8b71-667c3b106603-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.187358 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.187229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d1082894-2b31-4ad4-8b71-667c3b106603-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.187358 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.187252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d1082894-2b31-4ad4-8b71-667c3b106603-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.187358 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.187275 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d1082894-2b31-4ad4-8b71-667c3b106603-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.187358 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.187300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1082894-2b31-4ad4-8b71-667c3b106603-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.187358 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.187319 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5hn5\" (UniqueName: \"kubernetes.io/projected/d1082894-2b31-4ad4-8b71-667c3b106603-kube-api-access-s5hn5\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.230747 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.230703 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:50.288418 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.288381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d1082894-2b31-4ad4-8b71-667c3b106603-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.288662 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.288428 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1082894-2b31-4ad4-8b71-667c3b106603-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.288662 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.288453 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d1082894-2b31-4ad4-8b71-667c3b106603-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.288662 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.288529 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d1082894-2b31-4ad4-8b71-667c3b106603-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.288662 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.288582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d1082894-2b31-4ad4-8b71-667c3b106603-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.288662 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.288627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1082894-2b31-4ad4-8b71-667c3b106603-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.288662 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.288658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5hn5\" (UniqueName: \"kubernetes.io/projected/d1082894-2b31-4ad4-8b71-667c3b106603-kube-api-access-s5hn5\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.289111 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.289084 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d1082894-2b31-4ad4-8b71-667c3b106603-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.291443 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.291417 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d1082894-2b31-4ad4-8b71-667c3b106603-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.291573 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.291484 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d1082894-2b31-4ad4-8b71-667c3b106603-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.291573 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.291487 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1082894-2b31-4ad4-8b71-667c3b106603-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.291686 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.291670 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d1082894-2b31-4ad4-8b71-667c3b106603-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.297141 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.297115 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1082894-2b31-4ad4-8b71-667c3b106603-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.297251 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.297202 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5hn5\" (UniqueName: \"kubernetes.io/projected/d1082894-2b31-4ad4-8b71-667c3b106603-kube-api-access-s5hn5\") pod \"istiod-openshift-gateway-75c67f8887-brgnd\" (UID: \"d1082894-2b31-4ad4-8b71-667c3b106603\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.443486 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.443451 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:50.482768 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.482713 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:50.583818 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.583785 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:50.589778 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.589724 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd"] Jun 09 03:08:50.592314 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:08:50.592280 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1082894_2b31_4ad4_8b71_667c3b106603.slice/crio-26670200bd6880114c2d28a1aa65aafd364b78814723ef15ccedfcfa781fd275 WatchSource:0}: Error finding container 26670200bd6880114c2d28a1aa65aafd364b78814723ef15ccedfcfa781fd275: Status 404 returned error can't find the container with id 26670200bd6880114c2d28a1aa65aafd364b78814723ef15ccedfcfa781fd275 Jun 09 03:08:50.733823 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:50.733725 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:51.551036 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:51.550996 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" event={"ID":"d1082894-2b31-4ad4-8b71-667c3b106603","Type":"ContainerStarted","Data":"26670200bd6880114c2d28a1aa65aafd364b78814723ef15ccedfcfa781fd275"} Jun 09 03:08:53.797753 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:53.797715 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 03:08:53.797992 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:53.797785 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 03:08:54.521167 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:54.521134 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wz7kp" Jun 09 03:08:54.573964 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:54.573826 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" event={"ID":"d1082894-2b31-4ad4-8b71-667c3b106603","Type":"ContainerStarted","Data":"4d1f959eb2efc34b569d4c7cef790bbaa316552aa82b381c35cdc5fcc84f0f72"} Jun 09 03:08:54.575117 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:54.574910 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:54.576787 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:54.576386 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:54.576787 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:54.576687 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-brgnd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 03:08:54.577041 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:54.576783 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" podUID="d1082894-2b31-4ad4-8b71-667c3b106603" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:08:54.594147 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:54.594087 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" podStartSLOduration=1.391214374 podStartE2EDuration="4.594067866s" totalImagesPullingTime="3.202853492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:08:54.593804167 +0000 UTC m=+551.592810611" watchObservedRunningTime="2026-06-09 03:08:54.594067866 +0000 UTC m=+551.593074314" Jun 09 03:08:54.676743 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:54.676593 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:54.873840 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:54.873754 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:55.113206 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:55.113170 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:55.228557 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:55.228525 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:55.580136 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:55.580049 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-brgnd" Jun 09 03:08:58.929786 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:58.929745 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d869d9c69-nzczk"] Jun 09 03:08:58.950714 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:58.950682 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:08:59.006531 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.006463 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d869d9c69-nzczk"] Jun 09 03:08:59.006712 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.006589 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" Jun 09 03:08:59.009418 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.009393 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 03:08:59.009554 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.009417 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ffkzp\"" Jun 09 03:08:59.067711 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.067679 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3238495a-c320-4c41-9000-0fb474b36822-redirect-config\") pod \"dashboard-redirect-6d869d9c69-nzczk\" (UID: \"3238495a-c320-4c41-9000-0fb474b36822\") " pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" Jun 09 03:08:59.067894 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.067726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8j75\" (UniqueName: \"kubernetes.io/projected/3238495a-c320-4c41-9000-0fb474b36822-kube-api-access-t8j75\") pod \"dashboard-redirect-6d869d9c69-nzczk\" (UID: \"3238495a-c320-4c41-9000-0fb474b36822\") " pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" Jun 09 03:08:59.168773 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.168737 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8j75\" (UniqueName: \"kubernetes.io/projected/3238495a-c320-4c41-9000-0fb474b36822-kube-api-access-t8j75\") pod \"dashboard-redirect-6d869d9c69-nzczk\" (UID: \"3238495a-c320-4c41-9000-0fb474b36822\") " pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" Jun 09 03:08:59.168960 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.168836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3238495a-c320-4c41-9000-0fb474b36822-redirect-config\") pod \"dashboard-redirect-6d869d9c69-nzczk\" (UID: \"3238495a-c320-4c41-9000-0fb474b36822\") " pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" Jun 09 03:08:59.169473 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.169453 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3238495a-c320-4c41-9000-0fb474b36822-redirect-config\") pod \"dashboard-redirect-6d869d9c69-nzczk\" (UID: \"3238495a-c320-4c41-9000-0fb474b36822\") " pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" Jun 09 03:08:59.176298 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.176273 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8j75\" (UniqueName: \"kubernetes.io/projected/3238495a-c320-4c41-9000-0fb474b36822-kube-api-access-t8j75\") pod \"dashboard-redirect-6d869d9c69-nzczk\" (UID: \"3238495a-c320-4c41-9000-0fb474b36822\") " pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" Jun 09 03:08:59.317414 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.317312 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" Jun 09 03:08:59.469100 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.469066 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d869d9c69-nzczk"] Jun 09 03:08:59.472299 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:08:59.472269 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3238495a_c320_4c41_9000_0fb474b36822.slice/crio-a340f8f4bf8b1a7079a1156f3533129a1d932fe3ec55c0be22ce651a41f63230 WatchSource:0}: Error finding container a340f8f4bf8b1a7079a1156f3533129a1d932fe3ec55c0be22ce651a41f63230: Status 404 returned error can't find the container with id a340f8f4bf8b1a7079a1156f3533129a1d932fe3ec55c0be22ce651a41f63230 Jun 09 03:08:59.599619 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:08:59.599520 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" event={"ID":"3238495a-c320-4c41-9000-0fb474b36822","Type":"ContainerStarted","Data":"a340f8f4bf8b1a7079a1156f3533129a1d932fe3ec55c0be22ce651a41f63230"} Jun 09 03:09:02.616265 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:02.616226 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" event={"ID":"3238495a-c320-4c41-9000-0fb474b36822","Type":"ContainerStarted","Data":"0055c2727728ed502d79eb9d792e083adeb33fddabfb0f78dad26f8cb3548f3f"} Jun 09 03:09:02.630467 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:02.630413 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d869d9c69-nzczk" podStartSLOduration=2.537455521 podStartE2EDuration="4.630398074s" totalImagesPullingTime="2.092942553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:09:02.62987358 +0000 UTC m=+559.628880027" watchObservedRunningTime="2026-06-09 03:09:02.630398074 +0000 UTC m=+559.629404497" Jun 09 03:09:06.480805 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:06.480767 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8q5x4" Jun 09 03:09:06.483987 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:06.483960 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-6c59s" Jun 09 03:09:22.512490 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:22.512458 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:22.573364 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:22.573328 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:22.680015 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:22.679977 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:25.627024 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:25.626980 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:25.681799 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:25.681757 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:42.632319 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.632275 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c4b9f8f6d-tkhm5"] Jun 09 03:09:42.646966 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.646931 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c4b9f8f6d-tkhm5"] Jun 09 03:09:42.647131 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.647056 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.663078 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.663047 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4511f73b-5f59-4fce-af38-4aa914fc4691-console-serving-cert\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.663273 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.663087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-oauth-serving-cert\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.663273 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.663123 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-trusted-ca-bundle\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.663273 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.663189 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4511f73b-5f59-4fce-af38-4aa914fc4691-console-oauth-config\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.663273 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.663246 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s55zh\" (UniqueName: \"kubernetes.io/projected/4511f73b-5f59-4fce-af38-4aa914fc4691-kube-api-access-s55zh\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.663484 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.663294 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-service-ca\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.663484 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.663319 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-console-config\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.675533 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.675486 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:42.721917 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.721872 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:42.764555 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.764489 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4511f73b-5f59-4fce-af38-4aa914fc4691-console-oauth-config\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.764758 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.764577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s55zh\" (UniqueName: \"kubernetes.io/projected/4511f73b-5f59-4fce-af38-4aa914fc4691-kube-api-access-s55zh\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.764758 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.764613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-service-ca\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.764758 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.764630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-console-config\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.764758 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.764663 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4511f73b-5f59-4fce-af38-4aa914fc4691-console-serving-cert\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.764758 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.764683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-oauth-serving-cert\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.764758 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.764711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-trusted-ca-bundle\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.765449 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.765420 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-service-ca\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.765645 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.765420 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-console-config\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.765645 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.765480 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-trusted-ca-bundle\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.765645 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.765618 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4511f73b-5f59-4fce-af38-4aa914fc4691-oauth-serving-cert\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.767126 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.767101 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4511f73b-5f59-4fce-af38-4aa914fc4691-console-oauth-config\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.767221 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.767139 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4511f73b-5f59-4fce-af38-4aa914fc4691-console-serving-cert\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.771880 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.771856 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s55zh\" (UniqueName: \"kubernetes.io/projected/4511f73b-5f59-4fce-af38-4aa914fc4691-kube-api-access-s55zh\") pod \"console-7c4b9f8f6d-tkhm5\" (UID: \"4511f73b-5f59-4fce-af38-4aa914fc4691\") " pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:42.957573 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:42.957529 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:43.098016 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:43.097975 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c4b9f8f6d-tkhm5"] Jun 09 03:09:43.100424 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:09:43.100395 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4511f73b_5f59_4fce_af38_4aa914fc4691.slice/crio-1d26ab90daa471be2a73e1d0cd8602a6ba0877907f02cf4fad65b351264cdaf5 WatchSource:0}: Error finding container 1d26ab90daa471be2a73e1d0cd8602a6ba0877907f02cf4fad65b351264cdaf5: Status 404 returned error can't find the container with id 1d26ab90daa471be2a73e1d0cd8602a6ba0877907f02cf4fad65b351264cdaf5 Jun 09 03:09:43.389030 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:43.388945 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:09:43.389351 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:43.389330 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:09:43.394841 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:43.394814 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:09:43.395382 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:43.395363 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:09:43.806049 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:43.806012 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c4b9f8f6d-tkhm5" event={"ID":"4511f73b-5f59-4fce-af38-4aa914fc4691","Type":"ContainerStarted","Data":"8869233b19eb745a810f593165cb3ec66e4f492e39b3b065dc7ddb7107c622ab"} Jun 09 03:09:43.806450 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:43.806065 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c4b9f8f6d-tkhm5" event={"ID":"4511f73b-5f59-4fce-af38-4aa914fc4691","Type":"ContainerStarted","Data":"1d26ab90daa471be2a73e1d0cd8602a6ba0877907f02cf4fad65b351264cdaf5"} Jun 09 03:09:43.823287 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:43.823232 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c4b9f8f6d-tkhm5" podStartSLOduration=1.823215302 podStartE2EDuration="1.823215302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:09:43.821110793 +0000 UTC m=+600.820117238" watchObservedRunningTime="2026-06-09 03:09:43.823215302 +0000 UTC m=+600.822221746" Jun 09 03:09:51.740024 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:51.739988 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:52.957830 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:52.957796 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:52.958203 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:52.957863 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:52.962464 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:52.962440 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:53.857213 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:53.857114 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c4b9f8f6d-tkhm5" Jun 09 03:09:53.905895 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:53.905858 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f4db9fc87-7wd4b"] Jun 09 03:09:53.995029 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:53.994992 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:54.044407 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:54.044375 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:54.096916 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:54.096883 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:55.927338 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:55.927303 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:58.332576 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:58.332539 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:58.576661 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:58.576624 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:09:58.928710 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:09:58.928675 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:01.740607 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:01.740578 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jghjm"] Jun 09 03:10:01.744103 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:01.744084 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jghjm" Jun 09 03:10:01.746730 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:01.746705 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 03:10:01.746838 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:01.746782 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 03:10:01.747976 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:01.747953 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-srlp8\"" Jun 09 03:10:01.754394 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:01.754313 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jghjm"] Jun 09 03:10:01.838168 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:01.838132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb82d\" (UniqueName: \"kubernetes.io/projected/2856772c-5161-4f70-b200-4c14d18c6371-kube-api-access-lb82d\") pod \"authorino-operator-75cc8d5cb7-jghjm\" (UID: \"2856772c-5161-4f70-b200-4c14d18c6371\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jghjm" Jun 09 03:10:01.939428 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:01.939393 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb82d\" (UniqueName: \"kubernetes.io/projected/2856772c-5161-4f70-b200-4c14d18c6371-kube-api-access-lb82d\") pod \"authorino-operator-75cc8d5cb7-jghjm\" (UID: \"2856772c-5161-4f70-b200-4c14d18c6371\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jghjm" Jun 09 03:10:01.950109 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:01.950077 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb82d\" (UniqueName: \"kubernetes.io/projected/2856772c-5161-4f70-b200-4c14d18c6371-kube-api-access-lb82d\") pod \"authorino-operator-75cc8d5cb7-jghjm\" (UID: \"2856772c-5161-4f70-b200-4c14d18c6371\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jghjm" Jun 09 03:10:02.056023 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:02.055921 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jghjm" Jun 09 03:10:02.210856 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:02.210721 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jghjm"] Jun 09 03:10:02.213845 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:10:02.213816 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2856772c_5161_4f70_b200_4c14d18c6371.slice/crio-7f0272dc7047acbebdbdf05db6602a002f65faede4d295bd101820e8b8429a61 WatchSource:0}: Error finding container 7f0272dc7047acbebdbdf05db6602a002f65faede4d295bd101820e8b8429a61: Status 404 returned error can't find the container with id 7f0272dc7047acbebdbdf05db6602a002f65faede4d295bd101820e8b8429a61 Jun 09 03:10:02.323842 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:02.323760 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:02.904079 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:02.904041 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jghjm" event={"ID":"2856772c-5161-4f70-b200-4c14d18c6371","Type":"ContainerStarted","Data":"7f0272dc7047acbebdbdf05db6602a002f65faede4d295bd101820e8b8429a61"} Jun 09 03:10:03.472872 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:03.472839 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:03.573322 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:03.573272 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:04.917634 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:04.917602 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jghjm" event={"ID":"2856772c-5161-4f70-b200-4c14d18c6371","Type":"ContainerStarted","Data":"05acb1d9d051bc11bbc1380dbd10d04749ab944926dac76fc0bafe73e14687e3"} Jun 09 03:10:04.918014 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:04.917669 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jghjm" Jun 09 03:10:04.934597 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:04.934550 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jghjm" podStartSLOduration=1.5731297899999999 podStartE2EDuration="3.934537017s" totalImagesPullingTime="2.361407227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:10:04.932767001 +0000 UTC m=+621.931773447" watchObservedRunningTime="2026-06-09 03:10:04.934537017 +0000 UTC m=+621.933543463" Jun 09 03:10:05.429916 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:05.429880 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:07.167786 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:07.167751 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:08.543879 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:08.543840 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:08.646398 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:08.646354 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:12.348657 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:12.348624 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:12.448660 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:12.448626 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:15.840534 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:15.840470 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:15.892053 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:15.892019 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:15.925638 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:15.925614 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jghjm" Jun 09 03:10:16.530553 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:16.530519 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:16.634765 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:16.634722 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:16.988194 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:16.988153 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:17.059999 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:17.059930 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:17.828875 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:17.828841 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:18.781207 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:18.781171 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:18.881997 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:18.881962 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:18.926720 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:18.926682 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f4db9fc87-7wd4b" podUID="b250a422-3eb6-45b2-b309-3573ab1ad3aa" containerName="console" containerID="cri-o://e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69" gracePeriod=15 Jun 09 03:10:19.186272 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.186247 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:10:19.202337 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.202300 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-oauth-config\") pod \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " Jun 09 03:10:19.202524 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.202358 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-trusted-ca-bundle\") pod \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " Jun 09 03:10:19.202524 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.202410 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8v6m\" (UniqueName: \"kubernetes.io/projected/b250a422-3eb6-45b2-b309-3573ab1ad3aa-kube-api-access-h8v6m\") pod \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " Jun 09 03:10:19.202524 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.202431 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-serving-cert\") pod \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " Jun 09 03:10:19.202524 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.202469 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-config\") pod \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " Jun 09 03:10:19.202524 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.202521 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-oauth-serving-cert\") pod \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " Jun 09 03:10:19.202763 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.202546 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-service-ca\") pod \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\" (UID: \"b250a422-3eb6-45b2-b309-3573ab1ad3aa\") " Jun 09 03:10:19.202925 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.202893 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b250a422-3eb6-45b2-b309-3573ab1ad3aa" (UID: "b250a422-3eb6-45b2-b309-3573ab1ad3aa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:10:19.203085 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.202927 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-config" (OuterVolumeSpecName: "console-config") pod "b250a422-3eb6-45b2-b309-3573ab1ad3aa" (UID: "b250a422-3eb6-45b2-b309-3573ab1ad3aa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:10:19.203188 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.202971 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b250a422-3eb6-45b2-b309-3573ab1ad3aa" (UID: "b250a422-3eb6-45b2-b309-3573ab1ad3aa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:10:19.203188 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.203009 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-service-ca" (OuterVolumeSpecName: "service-ca") pod "b250a422-3eb6-45b2-b309-3573ab1ad3aa" (UID: "b250a422-3eb6-45b2-b309-3573ab1ad3aa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:10:19.205268 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.205218 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b250a422-3eb6-45b2-b309-3573ab1ad3aa-kube-api-access-h8v6m" (OuterVolumeSpecName: "kube-api-access-h8v6m") pod "b250a422-3eb6-45b2-b309-3573ab1ad3aa" (UID: "b250a422-3eb6-45b2-b309-3573ab1ad3aa"). InnerVolumeSpecName "kube-api-access-h8v6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 03:10:19.205402 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.205378 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b250a422-3eb6-45b2-b309-3573ab1ad3aa" (UID: "b250a422-3eb6-45b2-b309-3573ab1ad3aa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 03:10:19.205808 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.205783 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b250a422-3eb6-45b2-b309-3573ab1ad3aa" (UID: "b250a422-3eb6-45b2-b309-3573ab1ad3aa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 03:10:19.303821 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.303728 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-config\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:10:19.303821 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.303760 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-oauth-serving-cert\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:10:19.303821 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.303771 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-service-ca\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:10:19.303821 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.303779 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-oauth-config\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:10:19.303821 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.303787 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b250a422-3eb6-45b2-b309-3573ab1ad3aa-trusted-ca-bundle\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:10:19.303821 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.303797 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8v6m\" (UniqueName: \"kubernetes.io/projected/b250a422-3eb6-45b2-b309-3573ab1ad3aa-kube-api-access-h8v6m\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:10:19.303821 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.303806 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b250a422-3eb6-45b2-b309-3573ab1ad3aa-console-serving-cert\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:10:19.995309 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.995277 2568 generic.go:356] "Generic (PLEG): container finished" podID="b250a422-3eb6-45b2-b309-3573ab1ad3aa" containerID="e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69" exitCode=0 Jun 09 03:10:19.995740 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.995323 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4db9fc87-7wd4b" Jun 09 03:10:19.995740 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.995361 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4db9fc87-7wd4b" event={"ID":"b250a422-3eb6-45b2-b309-3573ab1ad3aa","Type":"ContainerDied","Data":"e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69"} Jun 09 03:10:19.995740 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.995414 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4db9fc87-7wd4b" event={"ID":"b250a422-3eb6-45b2-b309-3573ab1ad3aa","Type":"ContainerDied","Data":"28370b137eddc28d96fc2f7ecf499779ae5b1c10d1a7c574be607619db90cab9"} Jun 09 03:10:19.995740 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:19.995442 2568 scope.go:117] "RemoveContainer" containerID="e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69" Jun 09 03:10:20.006954 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:20.006931 2568 scope.go:117] "RemoveContainer" containerID="e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69" Jun 09 03:10:20.007284 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:10:20.007260 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69\": container with ID starting with e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69 not found: ID does not exist" containerID="e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69" Jun 09 03:10:20.007351 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:20.007295 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69"} err="failed to get container status \"e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69\": rpc error: code = NotFound desc = could not find container \"e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69\": container with ID starting with e18be270f4beb274d0c760ac85338de8841c31b32684cb7e45bbb21de5eddd69 not found: ID does not exist" Jun 09 03:10:20.015623 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:20.015595 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f4db9fc87-7wd4b"] Jun 09 03:10:20.023943 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:20.023917 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f4db9fc87-7wd4b"] Jun 09 03:10:20.729608 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:20.729575 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:20.829620 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:20.829589 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:21.079590 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:21.079477 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:21.179663 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:21.179628 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:21.416993 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:21.416959 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b250a422-3eb6-45b2-b309-3573ab1ad3aa" path="/var/lib/kubelet/pods/b250a422-3eb6-45b2-b309-3573ab1ad3aa/volumes" Jun 09 03:10:27.313694 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:27.313643 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:27.414023 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:27.413985 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:30.144621 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:30.144564 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:30.241163 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:30.241127 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:34.933065 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:34.933031 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:35.064029 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:35.063991 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:35.152711 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:35.152662 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:38.468869 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:38.468836 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:38.569806 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:38.569773 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:38.790228 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:38.790128 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:38.849422 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:38.849391 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:45.119879 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:45.119843 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:45.219915 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:45.219875 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:48.500215 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:48.500184 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:48.628749 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:48.628714 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:53.901422 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:53.901381 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:54.001437 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:54.001404 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:54.499481 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:54.499447 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:54.546705 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:54.546669 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:56.399363 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:56.399306 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:56.500659 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:56.500620 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:56.763001 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:56.762960 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:10:56.855558 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:10:56.855523 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:11:00.154745 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:00.154712 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:11:12.268877 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.268825 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:11:12.278851 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.278815 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r4m8c"] Jun 09 03:11:12.279195 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.279182 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b250a422-3eb6-45b2-b309-3573ab1ad3aa" containerName="console" Jun 09 03:11:12.279243 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.279197 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b250a422-3eb6-45b2-b309-3573ab1ad3aa" containerName="console" Jun 09 03:11:12.279284 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.279254 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b250a422-3eb6-45b2-b309-3573ab1ad3aa" containerName="console" Jun 09 03:11:12.282346 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.282329 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:12.284863 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.284843 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 03:11:12.284863 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.284857 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j572w\"" Jun 09 03:11:12.293411 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.293384 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r4m8c"] Jun 09 03:11:12.366308 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.366257 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b725e5b-11a7-4550-bf91-27f79ef90833-config-file\") pod \"limitador-limitador-64c94fd64f-r4m8c\" (UID: \"2b725e5b-11a7-4550-bf91-27f79ef90833\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:12.366517 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.366317 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsqx6\" (UniqueName: \"kubernetes.io/projected/2b725e5b-11a7-4550-bf91-27f79ef90833-kube-api-access-zsqx6\") pod \"limitador-limitador-64c94fd64f-r4m8c\" (UID: \"2b725e5b-11a7-4550-bf91-27f79ef90833\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:12.372353 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.372321 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r4m8c"] Jun 09 03:11:12.382162 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.382130 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:11:12.431188 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.431147 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:11:12.467843 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.467808 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b725e5b-11a7-4550-bf91-27f79ef90833-config-file\") pod \"limitador-limitador-64c94fd64f-r4m8c\" (UID: \"2b725e5b-11a7-4550-bf91-27f79ef90833\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:12.467843 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.467845 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsqx6\" (UniqueName: \"kubernetes.io/projected/2b725e5b-11a7-4550-bf91-27f79ef90833-kube-api-access-zsqx6\") pod \"limitador-limitador-64c94fd64f-r4m8c\" (UID: \"2b725e5b-11a7-4550-bf91-27f79ef90833\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:12.468549 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.468528 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b725e5b-11a7-4550-bf91-27f79ef90833-config-file\") pod \"limitador-limitador-64c94fd64f-r4m8c\" (UID: \"2b725e5b-11a7-4550-bf91-27f79ef90833\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:12.476099 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.476025 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsqx6\" (UniqueName: \"kubernetes.io/projected/2b725e5b-11a7-4550-bf91-27f79ef90833-kube-api-access-zsqx6\") pod \"limitador-limitador-64c94fd64f-r4m8c\" (UID: \"2b725e5b-11a7-4550-bf91-27f79ef90833\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:12.593271 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.593170 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:12.732018 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:12.731993 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r4m8c"] Jun 09 03:11:12.733807 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:11:12.733768 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b725e5b_11a7_4550_bf91_27f79ef90833.slice/crio-126b34f3bfb64c10a8c6393f236a073dafcb23d3ad5599203143cb1870a3f56d WatchSource:0}: Error finding container 126b34f3bfb64c10a8c6393f236a073dafcb23d3ad5599203143cb1870a3f56d: Status 404 returned error can't find the container with id 126b34f3bfb64c10a8c6393f236a073dafcb23d3ad5599203143cb1870a3f56d Jun 09 03:11:13.100111 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:13.100081 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:11:13.199243 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:13.199206 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:11:13.261250 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:13.261214 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" event={"ID":"2b725e5b-11a7-4550-bf91-27f79ef90833","Type":"ContainerStarted","Data":"126b34f3bfb64c10a8c6393f236a073dafcb23d3ad5599203143cb1870a3f56d"} Jun 09 03:11:16.280423 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:16.280381 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" event={"ID":"2b725e5b-11a7-4550-bf91-27f79ef90833","Type":"ContainerStarted","Data":"68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146"} Jun 09 03:11:16.280880 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:16.280531 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:16.298068 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:16.298020 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" podStartSLOduration=1.459649373 podStartE2EDuration="4.29800572s" totalImagesPullingTime="2.838356347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:11:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:11:16.295401322 +0000 UTC m=+693.294407823" watchObservedRunningTime="2026-06-09 03:11:16.29800572 +0000 UTC m=+693.297012192" Jun 09 03:11:27.275715 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:27.275591 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r4m8c"] Jun 09 03:11:27.276193 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:27.275943 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" podUID="2b725e5b-11a7-4550-bf91-27f79ef90833" containerName="limitador" containerID="cri-o://68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146" gracePeriod=30 Jun 09 03:11:27.276699 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:27.276679 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:27.828696 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:27.828672 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:27.908426 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:27.908332 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsqx6\" (UniqueName: \"kubernetes.io/projected/2b725e5b-11a7-4550-bf91-27f79ef90833-kube-api-access-zsqx6\") pod \"2b725e5b-11a7-4550-bf91-27f79ef90833\" (UID: \"2b725e5b-11a7-4550-bf91-27f79ef90833\") " Jun 09 03:11:27.908426 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:27.908424 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b725e5b-11a7-4550-bf91-27f79ef90833-config-file\") pod \"2b725e5b-11a7-4550-bf91-27f79ef90833\" (UID: \"2b725e5b-11a7-4550-bf91-27f79ef90833\") " Jun 09 03:11:27.908837 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:27.908812 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b725e5b-11a7-4550-bf91-27f79ef90833-config-file" (OuterVolumeSpecName: "config-file") pod "2b725e5b-11a7-4550-bf91-27f79ef90833" (UID: "2b725e5b-11a7-4550-bf91-27f79ef90833"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 03:11:27.910596 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:27.910569 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b725e5b-11a7-4550-bf91-27f79ef90833-kube-api-access-zsqx6" (OuterVolumeSpecName: "kube-api-access-zsqx6") pod "2b725e5b-11a7-4550-bf91-27f79ef90833" (UID: "2b725e5b-11a7-4550-bf91-27f79ef90833"). InnerVolumeSpecName "kube-api-access-zsqx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 03:11:28.009934 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.009891 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b725e5b-11a7-4550-bf91-27f79ef90833-config-file\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:11:28.009934 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.009927 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsqx6\" (UniqueName: \"kubernetes.io/projected/2b725e5b-11a7-4550-bf91-27f79ef90833-kube-api-access-zsqx6\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:11:28.339470 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.339436 2568 generic.go:356] "Generic (PLEG): container finished" podID="2b725e5b-11a7-4550-bf91-27f79ef90833" containerID="68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146" exitCode=0 Jun 09 03:11:28.339937 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.339477 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" Jun 09 03:11:28.339937 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.339508 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" event={"ID":"2b725e5b-11a7-4550-bf91-27f79ef90833","Type":"ContainerDied","Data":"68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146"} Jun 09 03:11:28.339937 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.339549 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r4m8c" event={"ID":"2b725e5b-11a7-4550-bf91-27f79ef90833","Type":"ContainerDied","Data":"126b34f3bfb64c10a8c6393f236a073dafcb23d3ad5599203143cb1870a3f56d"} Jun 09 03:11:28.339937 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.339573 2568 scope.go:117] "RemoveContainer" containerID="68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146" Jun 09 03:11:28.348320 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.348300 2568 scope.go:117] "RemoveContainer" containerID="68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146" Jun 09 03:11:28.348592 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:11:28.348572 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146\": container with ID starting with 68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146 not found: ID does not exist" containerID="68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146" Jun 09 03:11:28.348680 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.348603 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146"} err="failed to get container status \"68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146\": rpc error: code = NotFound desc = could not find container \"68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146\": container with ID starting with 68403d1ebbcb27943a02b9ea98055ead90f9ba82199bdf82585b242665d45146 not found: ID does not exist" Jun 09 03:11:28.359756 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.359729 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r4m8c"] Jun 09 03:11:28.363483 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:28.363457 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r4m8c"] Jun 09 03:11:29.415758 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:29.415726 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b725e5b-11a7-4550-bf91-27f79ef90833" path="/var/lib/kubelet/pods/2b725e5b-11a7-4550-bf91-27f79ef90833/volumes" Jun 09 03:11:31.969400 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:31.969357 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-mfhhh"] Jun 09 03:11:31.969928 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:31.969911 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b725e5b-11a7-4550-bf91-27f79ef90833" containerName="limitador" Jun 09 03:11:31.969973 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:31.969931 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b725e5b-11a7-4550-bf91-27f79ef90833" containerName="limitador" Jun 09 03:11:31.970044 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:31.970033 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b725e5b-11a7-4550-bf91-27f79ef90833" containerName="limitador" Jun 09 03:11:31.974188 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:31.974156 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-mfhhh" Jun 09 03:11:31.976619 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:31.976593 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 09 03:11:31.979787 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:31.979748 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-mfhhh"] Jun 09 03:11:31.999872 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:31.999840 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:11:32.046708 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:32.046674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9p57\" (UniqueName: \"kubernetes.io/projected/53f5a3a8-b0e1-4124-b07d-7ebb83c24fba-kube-api-access-v9p57\") pod \"postgres-69fb4594cf-mfhhh\" (UID: \"53f5a3a8-b0e1-4124-b07d-7ebb83c24fba\") " pod="opendatahub/postgres-69fb4594cf-mfhhh" Jun 09 03:11:32.046901 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:32.046719 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/53f5a3a8-b0e1-4124-b07d-7ebb83c24fba-data\") pod \"postgres-69fb4594cf-mfhhh\" (UID: \"53f5a3a8-b0e1-4124-b07d-7ebb83c24fba\") " pod="opendatahub/postgres-69fb4594cf-mfhhh" Jun 09 03:11:32.148124 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:32.148081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9p57\" (UniqueName: \"kubernetes.io/projected/53f5a3a8-b0e1-4124-b07d-7ebb83c24fba-kube-api-access-v9p57\") pod \"postgres-69fb4594cf-mfhhh\" (UID: \"53f5a3a8-b0e1-4124-b07d-7ebb83c24fba\") " pod="opendatahub/postgres-69fb4594cf-mfhhh" Jun 09 03:11:32.148318 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:32.148133 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/53f5a3a8-b0e1-4124-b07d-7ebb83c24fba-data\") pod \"postgres-69fb4594cf-mfhhh\" (UID: \"53f5a3a8-b0e1-4124-b07d-7ebb83c24fba\") " pod="opendatahub/postgres-69fb4594cf-mfhhh" Jun 09 03:11:32.148525 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:32.148483 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/53f5a3a8-b0e1-4124-b07d-7ebb83c24fba-data\") pod \"postgres-69fb4594cf-mfhhh\" (UID: \"53f5a3a8-b0e1-4124-b07d-7ebb83c24fba\") " pod="opendatahub/postgres-69fb4594cf-mfhhh" Jun 09 03:11:32.155915 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:32.155889 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9p57\" (UniqueName: \"kubernetes.io/projected/53f5a3a8-b0e1-4124-b07d-7ebb83c24fba-kube-api-access-v9p57\") pod \"postgres-69fb4594cf-mfhhh\" (UID: \"53f5a3a8-b0e1-4124-b07d-7ebb83c24fba\") " pod="opendatahub/postgres-69fb4594cf-mfhhh" Jun 09 03:11:32.287312 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:32.287212 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-mfhhh" Jun 09 03:11:32.420980 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:32.420953 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-mfhhh"] Jun 09 03:11:32.423277 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:11:32.423245 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f5a3a8_b0e1_4124_b07d_7ebb83c24fba.slice/crio-2d644ae6605614f106227c3e4a4796b9826265b12c2c69e099366c24e3177265 WatchSource:0}: Error finding container 2d644ae6605614f106227c3e4a4796b9826265b12c2c69e099366c24e3177265: Status 404 returned error can't find the container with id 2d644ae6605614f106227c3e4a4796b9826265b12c2c69e099366c24e3177265 Jun 09 03:11:33.366109 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:33.366048 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-mfhhh" event={"ID":"53f5a3a8-b0e1-4124-b07d-7ebb83c24fba","Type":"ContainerStarted","Data":"2d644ae6605614f106227c3e4a4796b9826265b12c2c69e099366c24e3177265"} Jun 09 03:11:35.377559 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:35.377523 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-mfhhh" event={"ID":"53f5a3a8-b0e1-4124-b07d-7ebb83c24fba","Type":"ContainerStarted","Data":"d04c7515c86bf64b164e8d858bbbe2abfcbf10d9737fc89e54eb2397910aa0b7"} Jun 09 03:11:35.378025 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:35.377628 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-mfhhh" Jun 09 03:11:35.393025 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:35.392970 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-mfhhh" podStartSLOduration=2.481285923 podStartE2EDuration="4.392953402s" totalImagesPullingTime="1.911667479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:11:35.39172158 +0000 UTC m=+712.390728025" watchObservedRunningTime="2026-06-09 03:11:35.392953402 +0000 UTC m=+712.391959847" Jun 09 03:11:41.415813 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:41.415785 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-mfhhh" Jun 09 03:11:41.698693 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:41.698594 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:11:41.797491 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:41.797456 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:11:41.951549 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:11:41.951423 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:12:05.911313 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:05.911280 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:12:06.011092 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.011058 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:12:06.302153 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.302067 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 03:12:06.305555 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.305539 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 03:12:06.307993 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.307968 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 03:12:06.308106 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.308021 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 03:12:06.309030 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.309014 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rf2z5\"" Jun 09 03:12:06.309080 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.309027 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 03:12:06.313402 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.313037 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 03:12:06.356857 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.356818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbzgw\" (UniqueName: \"kubernetes.io/projected/c1979651-4139-4315-a4aa-8c48a8f0ca72-kube-api-access-nbzgw\") pod \"maas-keycloak-0\" (UID: \"c1979651-4139-4315-a4aa-8c48a8f0ca72\") " pod="keycloak-system/maas-keycloak-0" Jun 09 03:12:06.458386 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.458337 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbzgw\" (UniqueName: \"kubernetes.io/projected/c1979651-4139-4315-a4aa-8c48a8f0ca72-kube-api-access-nbzgw\") pod \"maas-keycloak-0\" (UID: \"c1979651-4139-4315-a4aa-8c48a8f0ca72\") " pod="keycloak-system/maas-keycloak-0" Jun 09 03:12:06.466872 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.466843 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbzgw\" (UniqueName: \"kubernetes.io/projected/c1979651-4139-4315-a4aa-8c48a8f0ca72-kube-api-access-nbzgw\") pod \"maas-keycloak-0\" (UID: \"c1979651-4139-4315-a4aa-8c48a8f0ca72\") " pod="keycloak-system/maas-keycloak-0" Jun 09 03:12:06.616764 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.616664 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 03:12:06.754321 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:06.754292 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 03:12:06.756445 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:12:06.756418 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1979651_4139_4315_a4aa_8c48a8f0ca72.slice/crio-ee7ebc2d9bd7058eb3e0d1ece4ddd5ef9c25767978fabbca81b163544a63d9cf WatchSource:0}: Error finding container ee7ebc2d9bd7058eb3e0d1ece4ddd5ef9c25767978fabbca81b163544a63d9cf: Status 404 returned error can't find the container with id ee7ebc2d9bd7058eb3e0d1ece4ddd5ef9c25767978fabbca81b163544a63d9cf Jun 09 03:12:07.540703 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:07.540668 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c1979651-4139-4315-a4aa-8c48a8f0ca72","Type":"ContainerStarted","Data":"ee7ebc2d9bd7058eb3e0d1ece4ddd5ef9c25767978fabbca81b163544a63d9cf"} Jun 09 03:12:11.570122 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:11.570007 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c1979651-4139-4315-a4aa-8c48a8f0ca72","Type":"ContainerStarted","Data":"5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb"} Jun 09 03:12:11.589011 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:11.588942 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.089287825 podStartE2EDuration="5.588921639s" totalImagesPullingTime="4.499633814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:12:11.585656214 +0000 UTC m=+748.584662659" watchObservedRunningTime="2026-06-09 03:12:11.588921639 +0000 UTC m=+748.587928090" Jun 09 03:12:11.617677 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:11.617635 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 03:12:11.619357 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:11.619324 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:12.617964 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:12.617911 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:13.617940 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:13.617886 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:14.617200 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:14.617149 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:15.618070 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:15.618012 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:16.617439 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:16.617390 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 03:12:16.618785 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:16.618741 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:17.617910 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:17.617865 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:18.618200 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:18.618161 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:19.617869 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:19.617395 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:20.617994 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:20.617951 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:21.617393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:21.617338 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:22.617894 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:22.617845 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:23.618108 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:23.618058 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:24.617339 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:24.617290 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 03:12:25.747293 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:25.747248 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 03:12:25.765857 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:25.765805 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:12:35.753238 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:35.753195 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 03:12:36.410615 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:36.410576 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:12:37.383086 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:37.383051 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:12:41.319365 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:41.319326 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:12:41.418105 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:41.418069 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:12:41.467189 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:41.467156 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:12:41.534882 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:41.534848 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:12:44.718594 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:44.718560 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:12:44.812458 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:12:44.812425 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:13:00.558393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:00.558289 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:13:12.600840 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:12.600802 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:13:13.038965 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.038927 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:13:13.142012 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.141977 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:13:13.151129 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.151094 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-jq6s4"] Jun 09 03:13:13.154765 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.154742 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-jq6s4" Jun 09 03:13:13.157213 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.157149 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 03:13:13.157213 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.157188 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-v655q\"" Jun 09 03:13:13.167640 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.167537 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-jq6s4"] Jun 09 03:13:13.172863 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.172832 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-bxtnd"] Jun 09 03:13:13.176946 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.176921 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-bxtnd"] Jun 09 03:13:13.177075 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.177006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:13:13.281617 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.281576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh9mb\" (UniqueName: \"kubernetes.io/projected/30f4fea3-195a-4ae7-8b9b-2eff6030b24e-kube-api-access-xh9mb\") pod \"payload-pre-processing-67d7689b65-jq6s4\" (UID: \"30f4fea3-195a-4ae7-8b9b-2eff6030b24e\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-jq6s4" Jun 09 03:13:13.281803 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.281624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjfw\" (UniqueName: \"kubernetes.io/projected/56dbf406-ab32-4196-9eff-d1467f1d8b6f-kube-api-access-5hjfw\") pod \"payload-processing-7c6c859784-bxtnd\" (UID: \"56dbf406-ab32-4196-9eff-d1467f1d8b6f\") " pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:13:13.382662 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.382568 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh9mb\" (UniqueName: \"kubernetes.io/projected/30f4fea3-195a-4ae7-8b9b-2eff6030b24e-kube-api-access-xh9mb\") pod \"payload-pre-processing-67d7689b65-jq6s4\" (UID: \"30f4fea3-195a-4ae7-8b9b-2eff6030b24e\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-jq6s4" Jun 09 03:13:13.382662 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.382612 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjfw\" (UniqueName: \"kubernetes.io/projected/56dbf406-ab32-4196-9eff-d1467f1d8b6f-kube-api-access-5hjfw\") pod \"payload-processing-7c6c859784-bxtnd\" (UID: \"56dbf406-ab32-4196-9eff-d1467f1d8b6f\") " pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:13:13.396922 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.396891 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjfw\" (UniqueName: \"kubernetes.io/projected/56dbf406-ab32-4196-9eff-d1467f1d8b6f-kube-api-access-5hjfw\") pod \"payload-processing-7c6c859784-bxtnd\" (UID: \"56dbf406-ab32-4196-9eff-d1467f1d8b6f\") " pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:13:13.397076 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.397057 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh9mb\" (UniqueName: \"kubernetes.io/projected/30f4fea3-195a-4ae7-8b9b-2eff6030b24e-kube-api-access-xh9mb\") pod \"payload-pre-processing-67d7689b65-jq6s4\" (UID: \"30f4fea3-195a-4ae7-8b9b-2eff6030b24e\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-jq6s4" Jun 09 03:13:13.472908 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.472869 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-jq6s4" Jun 09 03:13:13.489454 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.489411 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:13:13.636420 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.636380 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-jq6s4"] Jun 09 03:13:13.637371 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:13:13.637337 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f4fea3_195a_4ae7_8b9b_2eff6030b24e.slice/crio-83621bf170e64effc88ed0c8f9de7118e0061674e5d9f8e19e1d35c86a17f454 WatchSource:0}: Error finding container 83621bf170e64effc88ed0c8f9de7118e0061674e5d9f8e19e1d35c86a17f454: Status 404 returned error can't find the container with id 83621bf170e64effc88ed0c8f9de7118e0061674e5d9f8e19e1d35c86a17f454 Jun 09 03:13:13.639420 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.639402 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 03:13:13.660332 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.660304 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-bxtnd"] Jun 09 03:13:13.662251 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:13:13.662222 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56dbf406_ab32_4196_9eff_d1467f1d8b6f.slice/crio-228aa31a5efbe76a80cb76c4c43a060329741eb535568816dfc661e220f861b8 WatchSource:0}: Error finding container 228aa31a5efbe76a80cb76c4c43a060329741eb535568816dfc661e220f861b8: Status 404 returned error can't find the container with id 228aa31a5efbe76a80cb76c4c43a060329741eb535568816dfc661e220f861b8 Jun 09 03:13:13.919181 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.919144 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" event={"ID":"56dbf406-ab32-4196-9eff-d1467f1d8b6f","Type":"ContainerStarted","Data":"228aa31a5efbe76a80cb76c4c43a060329741eb535568816dfc661e220f861b8"} Jun 09 03:13:13.920316 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:13.920291 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-jq6s4" event={"ID":"30f4fea3-195a-4ae7-8b9b-2eff6030b24e","Type":"ContainerStarted","Data":"83621bf170e64effc88ed0c8f9de7118e0061674e5d9f8e19e1d35c86a17f454"} Jun 09 03:13:16.941811 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:16.941768 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" event={"ID":"56dbf406-ab32-4196-9eff-d1467f1d8b6f","Type":"ContainerStarted","Data":"a9cb6d5966daf7972ac313778409964e229b72c9d12b93603da61b1b49253e94"} Jun 09 03:13:16.942309 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:16.941901 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:13:16.943689 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:16.943660 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-jq6s4" event={"ID":"30f4fea3-195a-4ae7-8b9b-2eff6030b24e","Type":"ContainerStarted","Data":"c56a1c5744e2bb2dd7d262cbae2d1809f94e42b14f0f307463ce02f8a88df3c7"} Jun 09 03:13:16.943800 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:16.943716 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-jq6s4" Jun 09 03:13:16.956346 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:16.956273 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" podStartSLOduration=1.636179585 podStartE2EDuration="3.956252651s" totalImagesPullingTime="2.320073066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:13:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:13:16.955307089 +0000 UTC m=+813.954313535" watchObservedRunningTime="2026-06-09 03:13:16.956252651 +0000 UTC m=+813.955259100" Jun 09 03:13:16.969558 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:16.969355 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-jq6s4" podStartSLOduration=1.619276196 podStartE2EDuration="3.969337345s" totalImagesPullingTime="2.350061149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:13:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:13:16.968997699 +0000 UTC m=+813.968004146" watchObservedRunningTime="2026-06-09 03:13:16.969337345 +0000 UTC m=+813.968343792" Jun 09 03:13:23.601331 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:23.601303 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 03:13:23.601818 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:23.601542 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" containerID="cri-o://5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb" gracePeriod=30 Jun 09 03:13:25.652674 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:25.652644 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:25.686921 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:25.686882 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbzgw\" (UniqueName: \"kubernetes.io/projected/c1979651-4139-4315-a4aa-8c48a8f0ca72-kube-api-access-nbzgw\") pod \"c1979651-4139-4315-a4aa-8c48a8f0ca72\" (UID: \"c1979651-4139-4315-a4aa-8c48a8f0ca72\") " Jun 09 03:13:25.689063 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:25.689037 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1979651-4139-4315-a4aa-8c48a8f0ca72-kube-api-access-nbzgw" (OuterVolumeSpecName: "kube-api-access-nbzgw") pod "c1979651-4139-4315-a4aa-8c48a8f0ca72" (UID: "c1979651-4139-4315-a4aa-8c48a8f0ca72"). InnerVolumeSpecName "kube-api-access-nbzgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 03:13:25.787757 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:25.787663 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbzgw\" (UniqueName: \"kubernetes.io/projected/c1979651-4139-4315-a4aa-8c48a8f0ca72-kube-api-access-nbzgw\") on node \"ip-10-0-136-172.ec2.internal\" DevicePath \"\"" Jun 09 03:13:25.991903 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:25.991872 2568 generic.go:356] "Generic (PLEG): container finished" podID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerID="5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb" exitCode=143 Jun 09 03:13:25.992109 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:25.991925 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:25.992109 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:25.991936 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c1979651-4139-4315-a4aa-8c48a8f0ca72","Type":"ContainerDied","Data":"5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb"} Jun 09 03:13:25.992109 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:25.991974 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c1979651-4139-4315-a4aa-8c48a8f0ca72","Type":"ContainerDied","Data":"ee7ebc2d9bd7058eb3e0d1ece4ddd5ef9c25767978fabbca81b163544a63d9cf"} Jun 09 03:13:25.992109 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:25.991995 2568 scope.go:117] "RemoveContainer" containerID="5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb" Jun 09 03:13:26.002482 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.002455 2568 scope.go:117] "RemoveContainer" containerID="5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb" Jun 09 03:13:26.002823 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:13:26.002801 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb\": container with ID starting with 5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb not found: ID does not exist" containerID="5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb" Jun 09 03:13:26.002895 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.002838 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb"} err="failed to get container status \"5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb\": rpc error: code = NotFound desc = could not find container \"5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb\": container with ID starting with 5ad39a8d3678f60bcc6b11dc45f683adfa5ef09d177c9ae48e649ccffb91e3eb not found: ID does not exist" Jun 09 03:13:26.015197 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.015171 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 03:13:26.019271 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.019244 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 03:13:26.039325 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.039230 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 03:13:26.039756 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.039736 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" Jun 09 03:13:26.039856 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.039758 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" Jun 09 03:13:26.039914 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.039856 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" containerName="keycloak" Jun 09 03:13:26.044577 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.044551 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:26.046818 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.046797 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 03:13:26.046937 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.046916 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 03:13:26.047155 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.047142 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rf2z5\"" Jun 09 03:13:26.047228 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.047212 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 03:13:26.047296 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.047282 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 03:13:26.052385 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.052065 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 03:13:26.091032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.090989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2nvg\" (UniqueName: \"kubernetes.io/projected/0e3418f4-9497-485f-b220-cf3bdd2393da-kube-api-access-m2nvg\") pod \"maas-keycloak-0\" (UID: \"0e3418f4-9497-485f-b220-cf3bdd2393da\") " pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:26.091032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.091031 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0e3418f4-9497-485f-b220-cf3bdd2393da-test-realms\") pod \"maas-keycloak-0\" (UID: \"0e3418f4-9497-485f-b220-cf3bdd2393da\") " pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:26.191599 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.191558 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2nvg\" (UniqueName: \"kubernetes.io/projected/0e3418f4-9497-485f-b220-cf3bdd2393da-kube-api-access-m2nvg\") pod \"maas-keycloak-0\" (UID: \"0e3418f4-9497-485f-b220-cf3bdd2393da\") " pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:26.191599 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.191605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0e3418f4-9497-485f-b220-cf3bdd2393da-test-realms\") pod \"maas-keycloak-0\" (UID: \"0e3418f4-9497-485f-b220-cf3bdd2393da\") " pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:26.192276 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.192259 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0e3418f4-9497-485f-b220-cf3bdd2393da-test-realms\") pod \"maas-keycloak-0\" (UID: \"0e3418f4-9497-485f-b220-cf3bdd2393da\") " pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:26.200678 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.200657 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2nvg\" (UniqueName: \"kubernetes.io/projected/0e3418f4-9497-485f-b220-cf3bdd2393da-kube-api-access-m2nvg\") pod \"maas-keycloak-0\" (UID: \"0e3418f4-9497-485f-b220-cf3bdd2393da\") " pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:26.355351 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.355260 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:26.491973 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:26.491944 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 03:13:26.494519 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:13:26.494479 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e3418f4_9497_485f_b220_cf3bdd2393da.slice/crio-25d2356251428d3b1e2637028985e44a01ae9889c8d1d3f8cad7256c00dc5146 WatchSource:0}: Error finding container 25d2356251428d3b1e2637028985e44a01ae9889c8d1d3f8cad7256c00dc5146: Status 404 returned error can't find the container with id 25d2356251428d3b1e2637028985e44a01ae9889c8d1d3f8cad7256c00dc5146 Jun 09 03:13:27.000373 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:27.000322 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0e3418f4-9497-485f-b220-cf3bdd2393da","Type":"ContainerStarted","Data":"d1b0af56eaba80ad046a5c01e085055fe99797537203950031d9776c192dd71e"} Jun 09 03:13:27.000988 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:27.000390 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0e3418f4-9497-485f-b220-cf3bdd2393da","Type":"ContainerStarted","Data":"25d2356251428d3b1e2637028985e44a01ae9889c8d1d3f8cad7256c00dc5146"} Jun 09 03:13:27.017106 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:27.017040 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.712105988 podStartE2EDuration="1.017017821s" totalImagesPullingTime="304.911833ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:13:27.016069291 +0000 UTC m=+824.015075735" watchObservedRunningTime="2026-06-09 03:13:27.017017821 +0000 UTC m=+824.016024267" Jun 09 03:13:27.356420 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:27.356380 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:27.358472 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:27.358428 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:27.419444 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:27.419392 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1979651-4139-4315-a4aa-8c48a8f0ca72" path="/var/lib/kubelet/pods/c1979651-4139-4315-a4aa-8c48a8f0ca72/volumes" Jun 09 03:13:27.951699 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:27.951672 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:13:27.951909 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:27.951822 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-jq6s4" Jun 09 03:13:28.356932 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:28.356818 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:29.356162 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:29.356109 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:30.355982 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:30.355927 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:31.356444 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:31.356396 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:32.356156 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:32.356100 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:33.356001 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:33.355945 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:34.356182 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:34.356127 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:35.356426 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:35.356369 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:36.355844 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:36.355806 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:36.356161 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:36.356133 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:37.356593 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:37.356537 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:38.356263 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:38.356213 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:39.356560 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:39.356508 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 09 03:13:40.488547 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:40.488509 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 03:13:40.509876 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:40.509810 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:13:43.123512 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:43.123436 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:13:50.494682 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:13:50.494631 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0e3418f4-9497-485f-b220-cf3bdd2393da" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 03:14:00.494283 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:00.494250 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 03:14:12.804284 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:12.804240 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:14:12.894807 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:12.894773 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:14:26.989534 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:26.989429 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7"] Jun 09 03:14:26.993373 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:26.993349 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:26.997058 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:26.997031 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 03:14:26.997058 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:26.997050 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 03:14:26.997239 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:26.997032 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tm2kp\"" Jun 09 03:14:26.997239 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:26.997031 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 03:14:27.002081 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.002057 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7"] Jun 09 03:14:27.051793 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.051755 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.051982 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.051815 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.051982 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.051854 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.051982 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.051940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22ftj\" (UniqueName: \"kubernetes.io/projected/31416040-141a-4009-9d31-a41ebafca38a-kube-api-access-22ftj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.052098 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.052000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.052098 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.052022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31416040-141a-4009-9d31-a41ebafca38a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.071079 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.071043 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:14:27.152680 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.152642 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22ftj\" (UniqueName: \"kubernetes.io/projected/31416040-141a-4009-9d31-a41ebafca38a-kube-api-access-22ftj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.152887 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.152716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.152887 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.152744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31416040-141a-4009-9d31-a41ebafca38a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.152887 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.152784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.152887 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.152817 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.152887 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.152850 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.153213 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.153180 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.153325 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.153226 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.153325 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.153247 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.155362 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.155339 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31416040-141a-4009-9d31-a41ebafca38a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.155527 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.155486 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31416040-141a-4009-9d31-a41ebafca38a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.161928 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.161904 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22ftj\" (UniqueName: \"kubernetes.io/projected/31416040-141a-4009-9d31-a41ebafca38a-kube-api-access-22ftj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7\" (UID: \"31416040-141a-4009-9d31-a41ebafca38a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.305209 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.305119 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:27.444193 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:27.444156 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7"] Jun 09 03:14:27.449538 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:14:27.449479 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31416040_141a_4009_9d31_a41ebafca38a.slice/crio-02492161112c4935dcb14b264e208c64ed12df37fc8558ee8eab0d071536d2c7 WatchSource:0}: Error finding container 02492161112c4935dcb14b264e208c64ed12df37fc8558ee8eab0d071536d2c7: Status 404 returned error can't find the container with id 02492161112c4935dcb14b264e208c64ed12df37fc8558ee8eab0d071536d2c7 Jun 09 03:14:28.368541 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:28.368490 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" event={"ID":"31416040-141a-4009-9d31-a41ebafca38a","Type":"ContainerStarted","Data":"02492161112c4935dcb14b264e208c64ed12df37fc8558ee8eab0d071536d2c7"} Jun 09 03:14:32.398631 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.398593 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" event={"ID":"31416040-141a-4009-9d31-a41ebafca38a","Type":"ContainerStarted","Data":"72cadb0c49e20ff4cfdb8bf3091800df4ad0851f210471371225f5b8d442e83a"} Jun 09 03:14:32.668094 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.668061 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp"] Jun 09 03:14:32.672446 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.672427 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.674958 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.674938 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 03:14:32.681480 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.681454 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp"] Jun 09 03:14:32.700015 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.699986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.700179 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.700028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.700179 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.700051 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.700179 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.700097 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876c279e-84e2-431d-b7fd-0b76de46341d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.700179 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.700138 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdmdq\" (UniqueName: \"kubernetes.io/projected/876c279e-84e2-431d-b7fd-0b76de46341d-kube-api-access-vdmdq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.700367 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.700217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.786137 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.786103 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:14:32.801555 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.801526 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.801649 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.801577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.801649 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.801606 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.801649 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.801621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876c279e-84e2-431d-b7fd-0b76de46341d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.801649 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.801639 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdmdq\" (UniqueName: \"kubernetes.io/projected/876c279e-84e2-431d-b7fd-0b76de46341d-kube-api-access-vdmdq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.801805 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.801695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.802045 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.802019 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.802168 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.802049 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.802168 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.802059 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.803758 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.803739 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876c279e-84e2-431d-b7fd-0b76de46341d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.804059 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.804043 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876c279e-84e2-431d-b7fd-0b76de46341d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.810384 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.810360 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdmdq\" (UniqueName: \"kubernetes.io/projected/876c279e-84e2-431d-b7fd-0b76de46341d-kube-api-access-vdmdq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b8xwp\" (UID: \"876c279e-84e2-431d-b7fd-0b76de46341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:32.983662 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:32.983553 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:33.122569 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:33.122543 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp"] Jun 09 03:14:33.124550 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:14:33.124523 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876c279e_84e2_431d_b7fd_0b76de46341d.slice/crio-5479d85a82fe6c7a19b9d9992dc6edee83d350a87e10dcdb482872a7f5e672b2 WatchSource:0}: Error finding container 5479d85a82fe6c7a19b9d9992dc6edee83d350a87e10dcdb482872a7f5e672b2: Status 404 returned error can't find the container with id 5479d85a82fe6c7a19b9d9992dc6edee83d350a87e10dcdb482872a7f5e672b2 Jun 09 03:14:33.405006 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:33.404901 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" event={"ID":"876c279e-84e2-431d-b7fd-0b76de46341d","Type":"ContainerStarted","Data":"69eea5e06265b3fba925d6f6e1322b41d93144b619a8af46b402455534d0be9c"} Jun 09 03:14:33.405006 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:33.404957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" event={"ID":"876c279e-84e2-431d-b7fd-0b76de46341d","Type":"ContainerStarted","Data":"5479d85a82fe6c7a19b9d9992dc6edee83d350a87e10dcdb482872a7f5e672b2"} Jun 09 03:14:35.415919 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:35.415879 2568 generic.go:356] "Generic (PLEG): container finished" podID="876c279e-84e2-431d-b7fd-0b76de46341d" containerID="69eea5e06265b3fba925d6f6e1322b41d93144b619a8af46b402455534d0be9c" exitCode=0 Jun 09 03:14:35.416379 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:35.416353 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" event={"ID":"876c279e-84e2-431d-b7fd-0b76de46341d","Type":"ContainerDied","Data":"69eea5e06265b3fba925d6f6e1322b41d93144b619a8af46b402455534d0be9c"} Jun 09 03:14:37.428074 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:37.428040 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" event={"ID":"876c279e-84e2-431d-b7fd-0b76de46341d","Type":"ContainerStarted","Data":"a08c29dc076770e108d088fb6409cdf3ebe61211f520ab747b8623c331bf2286"} Jun 09 03:14:37.447177 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:37.447127 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" podStartSLOduration=3.149510986 podStartE2EDuration="5.447108888s" totalImagesPullingTime="1.057762574s" totalInitContainerRuntime="1.239835328s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:14:37.445448404 +0000 UTC m=+894.444454866" watchObservedRunningTime="2026-06-09 03:14:37.447108888 +0000 UTC m=+894.446115333" Jun 09 03:14:40.445162 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:40.445122 2568 generic.go:356] "Generic (PLEG): container finished" podID="31416040-141a-4009-9d31-a41ebafca38a" containerID="72cadb0c49e20ff4cfdb8bf3091800df4ad0851f210471371225f5b8d442e83a" exitCode=0 Jun 09 03:14:40.445572 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:40.445190 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" event={"ID":"31416040-141a-4009-9d31-a41ebafca38a","Type":"ContainerDied","Data":"72cadb0c49e20ff4cfdb8bf3091800df4ad0851f210471371225f5b8d442e83a"} Jun 09 03:14:41.452866 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:41.452830 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" event={"ID":"31416040-141a-4009-9d31-a41ebafca38a","Type":"ContainerStarted","Data":"88b0876a33d5a35290b2e3a2a493a59b7a0c6ee30580937d37e74bc7236632b4"} Jun 09 03:14:41.474318 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:41.474249 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" podStartSLOduration=3.178580917 podStartE2EDuration="15.474227958s" totalImagesPullingTime="4.139180674s" totalInitContainerRuntime="8.156466367s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:14:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:14:41.470044757 +0000 UTC m=+898.469051212" watchObservedRunningTime="2026-06-09 03:14:41.474227958 +0000 UTC m=+898.473234416" Jun 09 03:14:42.984543 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:42.984481 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:42.984960 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:42.984583 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:42.997156 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:42.997124 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:43.424069 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:43.424045 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:14:43.424442 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:43.424420 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:14:43.430209 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:43.430183 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:14:43.430359 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:43.430304 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:14:43.475118 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:43.475089 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b8xwp" Jun 09 03:14:44.612384 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:44.612346 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:14:47.305585 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:47.305546 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:47.305585 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:47.305611 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:47.318404 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:47.318352 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:47.496150 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:47.496118 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7" Jun 09 03:14:53.073960 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.073923 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt"] Jun 09 03:14:53.085956 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.085929 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.086364 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.086329 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt"] Jun 09 03:14:53.088618 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.088571 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 03:14:53.110645 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.110613 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:14:53.199948 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.199910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj7hf\" (UniqueName: \"kubernetes.io/projected/c96cad81-d173-45b2-9602-3ef50ecbf111-kube-api-access-vj7hf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.199948 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.199949 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.200165 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.199970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.200165 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.200130 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.200238 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.200173 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.200238 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.200212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c96cad81-d173-45b2-9602-3ef50ecbf111-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.301732 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.301694 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.301732 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.301740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.301964 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.301835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c96cad81-d173-45b2-9602-3ef50ecbf111-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.301964 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.301911 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj7hf\" (UniqueName: \"kubernetes.io/projected/c96cad81-d173-45b2-9602-3ef50ecbf111-kube-api-access-vj7hf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.301964 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.301932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.301964 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.301951 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.302176 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.302142 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.302248 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.302176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.302389 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.302371 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.304239 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.304211 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c96cad81-d173-45b2-9602-3ef50ecbf111-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.304529 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.304490 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c96cad81-d173-45b2-9602-3ef50ecbf111-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.309428 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.309403 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj7hf\" (UniqueName: \"kubernetes.io/projected/c96cad81-d173-45b2-9602-3ef50ecbf111-kube-api-access-vj7hf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt\" (UID: \"c96cad81-d173-45b2-9602-3ef50ecbf111\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.399044 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.398928 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:14:53.553762 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:53.553738 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt"] Jun 09 03:14:53.555865 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:14:53.555836 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc96cad81_d173_45b2_9602_3ef50ecbf111.slice/crio-12e7a06b9f49ddbd7e9daa20e606693116b3c81614913fdb516d9f1bc9cf5ae6 WatchSource:0}: Error finding container 12e7a06b9f49ddbd7e9daa20e606693116b3c81614913fdb516d9f1bc9cf5ae6: Status 404 returned error can't find the container with id 12e7a06b9f49ddbd7e9daa20e606693116b3c81614913fdb516d9f1bc9cf5ae6 Jun 09 03:14:54.522652 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:54.522611 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" event={"ID":"c96cad81-d173-45b2-9602-3ef50ecbf111","Type":"ContainerStarted","Data":"1b554cf52d4f5da7d52ccfd4dcd1e353b85ee5d2e02f3ec6954ee91d84d99c8f"} Jun 09 03:14:54.523085 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:54.522680 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" event={"ID":"c96cad81-d173-45b2-9602-3ef50ecbf111","Type":"ContainerStarted","Data":"12e7a06b9f49ddbd7e9daa20e606693116b3c81614913fdb516d9f1bc9cf5ae6"} Jun 09 03:14:55.529944 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:55.529909 2568 generic.go:356] "Generic (PLEG): container finished" podID="c96cad81-d173-45b2-9602-3ef50ecbf111" containerID="1b554cf52d4f5da7d52ccfd4dcd1e353b85ee5d2e02f3ec6954ee91d84d99c8f" exitCode=0 Jun 09 03:14:55.530354 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:55.529994 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" event={"ID":"c96cad81-d173-45b2-9602-3ef50ecbf111","Type":"ContainerDied","Data":"1b554cf52d4f5da7d52ccfd4dcd1e353b85ee5d2e02f3ec6954ee91d84d99c8f"} Jun 09 03:14:56.538021 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:56.537974 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" event={"ID":"c96cad81-d173-45b2-9602-3ef50ecbf111","Type":"ContainerStarted","Data":"2715953f23fcf055b67e84fef86d9310938c3ae2dac4f5111511b1be62fbc252"} Jun 09 03:14:56.555761 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:14:56.555708 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" podStartSLOduration=2.15716619 podStartE2EDuration="3.555692223s" totalImagesPullingTime="187.404009ms" totalInitContainerRuntime="1.211122024s" isStatefulPod=false podCreationTimestamp="2026-06-09 03:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:14:56.553745115 +0000 UTC m=+913.552751597" watchObservedRunningTime="2026-06-09 03:14:56.555692223 +0000 UTC m=+913.554698714" Jun 09 03:15:03.399576 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:03.399528 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:15:03.400092 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:03.399639 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:15:03.417861 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:03.417835 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:15:03.585287 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:03.585254 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt" Jun 09 03:15:07.142245 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:07.142214 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:15:14.106060 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:14.106028 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:15:16.646741 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:16.646706 2568 generic.go:356] "Generic (PLEG): container finished" podID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" containerID="a9cb6d5966daf7972ac313778409964e229b72c9d12b93603da61b1b49253e94" exitCode=1 Jun 09 03:15:16.647140 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:16.646780 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" event={"ID":"56dbf406-ab32-4196-9eff-d1467f1d8b6f","Type":"ContainerDied","Data":"a9cb6d5966daf7972ac313778409964e229b72c9d12b93603da61b1b49253e94"} Jun 09 03:15:16.647190 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:16.647152 2568 scope.go:117] "RemoveContainer" containerID="a9cb6d5966daf7972ac313778409964e229b72c9d12b93603da61b1b49253e94" Jun 09 03:15:17.653929 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:17.653896 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" event={"ID":"56dbf406-ab32-4196-9eff-d1467f1d8b6f","Type":"ContainerStarted","Data":"d27d2ae2ed52fd64865b4ec8654056e28c97eb197597b7e90292d693f49578e9"} Jun 09 03:15:17.654329 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:17.654097 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:15:19.313382 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:19.313325 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:15:28.661053 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:15:28.661022 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:17:17.271277 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:17:17.271241 2568 generic.go:356] "Generic (PLEG): container finished" podID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" containerID="d27d2ae2ed52fd64865b4ec8654056e28c97eb197597b7e90292d693f49578e9" exitCode=1 Jun 09 03:17:17.271743 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:17:17.271311 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" event={"ID":"56dbf406-ab32-4196-9eff-d1467f1d8b6f","Type":"ContainerDied","Data":"d27d2ae2ed52fd64865b4ec8654056e28c97eb197597b7e90292d693f49578e9"} Jun 09 03:17:17.271743 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:17:17.271401 2568 scope.go:117] "RemoveContainer" containerID="a9cb6d5966daf7972ac313778409964e229b72c9d12b93603da61b1b49253e94" Jun 09 03:17:17.271834 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:17:17.271772 2568 scope.go:117] "RemoveContainer" containerID="d27d2ae2ed52fd64865b4ec8654056e28c97eb197597b7e90292d693f49578e9" Jun 09 03:17:17.272049 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:17:17.272019 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-bxtnd_openshift-ingress(56dbf406-ab32-4196-9eff-d1467f1d8b6f)\"" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" podUID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" Jun 09 03:17:18.659590 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:17:18.659551 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:17:18.659973 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:17:18.659935 2568 scope.go:117] "RemoveContainer" containerID="d27d2ae2ed52fd64865b4ec8654056e28c97eb197597b7e90292d693f49578e9" Jun 09 03:17:18.660180 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:17:18.660158 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-bxtnd_openshift-ingress(56dbf406-ab32-4196-9eff-d1467f1d8b6f)\"" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" podUID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" Jun 09 03:17:32.410506 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:17:32.410462 2568 scope.go:117] "RemoveContainer" containerID="d27d2ae2ed52fd64865b4ec8654056e28c97eb197597b7e90292d693f49578e9" Jun 09 03:17:33.359694 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:17:33.359654 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" event={"ID":"56dbf406-ab32-4196-9eff-d1467f1d8b6f","Type":"ContainerStarted","Data":"b58373832ff6443b319fc51e61c4f367c7ef18d6e895b97d14064ebffeb0c20b"} Jun 09 03:17:33.359896 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:17:33.359878 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:17:44.366546 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:17:44.366490 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:18:24.453212 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:18:24.453180 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:18:25.477061 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:18:25.477024 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:19:32.984879 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:32.984845 2568 generic.go:356] "Generic (PLEG): container finished" podID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" containerID="b58373832ff6443b319fc51e61c4f367c7ef18d6e895b97d14064ebffeb0c20b" exitCode=1 Jun 09 03:19:32.985397 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:32.984891 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" event={"ID":"56dbf406-ab32-4196-9eff-d1467f1d8b6f","Type":"ContainerDied","Data":"b58373832ff6443b319fc51e61c4f367c7ef18d6e895b97d14064ebffeb0c20b"} Jun 09 03:19:32.985397 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:32.984941 2568 scope.go:117] "RemoveContainer" containerID="d27d2ae2ed52fd64865b4ec8654056e28c97eb197597b7e90292d693f49578e9" Jun 09 03:19:32.985397 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:32.985275 2568 scope.go:117] "RemoveContainer" containerID="b58373832ff6443b319fc51e61c4f367c7ef18d6e895b97d14064ebffeb0c20b" Jun 09 03:19:32.985623 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:19:32.985598 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-bxtnd_openshift-ingress(56dbf406-ab32-4196-9eff-d1467f1d8b6f)\"" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" podUID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" Jun 09 03:19:33.489672 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:33.489638 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:19:33.991448 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:33.991420 2568 scope.go:117] "RemoveContainer" containerID="b58373832ff6443b319fc51e61c4f367c7ef18d6e895b97d14064ebffeb0c20b" Jun 09 03:19:33.991862 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:19:33.991673 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-bxtnd_openshift-ingress(56dbf406-ab32-4196-9eff-d1467f1d8b6f)\"" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" podUID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" Jun 09 03:19:34.365168 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:34.365076 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:19:34.996862 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:34.996835 2568 scope.go:117] "RemoveContainer" containerID="b58373832ff6443b319fc51e61c4f367c7ef18d6e895b97d14064ebffeb0c20b" Jun 09 03:19:34.997237 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:19:34.997044 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-bxtnd_openshift-ingress(56dbf406-ab32-4196-9eff-d1467f1d8b6f)\"" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" podUID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" Jun 09 03:19:43.455843 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:43.455814 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:19:43.458062 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:43.458038 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:19:43.461475 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:43.461449 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:19:43.463666 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:43.463646 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9rp4j_91ad2818-5103-48f9-ad94-616c4956273d/ovn-acl-logging/0.log" Jun 09 03:19:48.410406 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:48.410372 2568 scope.go:117] "RemoveContainer" containerID="b58373832ff6443b319fc51e61c4f367c7ef18d6e895b97d14064ebffeb0c20b" Jun 09 03:19:48.410894 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:19:48.410609 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-bxtnd_openshift-ingress(56dbf406-ab32-4196-9eff-d1467f1d8b6f)\"" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" podUID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" Jun 09 03:19:59.410819 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:19:59.410780 2568 scope.go:117] "RemoveContainer" containerID="b58373832ff6443b319fc51e61c4f367c7ef18d6e895b97d14064ebffeb0c20b" Jun 09 03:20:00.129024 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:20:00.128986 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" event={"ID":"56dbf406-ab32-4196-9eff-d1467f1d8b6f","Type":"ContainerStarted","Data":"ee0cab033aa3114b46a3013a488bf6f913d233d6da29efdf4215ebb178ed1a46"} Jun 09 03:20:00.129243 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:20:00.129225 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:20:11.137944 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:20:11.137907 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:21:31.287045 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:31.287016 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d869d9c69-nzczk_3238495a-c320-4c41-9000-0fb474b36822/nginx/0.log" Jun 09 03:21:31.395719 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:31.395688 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-6c59s_7176902c-1232-401e-813f-bc6bddd5cee9/manager/0.log" Jun 09 03:21:31.509953 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:31.509919 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8q5x4_1621b729-03c8-4fda-9305-0c25c62294f6/manager/0.log" Jun 09 03:21:31.965219 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:31.965188 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-fhv8m_8c11ee0e-817e-4a08-9425-cc14e9f01368/server/0.log" Jun 09 03:21:32.086828 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:32.086789 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-2bhpm_bf5390d0-c41f-446b-bec8-1259c9e7ae05/manager/0.log" Jun 09 03:21:32.196395 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:32.196362 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bfbb9599-jl7mq_07949c29-71bf-4662-8767-3cd3373294fd/copy-manifests/0.log" Jun 09 03:21:32.202184 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:32.202159 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bfbb9599-jl7mq_07949c29-71bf-4662-8767-3cd3373294fd/manager/0.log" Jun 09 03:21:32.553685 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:32.553654 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-mfhhh_53f5a3a8-b0e1-4124-b07d-7ebb83c24fba/postgres/0.log" Jun 09 03:21:33.918582 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:33.918554 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jghjm_2856772c-5161-4f70-b200-4c14d18c6371/manager/0.log" Jun 09 03:21:35.071080 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:35.071049 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-brgnd_d1082894-2b31-4ad4-8b71-667c3b106603/discovery/0.log" Jun 09 03:21:35.308061 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:35.308032 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86bb47f4b7-tmbpm_e5d6529d-21ff-4bb5-8d0f-8f2d433d0443/kube-auth-proxy/0.log" Jun 09 03:21:35.530174 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:35.530137 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jq6s4_30f4fea3-195a-4ae7-8b9b-2eff6030b24e/payload-pre-processing/0.log" Jun 09 03:21:35.640249 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:35.640217 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-bxtnd_56dbf406-ab32-4196-9eff-d1467f1d8b6f/payload-processing/3.log" Jun 09 03:21:36.087779 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:36.087749 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7_31416040-141a-4009-9d31-a41ebafca38a/storage-initializer/0.log" Jun 09 03:21:36.094465 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:36.094431 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jpnx7_31416040-141a-4009-9d31-a41ebafca38a/main/0.log" Jun 09 03:21:36.199585 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:36.199557 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-b8xwp_876c279e-84e2-431d-b7fd-0b76de46341d/storage-initializer/0.log" Jun 09 03:21:36.205460 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:36.205436 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-b8xwp_876c279e-84e2-431d-b7fd-0b76de46341d/main/0.log" Jun 09 03:21:36.437631 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:36.437605 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt_c96cad81-d173-45b2-9602-3ef50ecbf111/storage-initializer/0.log" Jun 09 03:21:36.444309 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:36.444288 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckvfzt_c96cad81-d173-45b2-9602-3ef50ecbf111/main/0.log" Jun 09 03:21:40.876171 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:40.876132 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:21:40.931590 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:40.931556 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" limit=1024 Jun 09 03:21:43.839818 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:43.839787 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5qbmr_a7455a43-a416-40a2-b102-d498bf398269/global-pull-secret-syncer/0.log" Jun 09 03:21:43.922058 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:43.922029 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hnwtf_14c0ecc7-1fa2-461d-b171-4fe38f21b310/konnectivity-agent/0.log" Jun 09 03:21:44.036383 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:44.036355 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-172.ec2.internal_9c31be9ab5b45b5bc46bc0a18af81246/haproxy/0.log" Jun 09 03:21:48.424520 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:48.424470 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-wz7kp_33e101e6-300b-4d8b-82b0-8e24acded8c2/sail-operator/0.log" Jun 09 03:21:48.822586 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:48.822466 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jghjm_2856772c-5161-4f70-b200-4c14d18c6371/manager/0.log" Jun 09 03:21:51.016365 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:51.016268 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-fcglz_a839c710-8579-45a6-adfa-ebb6eea7d32d/cluster-monitoring-operator/0.log" Jun 09 03:21:51.335473 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:51.335378 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5wqw_20901f4b-4dcd-4ba0-a109-7987e4c72060/node-exporter/0.log" Jun 09 03:21:51.355105 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:51.355080 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5wqw_20901f4b-4dcd-4ba0-a109-7987e4c72060/kube-rbac-proxy/0.log" Jun 09 03:21:51.378922 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:51.378895 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5wqw_20901f4b-4dcd-4ba0-a109-7987e4c72060/init-textfile/0.log" Jun 09 03:21:51.679623 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:51.679595 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xglkm_2659cfe6-7a96-44c8-aade-c0d1308da1b7/prometheus-operator/0.log" Jun 09 03:21:51.697046 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:51.697012 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xglkm_2659cfe6-7a96-44c8-aade-c0d1308da1b7/kube-rbac-proxy/0.log" Jun 09 03:21:53.177656 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.177630 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-lqpxp_21448262-f838-4bae-8fc6-4153bd0b03c7/networking-console-plugin/0.log" Jun 09 03:21:53.717371 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.717336 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq"] Jun 09 03:21:53.721222 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.721200 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.723599 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.723581 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbctj\"/\"openshift-service-ca.crt\"" Jun 09 03:21:53.723701 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.723628 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbctj\"/\"kube-root-ca.crt\"" Jun 09 03:21:53.724683 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.724662 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vbctj\"/\"default-dockercfg-4jj8c\"" Jun 09 03:21:53.728176 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.728106 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq"] Jun 09 03:21:53.776284 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.776253 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/2.log" Jun 09 03:21:53.781088 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.781067 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8w8qw_e3580812-0e71-4a5a-a89c-54745684747b/console-operator/3.log" Jun 09 03:21:53.836308 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.836272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-proc\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.836485 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.836343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-podres\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.836485 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.836387 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-sys\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.836485 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.836408 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-lib-modules\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.836485 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.836469 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69gj8\" (UniqueName: \"kubernetes.io/projected/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-kube-api-access-69gj8\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.937823 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.937781 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-proc\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.938032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.937852 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-podres\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.938032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.937879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-sys\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.938032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.937901 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-lib-modules\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.938032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.937920 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69gj8\" (UniqueName: \"kubernetes.io/projected/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-kube-api-access-69gj8\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.938032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.937920 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-proc\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.938032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.937988 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-sys\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.938032 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.937991 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-podres\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.938322 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.938042 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-lib-modules\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:53.945278 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:53.945254 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69gj8\" (UniqueName: \"kubernetes.io/projected/f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9-kube-api-access-69gj8\") pod \"perf-node-gather-daemonset-jd6pq\" (UID: \"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9\") " pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:54.032641 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:54.032549 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:54.168303 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:54.168277 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq"] Jun 09 03:21:54.170397 ip-10-0-136-172 kubenswrapper[2568]: W0609 03:21:54.170363 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf7092d42_2ce4_45f9_aa1b_7b08c6bda2c9.slice/crio-e8686c0c5a8e25d3fb0fbbfd45fb2ee4650bb7d3c8a7f0e80ad93342a7f4ba4d WatchSource:0}: Error finding container e8686c0c5a8e25d3fb0fbbfd45fb2ee4650bb7d3c8a7f0e80ad93342a7f4ba4d: Status 404 returned error can't find the container with id e8686c0c5a8e25d3fb0fbbfd45fb2ee4650bb7d3c8a7f0e80ad93342a7f4ba4d Jun 09 03:21:54.367526 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:54.367402 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c4b9f8f6d-tkhm5_4511f73b-5f59-4fce-af38-4aa914fc4691/console/0.log" Jun 09 03:21:54.393796 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:54.393763 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-6plxr_5055dee1-09b1-409b-a0c0-4ba74eaf8d11/download-server/0.log" Jun 09 03:21:54.721358 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:54.721323 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" event={"ID":"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9","Type":"ContainerStarted","Data":"1e71652a1f6f35b47d42a4ebf5bf1f36fb4ad6ea1a438b1d777519b8edb14b5d"} Jun 09 03:21:54.721592 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:54.721373 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" event={"ID":"f7092d42-2ce4-45f9-aa1b-7b08c6bda2c9","Type":"ContainerStarted","Data":"e8686c0c5a8e25d3fb0fbbfd45fb2ee4650bb7d3c8a7f0e80ad93342a7f4ba4d"} Jun 09 03:21:54.721592 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:54.721434 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:21:54.736320 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:54.736271 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" podStartSLOduration=1.7362567580000001 podStartE2EDuration="1.736256758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 03:21:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 03:21:54.735053692 +0000 UTC m=+1331.734060143" watchObservedRunningTime="2026-06-09 03:21:54.736256758 +0000 UTC m=+1331.735263202" Jun 09 03:21:55.032044 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:55.031955 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-k9zd7_b31d02dd-8dee-41a7-87cf-a5ef3442c56b/volume-data-source-validator/0.log" Jun 09 03:21:56.260393 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:56.260356 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-klhdv_6dad5db3-bce6-4f82-8696-9c8b7afe16a3/dns/0.log" Jun 09 03:21:56.278151 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:56.278122 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-klhdv_6dad5db3-bce6-4f82-8696-9c8b7afe16a3/kube-rbac-proxy/0.log" Jun 09 03:21:56.322766 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:56.322736 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jnj47_fd66dde4-da1d-49c1-b791-dca66777bd71/dns-node-resolver/0.log" Jun 09 03:21:56.841866 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:56.841837 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-844d889dc8-jn44p_97a80e2c-170f-4125-81d5-8b0c2442c9af/registry/0.log" Jun 09 03:21:56.845927 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:56.845905 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-844d889dc8-jn44p_97a80e2c-170f-4125-81d5-8b0c2442c9af/registry/1.log" Jun 09 03:21:56.864568 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:56.864543 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5vd6f_f00933df-8470-4be5-8679-54ba6a748b3d/node-ca/0.log" Jun 09 03:21:57.867368 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:57.867335 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-brgnd_d1082894-2b31-4ad4-8b71-667c3b106603/discovery/0.log" Jun 09 03:21:57.909238 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:57.909208 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86bb47f4b7-tmbpm_e5d6529d-21ff-4bb5-8d0f-8f2d433d0443/kube-auth-proxy/0.log" Jun 09 03:21:57.952442 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:57.952416 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jq6s4_30f4fea3-195a-4ae7-8b9b-2eff6030b24e/payload-pre-processing/0.log" Jun 09 03:21:57.973237 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:57.973211 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-bxtnd_56dbf406-ab32-4196-9eff-d1467f1d8b6f/payload-processing/3.log" Jun 09 03:21:57.973562 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:57.973549 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-bxtnd_56dbf406-ab32-4196-9eff-d1467f1d8b6f/payload-processing/2.log" Jun 09 03:21:58.589868 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:58.589843 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnc8q_4120ed8e-5060-458f-b402-5aa161b47996/serve-healthcheck-canary/0.log" Jun 09 03:21:59.110019 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:59.109985 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-v2znj_441f01df-e470-46a7-b98b-e5a2b681f3fe/insights-operator/0.log" Jun 09 03:21:59.112089 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:59.112073 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-v2znj_441f01df-e470-46a7-b98b-e5a2b681f3fe/insights-operator/1.log" Jun 09 03:21:59.129684 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:59.129662 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl4dx_32d9bd51-7a3b-41b4-9986-1d98bd901296/kube-rbac-proxy/0.log" Jun 09 03:21:59.147369 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:59.147342 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl4dx_32d9bd51-7a3b-41b4-9986-1d98bd901296/exporter/0.log" Jun 09 03:21:59.165176 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:59.165152 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl4dx_32d9bd51-7a3b-41b4-9986-1d98bd901296/extractor/0.log" Jun 09 03:21:59.748966 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:59.748936 2568 generic.go:356] "Generic (PLEG): container finished" podID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" containerID="ee0cab033aa3114b46a3013a488bf6f913d233d6da29efdf4215ebb178ed1a46" exitCode=1 Jun 09 03:21:59.749154 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:59.749006 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" event={"ID":"56dbf406-ab32-4196-9eff-d1467f1d8b6f","Type":"ContainerDied","Data":"ee0cab033aa3114b46a3013a488bf6f913d233d6da29efdf4215ebb178ed1a46"} Jun 09 03:21:59.749154 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:59.749063 2568 scope.go:117] "RemoveContainer" containerID="b58373832ff6443b319fc51e61c4f367c7ef18d6e895b97d14064ebffeb0c20b" Jun 09 03:21:59.749441 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:21:59.749422 2568 scope.go:117] "RemoveContainer" containerID="ee0cab033aa3114b46a3013a488bf6f913d233d6da29efdf4215ebb178ed1a46" Jun 09 03:21:59.749699 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:21:59.749680 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-bxtnd_openshift-ingress(56dbf406-ab32-4196-9eff-d1467f1d8b6f)\"" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" podUID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" Jun 09 03:22:00.737126 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:00.737094 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vbctj/perf-node-gather-daemonset-jd6pq" Jun 09 03:22:01.136434 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:01.136342 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" Jun 09 03:22:01.136772 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:01.136757 2568 scope.go:117] "RemoveContainer" containerID="ee0cab033aa3114b46a3013a488bf6f913d233d6da29efdf4215ebb178ed1a46" Jun 09 03:22:01.136973 ip-10-0-136-172 kubenswrapper[2568]: E0609 03:22:01.136955 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-bxtnd_openshift-ingress(56dbf406-ab32-4196-9eff-d1467f1d8b6f)\"" pod="openshift-ingress/payload-processing-7c6c859784-bxtnd" podUID="56dbf406-ab32-4196-9eff-d1467f1d8b6f" Jun 09 03:22:01.478845 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:01.478816 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d869d9c69-nzczk_3238495a-c320-4c41-9000-0fb474b36822/nginx/0.log" Jun 09 03:22:01.499764 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:01.499736 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-6c59s_7176902c-1232-401e-813f-bc6bddd5cee9/manager/0.log" Jun 09 03:22:01.530286 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:01.530251 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8q5x4_1621b729-03c8-4fda-9305-0c25c62294f6/manager/0.log" Jun 09 03:22:01.625665 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:01.625635 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-fhv8m_8c11ee0e-817e-4a08-9425-cc14e9f01368/server/0.log" Jun 09 03:22:01.669749 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:01.669712 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-2bhpm_bf5390d0-c41f-446b-bec8-1259c9e7ae05/manager/0.log" Jun 09 03:22:01.690018 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:01.689984 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bfbb9599-jl7mq_07949c29-71bf-4662-8767-3cd3373294fd/manager/0.log" Jun 09 03:22:01.707636 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:01.707614 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bfbb9599-jl7mq_07949c29-71bf-4662-8767-3cd3373294fd/copy-manifests/0.log" Jun 09 03:22:01.843643 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:01.843565 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-mfhhh_53f5a3a8-b0e1-4124-b07d-7ebb83c24fba/postgres/0.log" Jun 09 03:22:08.601598 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:08.601563 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-rshns_93aadb40-03a5-479a-bc7d-145a5a9bd54e/migrator/0.log" Jun 09 03:22:08.619083 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:08.619052 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-rshns_93aadb40-03a5-479a-bc7d-145a5a9bd54e/graceful-termination/0.log" Jun 09 03:22:08.651385 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:08.651352 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-brgnd_d1082894-2b31-4ad4-8b71-667c3b106603/discovery/0.log" Jun 09 03:22:08.684229 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:08.684199 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86bb47f4b7-tmbpm_e5d6529d-21ff-4bb5-8d0f-8f2d433d0443/kube-auth-proxy/0.log" Jun 09 03:22:08.715208 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:08.715181 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jq6s4_30f4fea3-195a-4ae7-8b9b-2eff6030b24e/payload-pre-processing/0.log" Jun 09 03:22:08.731490 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:08.731458 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-bxtnd_56dbf406-ab32-4196-9eff-d1467f1d8b6f/payload-processing/3.log" Jun 09 03:22:08.731661 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:08.731636 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-bxtnd_56dbf406-ab32-4196-9eff-d1467f1d8b6f/payload-processing/3.log" Jun 09 03:22:09.000913 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:09.000883 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-dgfdn_06f2f575-8396-47b7-a2d8-10193c494e6f/kube-storage-version-migrator-operator/1.log" Jun 09 03:22:09.001774 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:09.001756 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-dgfdn_06f2f575-8396-47b7-a2d8-10193c494e6f/kube-storage-version-migrator-operator/0.log" Jun 09 03:22:09.850944 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:09.850898 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-brgnd_d1082894-2b31-4ad4-8b71-667c3b106603/discovery/0.log" Jun 09 03:22:09.878399 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:09.878373 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86bb47f4b7-tmbpm_e5d6529d-21ff-4bb5-8d0f-8f2d433d0443/kube-auth-proxy/0.log" Jun 09 03:22:09.908134 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:09.908103 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jq6s4_30f4fea3-195a-4ae7-8b9b-2eff6030b24e/payload-pre-processing/0.log" Jun 09 03:22:09.925317 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:09.925282 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-bxtnd_56dbf406-ab32-4196-9eff-d1467f1d8b6f/payload-processing/3.log" Jun 09 03:22:09.925523 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:09.925376 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-bxtnd_56dbf406-ab32-4196-9eff-d1467f1d8b6f/payload-processing/3.log" Jun 09 03:22:10.168386 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:10.168357 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2lbc2_2cc03ebb-dd2e-4062-b9a4-2443742319cf/kube-multus/0.log" Jun 09 03:22:10.527384 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:10.527307 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zmx5b_6834b640-f33e-4cc2-96f1-038a55c5ff71/kube-multus-additional-cni-plugins/0.log" Jun 09 03:22:10.545978 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:10.545951 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zmx5b_6834b640-f33e-4cc2-96f1-038a55c5ff71/egress-router-binary-copy/0.log" Jun 09 03:22:10.563941 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:10.563916 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zmx5b_6834b640-f33e-4cc2-96f1-038a55c5ff71/cni-plugins/0.log" Jun 09 03:22:10.581041 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:10.581009 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zmx5b_6834b640-f33e-4cc2-96f1-038a55c5ff71/bond-cni-plugin/0.log" Jun 09 03:22:10.598529 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:10.598491 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zmx5b_6834b640-f33e-4cc2-96f1-038a55c5ff71/routeoverride-cni/0.log" Jun 09 03:22:10.619112 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:10.619086 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zmx5b_6834b640-f33e-4cc2-96f1-038a55c5ff71/whereabouts-cni-bincopy/0.log" Jun 09 03:22:10.637352 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:10.637329 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zmx5b_6834b640-f33e-4cc2-96f1-038a55c5ff71/whereabouts-cni/0.log" Jun 09 03:22:10.685272 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:10.685240 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbpvr_dbfc6f31-41c5-4e02-9e38-2a3248ca1063/network-metrics-daemon/0.log" Jun 09 03:22:10.701505 ip-10-0-136-172 kubenswrapper[2568]: I0609 03:22:10.701468 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbpvr_dbfc6f31-41c5-4e02-9e38-2a3248ca1063/kube-rbac-proxy/0.log"