Jun 15 06:23:00.715828 ip-10-0-140-165 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 15 06:23:00.715842 ip-10-0-140-165 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 15 06:23:00.715852 ip-10-0-140-165 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 15 06:23:00.716176 ip-10-0-140-165 systemd[1]: Failed to start Kubernetes Kubelet. Jun 15 06:23:12.125275 ip-10-0-140-165 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 15 06:23:12.125296 ip-10-0-140-165 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0d6c75a2496946e492772493bebafef3 -- Jun 15 06:25:47.585158 ip-10-0-140-165 systemd[1]: Starting Kubernetes Kubelet... Jun 15 06:25:47.985217 ip-10-0-140-165 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 06:25:47.985217 ip-10-0-140-165 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 06:25:47.985217 ip-10-0-140-165 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 06:25:47.985217 ip-10-0-140-165 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 06:25:47.985217 ip-10-0-140-165 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 06:25:47.986702 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.986607 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 06:25:47.994110 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994089 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 06:25:47.994110 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994109 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994113 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994118 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994122 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994125 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994130 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994135 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994138 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994141 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994144 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994147 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994150 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994152 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994155 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994158 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994161 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994164 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994168 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994170 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994173 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 06:25:47.994179 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994180 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994183 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994187 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994190 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994193 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994197 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994199 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994202 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994205 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994208 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994210 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994213 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994215 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994218 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994221 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994223 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994226 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994228 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994231 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 06:25:47.994664 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994234 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994239 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994242 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994245 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994248 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994250 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994253 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994255 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994258 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994260 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994263 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994265 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994268 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994270 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994273 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994276 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994279 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994282 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994284 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 06:25:47.995146 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994287 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994290 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994292 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994295 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994297 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994300 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994302 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994305 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994307 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994310 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994312 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994316 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994321 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994324 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994326 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994329 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994332 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994334 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994337 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 06:25:47.995612 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994339 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994342 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994344 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994347 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994350 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994352 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994355 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994357 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994360 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994363 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994366 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994369 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994372 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994374 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994377 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994379 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994382 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994384 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994386 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994389 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 06:25:47.996086 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.994391 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995154 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995162 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995165 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995167 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995170 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995178 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995181 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995184 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995187 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995189 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995192 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995197 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995201 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995203 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995206 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995209 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995212 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995214 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995217 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 06:25:47.996582 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995219 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995223 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995226 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995228 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995231 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995234 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995236 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995239 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995241 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995244 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995246 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995249 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995252 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995254 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995256 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995259 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995261 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995264 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995266 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995274 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 06:25:47.997094 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995277 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995280 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995282 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995284 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995289 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995291 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995294 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995298 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995300 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995303 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995305 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995308 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995311 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995314 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995316 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995319 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995322 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995324 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995327 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995329 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 06:25:47.997593 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995332 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995334 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995337 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995339 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995342 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995344 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995347 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995349 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995353 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995356 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995359 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995362 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995365 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995369 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995371 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995374 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995377 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995379 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995381 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995384 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 06:25:47.998101 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995387 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995390 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995392 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995396 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995400 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995403 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995406 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995409 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995412 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995414 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995417 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995419 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995422 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995425 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995427 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995430 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995432 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995435 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995437 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 06:25:47.998613 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995440 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995881 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995887 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995890 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995893 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995896 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995899 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995902 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995905 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995908 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995910 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995913 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995916 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995918 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995921 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995923 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995926 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995929 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995932 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995935 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 06:25:47.999091 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995937 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995940 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995943 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995945 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995949 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995951 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995954 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995956 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995959 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995961 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995964 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995966 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995969 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995971 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995974 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995977 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995979 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995982 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995985 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995988 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 06:25:47.999580 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995991 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995994 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995996 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.995999 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996001 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996004 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996006 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996011 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996014 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996018 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996021 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996024 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996027 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996049 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996054 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996061 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996066 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996069 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996072 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 06:25:48.000116 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996075 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996078 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996080 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996083 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996085 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996089 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996093 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996095 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996098 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996101 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996104 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996107 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996114 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996117 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996119 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996122 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996124 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996127 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996129 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 06:25:48.000578 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996131 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996134 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996141 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996143 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996148 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996150 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996153 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996155 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996158 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996161 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996163 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996166 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996169 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996171 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996174 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996176 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996179 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996182 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996184 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996187 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 06:25:48.001054 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996189 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996192 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996274 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996285 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996296 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996302 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996309 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996314 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996319 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996323 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996326 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996329 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996333 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996336 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996341 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996344 2576 flags.go:64] FLAG: --cgroup-root="" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996348 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996351 2576 flags.go:64] FLAG: --client-ca-file="" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996354 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996357 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996362 2576 flags.go:64] FLAG: --cluster-domain="" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996364 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996367 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996371 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 06:25:48.001595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996374 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996378 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996381 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996384 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996387 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996390 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996393 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996396 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996399 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996402 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996406 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996409 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996412 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996415 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996418 2576 flags.go:64] FLAG: --enable-server="true" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996426 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996431 2576 flags.go:64] FLAG: --event-burst="100" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996435 2576 flags.go:64] FLAG: --event-qps="50" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996438 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996441 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996444 2576 flags.go:64] FLAG: --eviction-hard="" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996448 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996452 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996455 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996463 2576 flags.go:64] FLAG: --eviction-soft="" Jun 15 06:25:48.002202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996467 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996470 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996473 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996476 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996478 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996482 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996485 2576 flags.go:64] FLAG: --feature-gates="" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996489 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996492 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996495 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996502 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996506 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996509 2576 flags.go:64] FLAG: --help="false" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996512 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996516 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996519 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996522 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996525 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996529 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996532 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996535 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996537 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996540 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 06:25:48.002841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996544 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996547 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996550 2576 flags.go:64] FLAG: --kube-reserved="" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996553 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996556 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996559 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996564 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996567 2576 flags.go:64] FLAG: --lock-file="" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996571 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996573 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996577 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996582 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996586 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996588 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996591 2576 flags.go:64] FLAG: --logging-format="text" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996595 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996599 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996602 2576 flags.go:64] FLAG: --manifest-url="" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996606 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996610 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996614 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996618 2576 flags.go:64] FLAG: --max-pods="110" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996621 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996624 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996628 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 06:25:48.003474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996631 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996633 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996636 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996639 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996647 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996650 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996653 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996656 2576 flags.go:64] FLAG: --pod-cidr="" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996660 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996665 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996668 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996671 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996674 2576 flags.go:64] FLAG: --port="10250" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996677 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996682 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-032f89abf076ff2c8" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996686 2576 flags.go:64] FLAG: --qos-reserved="" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996690 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996693 2576 flags.go:64] FLAG: --register-node="true" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996696 2576 flags.go:64] FLAG: --register-with-taints="" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996699 2576 flags.go:64] FLAG: --registry-burst="10" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996702 2576 flags.go:64] FLAG: --registry-qps="5" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996705 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996708 2576 flags.go:64] FLAG: --reserved-memory="" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996712 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996715 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 06:25:48.004141 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996718 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996721 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996724 2576 flags.go:64] FLAG: --runonce="false" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996726 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996729 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996732 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996735 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996738 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996741 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996744 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996747 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996750 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996753 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996756 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996759 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996762 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996766 2576 flags.go:64] FLAG: --system-cgroups="" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996768 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996774 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996777 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996779 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996785 2576 flags.go:64] FLAG: --tls-min-version="" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996789 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996792 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996795 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 06:25:48.004761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996798 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996801 2576 flags.go:64] FLAG: --v="2" Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996805 2576 flags.go:64] FLAG: --version="false" Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996809 2576 flags.go:64] FLAG: --vmodule="" Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996813 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.996816 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996962 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996966 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996970 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996973 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996975 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996978 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996981 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996984 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996987 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996990 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996992 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996995 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.996998 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997000 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997003 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 06:25:48.005414 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997006 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997009 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997012 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997015 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997017 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997020 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997023 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997027 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997031 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997034 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997036 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997039 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997043 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997047 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997050 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997053 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997055 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997058 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997061 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997063 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 06:25:48.005966 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997066 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997069 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997071 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997074 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997076 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997079 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997081 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997084 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997086 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997089 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997092 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997095 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997098 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997101 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997104 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997106 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997109 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997112 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997115 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 06:25:48.006466 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997119 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997123 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997126 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997129 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997131 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997134 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997136 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997139 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997141 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997144 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997147 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997149 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997152 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997155 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997158 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997162 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997164 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997167 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997169 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997172 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 06:25:48.006977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997174 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997177 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997180 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997183 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997185 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997188 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997190 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997192 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997195 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997197 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997206 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997210 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997215 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997219 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997222 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997225 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997228 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997231 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997234 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997237 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 06:25:48.007581 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997240 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997242 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997245 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997248 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:47.997250 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:47.998167 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.005126 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.005143 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.005167 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.005174 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005231 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005236 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005239 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005243 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005246 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 06:25:48.008323 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005249 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005252 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005256 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005261 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005264 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005266 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005269 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005271 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005274 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005277 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005280 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005282 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005285 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005288 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005291 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005293 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005296 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005298 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005301 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005304 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 06:25:48.008713 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005307 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005309 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005312 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005315 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005319 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005322 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005325 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005328 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005330 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005333 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005336 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005339 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005341 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005344 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005346 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005349 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005351 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005354 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005357 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 06:25:48.009271 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005359 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005361 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005364 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005367 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005369 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005372 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005374 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005377 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005379 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005382 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005384 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005387 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005390 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005392 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005395 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005397 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005401 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005406 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005410 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 06:25:48.009726 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005413 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005416 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005419 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005422 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005425 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005428 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005430 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005433 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005435 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005438 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005440 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005443 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005446 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005448 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005451 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005453 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005456 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005459 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005462 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005464 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 06:25:48.010224 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005467 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005469 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005472 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005474 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005477 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005480 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005482 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005485 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005487 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005490 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005494 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005497 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005500 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005502 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005505 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 06:25:48.010704 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005509 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.005516 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005651 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005656 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005660 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005663 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005666 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005669 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005673 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005675 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005678 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005680 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005683 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005686 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005688 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 06:25:48.011121 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005691 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005693 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005696 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005698 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005701 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005704 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005706 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005709 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005711 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005715 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005718 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005720 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005723 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005726 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005729 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005732 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005735 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005738 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005740 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 06:25:48.011491 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005743 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005745 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005748 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005750 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005753 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005755 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005758 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005761 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005764 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005767 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005771 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005773 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005776 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005779 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005782 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005784 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005787 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005790 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005793 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 06:25:48.011975 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005795 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005798 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005800 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005803 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005806 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005808 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005811 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005814 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005816 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005819 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005822 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005825 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005828 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005830 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005833 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005835 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005838 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005840 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005843 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005845 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 06:25:48.012438 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005848 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005863 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005886 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005889 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005891 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005894 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005896 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005899 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005902 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005905 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005908 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005910 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005913 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005915 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005918 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005921 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005923 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005926 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005928 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005932 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005935 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 06:25:48.013066 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005937 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005940 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005943 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005946 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005949 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005953 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:48.005956 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.005961 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.006095 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.009768 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.011266 2576 server.go:1019] "Starting client certificate rotation" Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.011366 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 06:25:48.013591 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.011399 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 06:25:48.013933 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.013797 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 06:25:48.015023 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.015002 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 06:25:48.026329 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.026307 2576 log.go:25] "Validated CRI v1 runtime API" Jun 15 06:25:48.029988 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.029972 2576 log.go:25] "Validated CRI v1 image API" Jun 15 06:25:48.030805 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.030785 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 06:25:48.033316 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.033297 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9f2a370c-ecc8-413d-8c72-423ce7e52f73:/dev/nvme0n1p4 ac56e11c-4178-4421-8e7d-cb8d6fe24006:/dev/nvme0n1p3] Jun 15 06:25:48.033386 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.033316 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 06:25:48.038646 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.038508 2576 manager.go:216] Machine: {Timestamp:2026-06-15 06:25:48.037409195 +0000 UTC m=+0.332936462 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097313 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea60143ae715d537a1e3ea3c88c19 SystemUUID:ec2ea601-43ae-715d-537a-1e3ea3c88c19 BootID:0d6c75a2-4969-46e4-9277-2493bebafef3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d3:74:14:60:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d3:74:14:60:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:68:7a:f6:85:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 06:25:48.038646 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.038635 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 06:25:48.038775 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.038732 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 06:25:48.040488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.040471 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 06:25:48.042346 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.042321 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 06:25:48.042509 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.042362 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 06:25:48.043072 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.043062 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 06:25:48.043104 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.043075 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 06:25:48.043104 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.043084 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 06:25:48.043802 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.043792 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 06:25:48.045503 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.045494 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 06:25:48.049139 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.049126 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 15 06:25:48.049264 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.049254 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 06:25:48.049306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.049291 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 15 06:25:48.049336 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.049309 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 06:25:48.049336 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.049320 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 06:25:48.049336 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.049332 2576 kubelet.go:398] "Adding apiserver pod source" Jun 15 06:25:48.049456 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.049341 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 06:25:48.049826 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.049814 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 06:25:48.049892 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.049844 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 06:25:48.052885 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.052846 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 06:25:48.054477 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.054461 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 06:25:48.054575 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.054491 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 06:25:48.054667 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.054657 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 06:25:48.054704 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.054672 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 06:25:48.054704 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.054678 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 06:25:48.054704 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.054684 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 06:25:48.054704 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.054691 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 06:25:48.054704 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.054697 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 06:25:48.055313 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.055303 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 06:25:48.055313 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.055313 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 06:25:48.055376 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.055321 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 06:25:48.055376 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.055326 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 06:25:48.055376 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.055335 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 06:25:48.055376 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.055342 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 06:25:48.056071 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.056062 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 06:25:48.056071 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.056071 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 06:25:48.058152 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.058130 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-165.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 06:25:48.058152 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.058144 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 06:25:48.058288 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.058196 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 06:25:48.059443 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.059430 2576 server.go:1268] "Started kubelet" Jun 15 06:25:48.060056 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.059719 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 06:25:48.060056 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.059780 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7kb7z" Jun 15 06:25:48.060056 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.059794 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 06:25:48.060056 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.059819 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 06:25:48.060636 ip-10-0-140-165 systemd[1]: Started Kubernetes Kubelet. Jun 15 06:25:48.061216 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.061170 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 15 06:25:48.061570 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.061507 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 06:25:48.065159 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.065141 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 06:25:48.065229 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.064110 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-165.ec2.internal.18b92d2129c0ab25 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-165.ec2.internal,UID:ip-10-0-140-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-165.ec2.internal,},FirstTimestamp:2026-06-15 06:25:48.059405093 +0000 UTC m=+0.354932360,LastTimestamp:2026-06-15 06:25:48.059405093 +0000 UTC m=+0.354932360,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-165.ec2.internal,}" Jun 15 06:25:48.065962 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.065943 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 06:25:48.065962 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.065957 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 06:25:48.066101 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.066088 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:48.066680 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.066661 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7kb7z" Jun 15 06:25:48.066773 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.066680 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 06:25:48.066834 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.066781 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 06:25:48.066901 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.066707 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 06:25:48.066959 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.066923 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 15 06:25:48.066959 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.066931 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 15 06:25:48.066959 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.066943 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 06:25:48.066959 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.066957 2576 factory.go:55] Registering systemd factory Jun 15 06:25:48.067112 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.066965 2576 factory.go:223] Registration of the systemd container factory successfully Jun 15 06:25:48.067219 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.067204 2576 factory.go:153] Registering CRI-O factory Jun 15 06:25:48.067260 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.067223 2576 factory.go:223] Registration of the crio container factory successfully Jun 15 06:25:48.067260 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.067244 2576 factory.go:103] Registering Raw factory Jun 15 06:25:48.067260 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.067259 2576 manager.go:1196] Started watching for new ooms in manager Jun 15 06:25:48.067927 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.067914 2576 manager.go:349] Starting recovery of all containers Jun 15 06:25:48.077518 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.077357 2576 manager.go:354] Recovery completed Jun 15 06:25:48.078408 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.078303 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 06:25:48.080852 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.080827 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-165.ec2.internal\" not found" node="ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.083850 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.083832 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 06:25:48.085730 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.085709 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientMemory" Jun 15 06:25:48.085815 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.085737 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 06:25:48.085815 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.085747 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientPID" Jun 15 06:25:48.086313 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.086297 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 06:25:48.086374 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.086314 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 06:25:48.086374 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.086303 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 06:25:48.086374 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.086346 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 15 06:25:48.087081 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.087064 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientMemory" Jun 15 06:25:48.087132 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.087092 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 06:25:48.087132 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.087103 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientPID" Jun 15 06:25:48.088058 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.088046 2576 policy_none.go:49] "None policy: Start" Jun 15 06:25:48.088097 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.088063 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 06:25:48.088097 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.088073 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 06:25:48.089738 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.089728 2576 policy_none.go:47] "Start" Jun 15 06:25:48.121609 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.121593 2576 manager.go:337] "Starting Device Plugin manager" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.121632 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.121645 2576 server.go:87] "Starting device plugin registration server" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.121961 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.121977 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.122058 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.122125 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.122135 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.122768 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.122811 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.134224 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.135381 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.135414 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.135442 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.135474 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 06:25:48.148891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.137657 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 06:25:48.222382 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.222343 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 06:25:48.223374 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.223359 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientMemory" Jun 15 06:25:48.223425 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.223390 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 06:25:48.223425 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.223402 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientPID" Jun 15 06:25:48.223425 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.223425 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.231502 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.231485 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.231555 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.231511 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-165.ec2.internal\": node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:48.235591 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.235541 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal"] Jun 15 06:25:48.235642 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.235601 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 06:25:48.237045 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.237032 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientMemory" Jun 15 06:25:48.237092 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.237061 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 06:25:48.237092 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.237075 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientPID" Jun 15 06:25:48.239149 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.239136 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 06:25:48.239270 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.239256 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.239341 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.239284 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 06:25:48.239855 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.239838 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientMemory" Jun 15 06:25:48.239926 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.239838 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientMemory" Jun 15 06:25:48.239926 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.239893 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 06:25:48.239926 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.239896 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 06:25:48.239926 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.239909 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientPID" Jun 15 06:25:48.239926 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.239921 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientPID" Jun 15 06:25:48.242037 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.242019 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.242131 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.242058 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 06:25:48.242827 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.242806 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientMemory" Jun 15 06:25:48.242930 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.242839 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 06:25:48.242930 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.242850 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeHasSufficientPID" Jun 15 06:25:48.244894 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.244859 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:48.268065 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.268035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/247a42b425f1cc7470c3639b5a9704cf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-165.ec2.internal\" (UID: \"247a42b425f1cc7470c3639b5a9704cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.268065 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.268070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5fd452432c1d2024ef6b0004eb82a250-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal\" (UID: \"5fd452432c1d2024ef6b0004eb82a250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.268253 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.268086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd452432c1d2024ef6b0004eb82a250-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal\" (UID: \"5fd452432c1d2024ef6b0004eb82a250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.275732 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.275710 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-165.ec2.internal\" not found" node="ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.280092 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.280074 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-165.ec2.internal\" not found" node="ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.345355 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.345326 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:48.368585 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.368554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5fd452432c1d2024ef6b0004eb82a250-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal\" (UID: \"5fd452432c1d2024ef6b0004eb82a250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.368585 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.368587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd452432c1d2024ef6b0004eb82a250-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal\" (UID: \"5fd452432c1d2024ef6b0004eb82a250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.368791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.368605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/247a42b425f1cc7470c3639b5a9704cf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-165.ec2.internal\" (UID: \"247a42b425f1cc7470c3639b5a9704cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.368791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.368637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd452432c1d2024ef6b0004eb82a250-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal\" (UID: \"5fd452432c1d2024ef6b0004eb82a250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.368791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.368646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5fd452432c1d2024ef6b0004eb82a250-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal\" (UID: \"5fd452432c1d2024ef6b0004eb82a250\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.368791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.368688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/247a42b425f1cc7470c3639b5a9704cf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-165.ec2.internal\" (UID: \"247a42b425f1cc7470c3639b5a9704cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.446166 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.446135 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:48.546804 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.546730 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:48.578410 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.578384 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.583481 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:48.583462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" Jun 15 06:25:48.646884 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.646816 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:48.747333 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.747299 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:48.847984 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.847900 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:48.948541 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:48.948508 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:49.011012 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.010978 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 06:25:49.011538 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.011138 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 06:25:49.011538 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.011166 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 06:25:49.049317 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:49.049287 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:49.071309 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.071264 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 06:20:48 +0000 UTC" deadline="2028-03-25 14:43:18.532471324 +0000 UTC" Jun 15 06:25:49.071456 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.071327 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15584h17m29.461167565s" Jun 15 06:25:49.150431 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:49.150354 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:49.197800 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:49.197762 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd452432c1d2024ef6b0004eb82a250.slice/crio-72863c14cc7f9a73a57e5ad199ce946ed38ec930049f10f3735511662e3aad10 WatchSource:0}: Error finding container 72863c14cc7f9a73a57e5ad199ce946ed38ec930049f10f3735511662e3aad10: Status 404 returned error can't find the container with id 72863c14cc7f9a73a57e5ad199ce946ed38ec930049f10f3735511662e3aad10 Jun 15 06:25:49.198132 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:49.198113 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247a42b425f1cc7470c3639b5a9704cf.slice/crio-6b81f35c5f61faa2eae739e7df21a6c5a3f2526b5739fc6e2a02959078c56e5a WatchSource:0}: Error finding container 6b81f35c5f61faa2eae739e7df21a6c5a3f2526b5739fc6e2a02959078c56e5a: Status 404 returned error can't find the container with id 6b81f35c5f61faa2eae739e7df21a6c5a3f2526b5739fc6e2a02959078c56e5a Jun 15 06:25:49.202756 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.202740 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 06:25:49.251058 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:49.251003 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:49.351537 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:49.351501 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-165.ec2.internal\" not found" Jun 15 06:25:49.400850 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.400767 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 06:25:49.467235 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.467197 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" Jun 15 06:25:49.478074 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.478049 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 06:25:49.479723 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.479707 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal" Jun 15 06:25:49.486739 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.486718 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 06:25:49.625439 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:49.625405 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 06:25:50.050605 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.050550 2576 apiserver.go:52] "Watching apiserver" Jun 15 06:25:50.055804 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.055638 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 06:25:50.056146 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.056118 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b","openshift-cluster-node-tuning-operator/tuned-q6c66","openshift-image-registry/node-ca-qjd6k","openshift-multus/multus-additional-cni-plugins-m2d6t","openshift-network-operator/iptables-alerter-bdzkh","kube-system/konnectivity-agent-rjjk5","kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal","openshift-dns/node-resolver-rjxcq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal","openshift-multus/multus-r6lk5","openshift-multus/network-metrics-daemon-77v27","openshift-network-diagnostics/network-check-target-b66w6","openshift-ovn-kubernetes/ovnkube-node-fgsvg","kube-system/global-pull-secret-syncer-jb6rn"] Jun 15 06:25:50.058679 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.058657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.060606 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.060584 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 06:25:50.060811 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.060789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rpqbt\"" Jun 15 06:25:50.060979 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.060942 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 06:25:50.061038 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.061014 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 06:25:50.061126 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.061111 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 06:25:50.062857 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.062624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.065360 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.064349 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 06:25:50.065360 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.064367 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 06:25:50.065360 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.064533 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 06:25:50.065360 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.064647 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 06:25:50.065360 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.064789 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 06:25:50.065360 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.064834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.065360 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.065016 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 06:25:50.065360 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.065324 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ck8kf\"" Jun 15 06:25:50.066345 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.066326 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 06:25:50.066467 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.066447 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 06:25:50.066824 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.066671 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s4z5j\"" Jun 15 06:25:50.066824 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.066771 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 06:25:50.067295 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.066975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.067295 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.067021 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 06:25:50.068434 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.068416 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fnb4p\"" Jun 15 06:25:50.068811 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.068712 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 06:25:50.069122 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.068958 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 06:25:50.069356 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.069314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.070884 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.070696 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 06:25:50.071180 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.071157 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 06:25:50.071440 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.071421 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rcrx7\"" Jun 15 06:25:50.071590 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.071575 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 06:25:50.071655 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.071629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:25:50.073665 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.073269 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sdhhk\"" Jun 15 06:25:50.073665 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.073364 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 06:25:50.073665 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.073369 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 06:25:50.073891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.073673 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:50.073891 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.073734 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:25:50.076056 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.076033 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.078155 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.077776 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 06:25:50.078155 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.077840 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cm25v\"" Jun 15 06:25:50.078155 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.078009 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 06:25:50.078155 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.078150 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 06:25:50.079338 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-multus-socket-dir-parent\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.079338 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-etc-kubernetes\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.079512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-cni-bin\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.079512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-cni-netd\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.079512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fljxb\" (UniqueName: \"kubernetes.io/projected/be585863-e1e4-43d4-a260-c9409de3709e-kube-api-access-fljxb\") pod \"node-ca-qjd6k\" (UID: \"be585863-e1e4-43d4-a260-c9409de3709e\") " pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.079512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.079512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.079512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-cnibin\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-var-lib-openvswitch\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-etc-openvswitch\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-node-log\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be585863-e1e4-43d4-a260-c9409de3709e-host\") pod \"node-ca-qjd6k\" (UID: \"be585863-e1e4-43d4-a260-c9409de3709e\") " pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95xkq\" (UniqueName: \"kubernetes.io/projected/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-kube-api-access-95xkq\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-run-k8s-cni-cncf-io\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-var-lib-cni-bin\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-var-lib-kubelet\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85f05280-f319-4538-a205-ad382136d787-multus-daemon-config\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-multus-cni-dir\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.079903 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-run-multus-certs\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.080440 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.079996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-run-systemd\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.080440 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.080059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-log-socket\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.080440 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.080107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktpzt\" (UniqueName: \"kubernetes.io/projected/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-kube-api-access-ktpzt\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.080440 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.080160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.080440 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.080164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-run-netns\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.081735 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.081705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-slash\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.081841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.081753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-run-openvswitch\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.081841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.081792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-run-ovn\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.081841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.081832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-ovnkube-script-lib\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.082035 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.081901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c22328c-7c4e-4aca-9bed-8218bae58f69-host-slash\") pod \"iptables-alerter-bdzkh\" (UID: \"5c22328c-7c4e-4aca-9bed-8218bae58f69\") " pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.082035 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.081934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85f05280-f319-4538-a205-ad382136d787-cni-binary-copy\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.082035 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.081963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-hostroot\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.082035 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.081992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-run-netns\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.082035 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-run-ovn-kubernetes\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.082191 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.082191 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-ovnkube-config\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.082284 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be585863-e1e4-43d4-a260-c9409de3709e-serviceca\") pod \"node-ca-qjd6k\" (UID: \"be585863-e1e4-43d4-a260-c9409de3709e\") " pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.082338 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-system-cni-dir\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.082338 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-os-release\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.082428 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c22328c-7c4e-4aca-9bed-8218bae58f69-iptables-alerter-script\") pod \"iptables-alerter-bdzkh\" (UID: \"5c22328c-7c4e-4aca-9bed-8218bae58f69\") " pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.082428 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082362 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 06:25:50.082428 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-env-overrides\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.082757 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-ovn-node-metrics-cert\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.082835 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.082789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-cnibin\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.083591 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.083565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-var-lib-cni-multus\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.083687 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.083674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-multus-conf-dir\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.083744 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.083710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk7xm\" (UniqueName: \"kubernetes.io/projected/85f05280-f319-4538-a205-ad382136d787-kube-api-access-tk7xm\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.083799 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.083763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-kubelet\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.083897 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.083879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-systemd-units\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.083977 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.083920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.084048 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.083996 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jt49h\"" Jun 15 06:25:50.084135 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.084099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52v6d\" (UniqueName: \"kubernetes.io/projected/5c22328c-7c4e-4aca-9bed-8218bae58f69-kube-api-access-52v6d\") pod \"iptables-alerter-bdzkh\" (UID: \"5c22328c-7c4e-4aca-9bed-8218bae58f69\") " pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.084209 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.084136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-system-cni-dir\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.084209 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.084168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-os-release\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.084315 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.084270 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 06:25:50.084472 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.084453 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.084539 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.084491 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 06:25:50.086233 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.086054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:50.086233 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.086154 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:25:50.087774 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.087754 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 06:25:50.087975 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.087959 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 06:25:50.088276 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.088158 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 06:25:50.088276 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.088177 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bbwhj\"" Jun 15 06:25:50.089716 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.089696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:50.089810 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.089761 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:25:50.096984 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.096933 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-whn5x" Jun 15 06:25:50.105133 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.105045 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-whn5x" Jun 15 06:25:50.139553 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.139496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal" event={"ID":"247a42b425f1cc7470c3639b5a9704cf","Type":"ContainerStarted","Data":"6b81f35c5f61faa2eae739e7df21a6c5a3f2526b5739fc6e2a02959078c56e5a"} Jun 15 06:25:50.140916 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.140879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" event={"ID":"5fd452432c1d2024ef6b0004eb82a250","Type":"ContainerStarted","Data":"72863c14cc7f9a73a57e5ad199ce946ed38ec930049f10f3735511662e3aad10"} Jun 15 06:25:50.168657 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.168624 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 06:25:50.184682 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-run-netns\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.184682 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-slash\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-run-ovn\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-run-ovn\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-run-netns\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-socket-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-slash\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-run-netns\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-env-overrides\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-run-netns\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.184955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-registration-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.184980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-system-cni-dir\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d2462d75-6125-4066-a0d8-335ffe11dc4a-kubelet-config\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-kubernetes\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-system-cni-dir\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhlxp\" (UniqueName: \"kubernetes.io/projected/1fc8c279-c62e-42e7-b14f-7bf0339b9282-kube-api-access-vhlxp\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-cnibin\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185153 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-cnibin\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-multus-conf-dir\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7xm\" (UniqueName: \"kubernetes.io/projected/85f05280-f319-4538-a205-ad382136d787-kube-api-access-tk7xm\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-multus-conf-dir\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-systemd-units\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-multus-socket-dir-parent\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-systemd\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph7ct\" (UniqueName: \"kubernetes.io/projected/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-kube-api-access-ph7ct\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-systemd-units\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.185488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-modprobe-d\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95xkq\" (UniqueName: \"kubernetes.io/projected/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-kube-api-access-95xkq\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-var-lib-cni-bin\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-sysconfig\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-host\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-multus-cni-dir\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-run-systemd\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d30991d-9f2c-4702-a141-1d265a9c1970-agent-certs\") pod \"konnectivity-agent-rjjk5\" (UID: \"3d30991d-9f2c-4702-a141-1d265a9c1970\") " pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185588 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-var-lib-cni-bin\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-sysctl-d\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-run\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-run-openvswitch\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tq2k\" (UniqueName: \"kubernetes.io/projected/7a53739e-5156-4475-b741-e13c84564d26-kube-api-access-5tq2k\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-multus-cni-dir\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-multus-socket-dir-parent\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.186303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185588 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-run-systemd\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d30991d-9f2c-4702-a141-1d265a9c1970-konnectivity-ca\") pod \"konnectivity-agent-rjjk5\" (UID: \"3d30991d-9f2c-4702-a141-1d265a9c1970\") " pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1193db8a-f0f2-4f9f-8eef-fd4f79f8b088-tmp-dir\") pod \"node-resolver-rjxcq\" (UID: \"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088\") " pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-run-openvswitch\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-sysctl-conf\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-lib-modules\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-device-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.185990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c22328c-7c4e-4aca-9bed-8218bae58f69-host-slash\") pod \"iptables-alerter-bdzkh\" (UID: \"5c22328c-7c4e-4aca-9bed-8218bae58f69\") " pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85f05280-f319-4538-a205-ad382136d787-cni-binary-copy\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186008 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-hostroot\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c22328c-7c4e-4aca-9bed-8218bae58f69-host-slash\") pod \"iptables-alerter-bdzkh\" (UID: \"5c22328c-7c4e-4aca-9bed-8218bae58f69\") " pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-run-ovn-kubernetes\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-hostroot\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-ovnkube-config\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-run-ovn-kubernetes\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cx2h\" (UniqueName: \"kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h\") pod \"network-check-target-b66w6\" (UID: \"e7c17f5a-207f-46c3-a64d-1c4c70c0a022\") " pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:50.187067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186170 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-env-overrides\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be585863-e1e4-43d4-a260-c9409de3709e-serviceca\") pod \"node-ca-qjd6k\" (UID: \"be585863-e1e4-43d4-a260-c9409de3709e\") " pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-os-release\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-os-release\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c22328c-7c4e-4aca-9bed-8218bae58f69-iptables-alerter-script\") pod \"iptables-alerter-bdzkh\" (UID: \"5c22328c-7c4e-4aca-9bed-8218bae58f69\") " pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-ovn-node-metrics-cert\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlm94\" (UniqueName: \"kubernetes.io/projected/1193db8a-f0f2-4f9f-8eef-fd4f79f8b088-kube-api-access-jlm94\") pod \"node-resolver-rjxcq\" (UID: \"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088\") " pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-tuned\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-sys-fs\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-var-lib-cni-multus\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-kubelet\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-var-lib-kubelet\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-etc-selinux\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-ovnkube-config\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186675 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85f05280-f319-4538-a205-ad382136d787-cni-binary-copy\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-var-lib-cni-multus\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.187830 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186727 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be585863-e1e4-43d4-a260-c9409de3709e-serviceca\") pod \"node-ca-qjd6k\" (UID: \"be585863-e1e4-43d4-a260-c9409de3709e\") " pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52v6d\" (UniqueName: \"kubernetes.io/projected/5c22328c-7c4e-4aca-9bed-8218bae58f69-kube-api-access-52v6d\") pod \"iptables-alerter-bdzkh\" (UID: \"5c22328c-7c4e-4aca-9bed-8218bae58f69\") " pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-kubelet\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-system-cni-dir\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-os-release\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186842 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-etc-kubernetes\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-system-cni-dir\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-cni-bin\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-cni-netd\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-os-release\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fc8c279-c62e-42e7-b14f-7bf0339b9282-tmp\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-etc-kubernetes\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186982 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-cni-netd\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fljxb\" (UniqueName: \"kubernetes.io/projected/be585863-e1e4-43d4-a260-c9409de3709e-kube-api-access-fljxb\") pod \"node-ca-qjd6k\" (UID: \"be585863-e1e4-43d4-a260-c9409de3709e\") " pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.186940 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-host-cni-bin\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-cnibin\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.188631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187149 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c22328c-7c4e-4aca-9bed-8218bae58f69-iptables-alerter-script\") pod \"iptables-alerter-bdzkh\" (UID: \"5c22328c-7c4e-4aca-9bed-8218bae58f69\") " pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-var-lib-openvswitch\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-etc-openvswitch\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-cnibin\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-node-log\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187282 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-var-lib-openvswitch\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187289 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-node-log\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-ovnkube-script-lib\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-etc-openvswitch\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be585863-e1e4-43d4-a260-c9409de3709e-host\") pod \"node-ca-qjd6k\" (UID: \"be585863-e1e4-43d4-a260-c9409de3709e\") " pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-run-k8s-cni-cncf-io\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-var-lib-kubelet\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85f05280-f319-4538-a205-ad382136d787-multus-daemon-config\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktpzt\" (UniqueName: \"kubernetes.io/projected/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-kube-api-access-ktpzt\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1193db8a-f0f2-4f9f-8eef-fd4f79f8b088-hosts-file\") pod \"node-resolver-rjxcq\" (UID: \"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088\") " pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-run-multus-certs\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.189491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-log-socket\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d2462d75-6125-4066-a0d8-335ffe11dc4a-dbus\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-var-lib-kubelet\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-run-multus-certs\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187777 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-log-socket\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85f05280-f319-4538-a205-ad382136d787-host-run-k8s-cni-cncf-io\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187896 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-ovnkube-script-lib\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.187912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be585863-e1e4-43d4-a260-c9409de3709e-host\") pod \"node-ca-qjd6k\" (UID: \"be585863-e1e4-43d4-a260-c9409de3709e\") " pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.188006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.188046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-sys\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.188070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.188189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85f05280-f319-4538-a205-ad382136d787-multus-daemon-config\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.190306 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.188223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.190943 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.190852 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-ovn-node-metrics-cert\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.192972 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.192940 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk7xm\" (UniqueName: \"kubernetes.io/projected/85f05280-f319-4538-a205-ad382136d787-kube-api-access-tk7xm\") pod \"multus-r6lk5\" (UID: \"85f05280-f319-4538-a205-ad382136d787\") " pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.193084 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.193005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95xkq\" (UniqueName: \"kubernetes.io/projected/de2eb6e4-34bf-4853-a6eb-0d4b9170c30b-kube-api-access-95xkq\") pod \"multus-additional-cni-plugins-m2d6t\" (UID: \"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b\") " pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.194347 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.194321 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52v6d\" (UniqueName: \"kubernetes.io/projected/5c22328c-7c4e-4aca-9bed-8218bae58f69-kube-api-access-52v6d\") pod \"iptables-alerter-bdzkh\" (UID: \"5c22328c-7c4e-4aca-9bed-8218bae58f69\") " pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.194463 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.194379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fljxb\" (UniqueName: \"kubernetes.io/projected/be585863-e1e4-43d4-a260-c9409de3709e-kube-api-access-fljxb\") pod \"node-ca-qjd6k\" (UID: \"be585863-e1e4-43d4-a260-c9409de3709e\") " pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.195033 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.195010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktpzt\" (UniqueName: \"kubernetes.io/projected/fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc-kube-api-access-ktpzt\") pod \"ovnkube-node-fgsvg\" (UID: \"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc\") " pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.288980 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.288945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-socket-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.288980 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.288984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-registration-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.289210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d2462d75-6125-4066-a0d8-335ffe11dc4a-kubelet-config\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:50.289210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-kubernetes\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhlxp\" (UniqueName: \"kubernetes.io/projected/1fc8c279-c62e-42e7-b14f-7bf0339b9282-kube-api-access-vhlxp\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-systemd\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph7ct\" (UniqueName: \"kubernetes.io/projected/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-kube-api-access-ph7ct\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.289210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-kubernetes\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-modprobe-d\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289160 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-registration-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.289210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-sysconfig\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289203 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-systemd\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-sysconfig\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289160 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-socket-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-host\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d30991d-9f2c-4702-a141-1d265a9c1970-agent-certs\") pod \"konnectivity-agent-rjjk5\" (UID: \"3d30991d-9f2c-4702-a141-1d265a9c1970\") " pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-host\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-sysctl-d\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289347 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-modprobe-d\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d2462d75-6125-4066-a0d8-335ffe11dc4a-kubelet-config\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-sysctl-d\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-run\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tq2k\" (UniqueName: \"kubernetes.io/projected/7a53739e-5156-4475-b741-e13c84564d26-kube-api-access-5tq2k\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d30991d-9f2c-4702-a141-1d265a9c1970-konnectivity-ca\") pod \"konnectivity-agent-rjjk5\" (UID: \"3d30991d-9f2c-4702-a141-1d265a9c1970\") " pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-run\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1193db8a-f0f2-4f9f-8eef-fd4f79f8b088-tmp-dir\") pod \"node-resolver-rjxcq\" (UID: \"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088\") " pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-sysctl-conf\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-lib-modules\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-device-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.289836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx2h\" (UniqueName: \"kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h\") pod \"network-check-target-b66w6\" (UID: \"e7c17f5a-207f-46c3-a64d-1c4c70c0a022\") " pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlm94\" (UniqueName: \"kubernetes.io/projected/1193db8a-f0f2-4f9f-8eef-fd4f79f8b088-kube-api-access-jlm94\") pod \"node-resolver-rjxcq\" (UID: \"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088\") " pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-tuned\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-sys-fs\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-var-lib-kubelet\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-sysctl-conf\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-etc-selinux\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fc8c279-c62e-42e7-b14f-7bf0339b9282-tmp\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289779 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-lib-modules\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1193db8a-f0f2-4f9f-8eef-fd4f79f8b088-tmp-dir\") pod \"node-resolver-rjxcq\" (UID: \"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088\") " pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1193db8a-f0f2-4f9f-8eef-fd4f79f8b088-hosts-file\") pod \"node-resolver-rjxcq\" (UID: \"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088\") " pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d2462d75-6125-4066-a0d8-335ffe11dc4a-dbus\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289829 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-device-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-sys\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.291086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.289989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.290038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1193db8a-f0f2-4f9f-8eef-fd4f79f8b088-hosts-file\") pod \"node-resolver-rjxcq\" (UID: \"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088\") " pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.290048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d30991d-9f2c-4702-a141-1d265a9c1970-konnectivity-ca\") pod \"konnectivity-agent-rjjk5\" (UID: \"3d30991d-9f2c-4702-a141-1d265a9c1970\") " pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.290080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-var-lib-kubelet\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.290098 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-etc-selinux\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.290133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d2462d75-6125-4066-a0d8-335ffe11dc4a-dbus\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.290144 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.290155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-sys-fs\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.290205 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs podName:7a53739e-5156-4475-b741-e13c84564d26 nodeName:}" failed. No retries permitted until 2026-06-15 06:25:50.790185596 +0000 UTC m=+3.085712850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs") pod "network-metrics-daemon-77v27" (UID: "7a53739e-5156-4475-b741-e13c84564d26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.290205 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.290209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fc8c279-c62e-42e7-b14f-7bf0339b9282-sys\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.291943 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.290266 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret podName:d2462d75-6125-4066-a0d8-335ffe11dc4a nodeName:}" failed. No retries permitted until 2026-06-15 06:25:50.790249094 +0000 UTC m=+3.085776363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret") pod "global-pull-secret-syncer-jb6rn" (UID: "d2462d75-6125-4066-a0d8-335ffe11dc4a") : object "kube-system"/"original-pull-secret" not registered Jun 15 06:25:50.292502 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.292047 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fc8c279-c62e-42e7-b14f-7bf0339b9282-tmp\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.292502 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.292104 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1fc8c279-c62e-42e7-b14f-7bf0339b9282-etc-tuned\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.292502 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.292453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d30991d-9f2c-4702-a141-1d265a9c1970-agent-certs\") pod \"konnectivity-agent-rjjk5\" (UID: \"3d30991d-9f2c-4702-a141-1d265a9c1970\") " pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:25:50.295585 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.295486 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 06:25:50.295780 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.295738 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 06:25:50.295780 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.295762 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 06:25:50.295780 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.295775 2576 projected.go:196] Error preparing data for projected volume kube-api-access-4cx2h for pod openshift-network-diagnostics/network-check-target-b66w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:25:50.296030 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.295841 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h podName:e7c17f5a-207f-46c3-a64d-1c4c70c0a022 nodeName:}" failed. No retries permitted until 2026-06-15 06:25:50.79582412 +0000 UTC m=+3.091351374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx2h" (UniqueName: "kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h") pod "network-check-target-b66w6" (UID: "e7c17f5a-207f-46c3-a64d-1c4c70c0a022") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:25:50.297838 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.297591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhlxp\" (UniqueName: \"kubernetes.io/projected/1fc8c279-c62e-42e7-b14f-7bf0339b9282-kube-api-access-vhlxp\") pod \"tuned-q6c66\" (UID: \"1fc8c279-c62e-42e7-b14f-7bf0339b9282\") " pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.297838 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.297611 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph7ct\" (UniqueName: \"kubernetes.io/projected/f36afae1-3424-4f5d-9c5c-cf417ad82ae0-kube-api-access-ph7ct\") pod \"aws-ebs-csi-driver-node-4sh5b\" (UID: \"f36afae1-3424-4f5d-9c5c-cf417ad82ae0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.297838 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.297813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tq2k\" (UniqueName: \"kubernetes.io/projected/7a53739e-5156-4475-b741-e13c84564d26-kube-api-access-5tq2k\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:50.298407 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.298387 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlm94\" (UniqueName: \"kubernetes.io/projected/1193db8a-f0f2-4f9f-8eef-fd4f79f8b088-kube-api-access-jlm94\") pod \"node-resolver-rjxcq\" (UID: \"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088\") " pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.372749 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.372672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r6lk5" Jun 15 06:25:50.382626 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.382595 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:25:50.390500 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.390480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qjd6k" Jun 15 06:25:50.398170 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.398145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" Jun 15 06:25:50.406970 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.406941 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bdzkh" Jun 15 06:25:50.414720 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.414697 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:25:50.422309 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.422287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rjxcq" Jun 15 06:25:50.429963 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.429940 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q6c66" Jun 15 06:25:50.435594 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.435572 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" Jun 15 06:25:50.793133 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.793041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:50.793133 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.793109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:50.793345 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.793229 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:25:50.793345 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.793258 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 06:25:50.793345 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.793317 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs podName:7a53739e-5156-4475-b741-e13c84564d26 nodeName:}" failed. No retries permitted until 2026-06-15 06:25:51.793294642 +0000 UTC m=+4.088821901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs") pod "network-metrics-daemon-77v27" (UID: "7a53739e-5156-4475-b741-e13c84564d26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:25:50.793345 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.793341 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret podName:d2462d75-6125-4066-a0d8-335ffe11dc4a nodeName:}" failed. No retries permitted until 2026-06-15 06:25:51.79333022 +0000 UTC m=+4.088857474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret") pod "global-pull-secret-syncer-jb6rn" (UID: "d2462d75-6125-4066-a0d8-335ffe11dc4a") : object "kube-system"/"original-pull-secret" not registered Jun 15 06:25:50.894317 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:50.894278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx2h\" (UniqueName: \"kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h\") pod \"network-check-target-b66w6\" (UID: \"e7c17f5a-207f-46c3-a64d-1c4c70c0a022\") " pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:50.894483 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.894464 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 06:25:50.894540 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.894493 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 06:25:50.894540 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.894506 2576 projected.go:196] Error preparing data for projected volume kube-api-access-4cx2h for pod openshift-network-diagnostics/network-check-target-b66w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:25:50.894599 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:50.894562 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h podName:e7c17f5a-207f-46c3-a64d-1c4c70c0a022 nodeName:}" failed. No retries permitted until 2026-06-15 06:25:51.894546339 +0000 UTC m=+4.190073593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx2h" (UniqueName: "kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h") pod "network-check-target-b66w6" (UID: "e7c17f5a-207f-46c3-a64d-1c4c70c0a022") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:25:51.109106 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:51.109018 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 06:20:50 +0000 UTC" deadline="2028-02-29 17:06:52.63199244 +0000 UTC" Jun 15 06:25:51.109106 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:51.109051 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14986h41m1.522944533s" Jun 15 06:25:51.329391 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:51.329358 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde4e3a8_977a_4ea3_ae0c_5cbd4f2d5ddc.slice/crio-06a177467df21efceef58b64742345cc770aff742ac490c8a23fdcf14496a9fb WatchSource:0}: Error finding container 06a177467df21efceef58b64742345cc770aff742ac490c8a23fdcf14496a9fb: Status 404 returned error can't find the container with id 06a177467df21efceef58b64742345cc770aff742ac490c8a23fdcf14496a9fb Jun 15 06:25:51.331144 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:51.331107 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc8c279_c62e_42e7_b14f_7bf0339b9282.slice/crio-64348d307eb4a8faf86c55ed0d2490f6ca837c620cdde7918f72d1da5d538cb6 WatchSource:0}: Error finding container 64348d307eb4a8faf86c55ed0d2490f6ca837c620cdde7918f72d1da5d538cb6: Status 404 returned error can't find the container with id 64348d307eb4a8faf86c55ed0d2490f6ca837c620cdde7918f72d1da5d538cb6 Jun 15 06:25:51.333977 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:51.333775 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f05280_f319_4538_a205_ad382136d787.slice/crio-a49933709639e494b32da1dae24b258c297cc07101b7a1c1542e8f097862d0a4 WatchSource:0}: Error finding container a49933709639e494b32da1dae24b258c297cc07101b7a1c1542e8f097862d0a4: Status 404 returned error can't find the container with id a49933709639e494b32da1dae24b258c297cc07101b7a1c1542e8f097862d0a4 Jun 15 06:25:51.336617 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:51.336590 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2eb6e4_34bf_4853_a6eb_0d4b9170c30b.slice/crio-990d67c565a269895f2f8deebcc0491c23d1959bda4c60462f642c5e159b9289 WatchSource:0}: Error finding container 990d67c565a269895f2f8deebcc0491c23d1959bda4c60462f642c5e159b9289: Status 404 returned error can't find the container with id 990d67c565a269895f2f8deebcc0491c23d1959bda4c60462f642c5e159b9289 Jun 15 06:25:51.337288 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:25:51.336893 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1193db8a_f0f2_4f9f_8eef_fd4f79f8b088.slice/crio-f1fd1f993afe919fc0f913f9764f543acaa56ecf0c1fba35f5bfd398eb9af11a WatchSource:0}: Error finding container f1fd1f993afe919fc0f913f9764f543acaa56ecf0c1fba35f5bfd398eb9af11a: Status 404 returned error can't find the container with id f1fd1f993afe919fc0f913f9764f543acaa56ecf0c1fba35f5bfd398eb9af11a Jun 15 06:25:51.800413 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:51.800141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:51.800607 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:51.800442 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:25:51.800607 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:51.800468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:51.800607 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:51.800514 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs podName:7a53739e-5156-4475-b741-e13c84564d26 nodeName:}" failed. No retries permitted until 2026-06-15 06:25:53.800493919 +0000 UTC m=+6.096021174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs") pod "network-metrics-daemon-77v27" (UID: "7a53739e-5156-4475-b741-e13c84564d26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:25:51.800607 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:51.800571 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 06:25:51.800818 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:51.800623 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret podName:d2462d75-6125-4066-a0d8-335ffe11dc4a nodeName:}" failed. No retries permitted until 2026-06-15 06:25:53.800607133 +0000 UTC m=+6.096134469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret") pod "global-pull-secret-syncer-jb6rn" (UID: "d2462d75-6125-4066-a0d8-335ffe11dc4a") : object "kube-system"/"original-pull-secret" not registered Jun 15 06:25:51.901690 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:51.901595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx2h\" (UniqueName: \"kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h\") pod \"network-check-target-b66w6\" (UID: \"e7c17f5a-207f-46c3-a64d-1c4c70c0a022\") " pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:51.901892 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:51.901795 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 06:25:51.901892 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:51.901817 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 06:25:51.901892 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:51.901828 2576 projected.go:196] Error preparing data for projected volume kube-api-access-4cx2h for pod openshift-network-diagnostics/network-check-target-b66w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:25:51.902064 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:51.901913 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h podName:e7c17f5a-207f-46c3-a64d-1c4c70c0a022 nodeName:}" failed. No retries permitted until 2026-06-15 06:25:53.901892456 +0000 UTC m=+6.197419714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx2h" (UniqueName: "kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h") pod "network-check-target-b66w6" (UID: "e7c17f5a-207f-46c3-a64d-1c4c70c0a022") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:25:52.110347 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.109797 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 06:20:50 +0000 UTC" deadline="2027-11-25 05:16:32.417072701 +0000 UTC" Jun 15 06:25:52.110347 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.109861 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12670h50m40.307215403s" Jun 15 06:25:52.139891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.138650 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:52.139891 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:52.138792 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:25:52.139891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.139217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:52.139891 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:52.139308 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:25:52.139891 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.139367 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:52.139891 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:52.139431 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:25:52.156018 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.155889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rjxcq" event={"ID":"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088","Type":"ContainerStarted","Data":"f1fd1f993afe919fc0f913f9764f543acaa56ecf0c1fba35f5bfd398eb9af11a"} Jun 15 06:25:52.169714 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.169672 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qjd6k" event={"ID":"be585863-e1e4-43d4-a260-c9409de3709e","Type":"ContainerStarted","Data":"9b317bc311b0144e5a3b90ddfcb5cc96f6ea74837c30f1e0040201a65a71b0f9"} Jun 15 06:25:52.172105 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.172071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rjjk5" event={"ID":"3d30991d-9f2c-4702-a141-1d265a9c1970","Type":"ContainerStarted","Data":"27ffcd818feb92ad031dd2d9094a990e4b4bff29bea87ee96cb6586e673f8583"} Jun 15 06:25:52.180798 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.180763 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q6c66" event={"ID":"1fc8c279-c62e-42e7-b14f-7bf0339b9282","Type":"ContainerStarted","Data":"64348d307eb4a8faf86c55ed0d2490f6ca837c620cdde7918f72d1da5d538cb6"} Jun 15 06:25:52.186115 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.186080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" event={"ID":"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc","Type":"ContainerStarted","Data":"06a177467df21efceef58b64742345cc770aff742ac490c8a23fdcf14496a9fb"} Jun 15 06:25:52.205722 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.205678 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal" event={"ID":"247a42b425f1cc7470c3639b5a9704cf","Type":"ContainerStarted","Data":"b8ded0cc1be92330fdca8c3a1c4144131552442a97d50fa4ed5d310616433452"} Jun 15 06:25:52.219661 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.219599 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-165.ec2.internal" podStartSLOduration=3.219580326 podStartE2EDuration="3.219580326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:25:52.219218827 +0000 UTC m=+4.514746097" watchObservedRunningTime="2026-06-15 06:25:52.219580326 +0000 UTC m=+4.515107603" Jun 15 06:25:52.220342 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.220311 2576 generic.go:356] "Generic (PLEG): container finished" podID="5fd452432c1d2024ef6b0004eb82a250" containerID="e5079ff8f5574ddc9f8277fe6b194fec752aea670a1de2e759e7ad5fcb3c10f9" exitCode=0 Jun 15 06:25:52.220461 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.220414 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" event={"ID":"5fd452432c1d2024ef6b0004eb82a250","Type":"ContainerDied","Data":"e5079ff8f5574ddc9f8277fe6b194fec752aea670a1de2e759e7ad5fcb3c10f9"} Jun 15 06:25:52.231367 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.231333 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bdzkh" event={"ID":"5c22328c-7c4e-4aca-9bed-8218bae58f69","Type":"ContainerStarted","Data":"09816b73163a84fa1cdc3e0b5145b56bec8672a2ed2a04aa237a8f40937df9d9"} Jun 15 06:25:52.239822 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.239760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" event={"ID":"f36afae1-3424-4f5d-9c5c-cf417ad82ae0","Type":"ContainerStarted","Data":"396412ff64fbae6ce837dc84a9e2886fa27af3830ab644819d63070bb7ece685"} Jun 15 06:25:52.251052 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.251018 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" event={"ID":"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b","Type":"ContainerStarted","Data":"990d67c565a269895f2f8deebcc0491c23d1959bda4c60462f642c5e159b9289"} Jun 15 06:25:52.261944 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:52.261905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r6lk5" event={"ID":"85f05280-f319-4538-a205-ad382136d787","Type":"ContainerStarted","Data":"a49933709639e494b32da1dae24b258c297cc07101b7a1c1542e8f097862d0a4"} Jun 15 06:25:53.292240 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:53.292113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" event={"ID":"5fd452432c1d2024ef6b0004eb82a250","Type":"ContainerStarted","Data":"fa716435f999fe38eb805ecdff329b4af68530eba1ce7068c5a150baf2fbc68d"} Jun 15 06:25:53.307018 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:53.306020 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-165.ec2.internal" podStartSLOduration=4.30599793 podStartE2EDuration="4.30599793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:25:53.30596328 +0000 UTC m=+5.601490557" watchObservedRunningTime="2026-06-15 06:25:53.30599793 +0000 UTC m=+5.601525207" Jun 15 06:25:53.821204 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:53.820607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:53.821204 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:53.820667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:53.821204 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:53.820800 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 06:25:53.821204 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:53.820848 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:25:53.821204 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:53.820863 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret podName:d2462d75-6125-4066-a0d8-335ffe11dc4a nodeName:}" failed. No retries permitted until 2026-06-15 06:25:57.820845483 +0000 UTC m=+10.116372742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret") pod "global-pull-secret-syncer-jb6rn" (UID: "d2462d75-6125-4066-a0d8-335ffe11dc4a") : object "kube-system"/"original-pull-secret" not registered Jun 15 06:25:53.821204 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:53.820924 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs podName:7a53739e-5156-4475-b741-e13c84564d26 nodeName:}" failed. No retries permitted until 2026-06-15 06:25:57.820906995 +0000 UTC m=+10.116434253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs") pod "network-metrics-daemon-77v27" (UID: "7a53739e-5156-4475-b741-e13c84564d26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:25:53.921778 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:53.921744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx2h\" (UniqueName: \"kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h\") pod \"network-check-target-b66w6\" (UID: \"e7c17f5a-207f-46c3-a64d-1c4c70c0a022\") " pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:53.922001 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:53.921981 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 06:25:53.922094 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:53.922004 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 06:25:53.922094 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:53.922017 2576 projected.go:196] Error preparing data for projected volume kube-api-access-4cx2h for pod openshift-network-diagnostics/network-check-target-b66w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:25:53.922094 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:53.922074 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h podName:e7c17f5a-207f-46c3-a64d-1c4c70c0a022 nodeName:}" failed. No retries permitted until 2026-06-15 06:25:57.922055153 +0000 UTC m=+10.217582414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx2h" (UniqueName: "kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h") pod "network-check-target-b66w6" (UID: "e7c17f5a-207f-46c3-a64d-1c4c70c0a022") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:25:54.137724 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:54.136311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:54.137724 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:54.136330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:54.137724 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:54.136449 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:25:54.137724 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:54.136503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:54.137724 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:54.136630 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:25:54.137724 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:54.136734 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:25:56.137716 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:56.137681 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:56.138201 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:56.137828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:56.138201 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:56.137844 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:25:56.138201 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:56.137893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:56.138201 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:56.138027 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:25:56.138201 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:56.138113 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:25:57.854972 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:57.854935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:57.855437 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:57.854996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:57.855437 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:57.855094 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 06:25:57.855437 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:57.855159 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret podName:d2462d75-6125-4066-a0d8-335ffe11dc4a nodeName:}" failed. No retries permitted until 2026-06-15 06:26:05.855140969 +0000 UTC m=+18.150668227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret") pod "global-pull-secret-syncer-jb6rn" (UID: "d2462d75-6125-4066-a0d8-335ffe11dc4a") : object "kube-system"/"original-pull-secret" not registered Jun 15 06:25:57.855437 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:57.855094 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:25:57.855437 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:57.855217 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs podName:7a53739e-5156-4475-b741-e13c84564d26 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:05.8552037 +0000 UTC m=+18.150730958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs") pod "network-metrics-daemon-77v27" (UID: "7a53739e-5156-4475-b741-e13c84564d26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:25:57.956393 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:57.956307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx2h\" (UniqueName: \"kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h\") pod \"network-check-target-b66w6\" (UID: \"e7c17f5a-207f-46c3-a64d-1c4c70c0a022\") " pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:57.956556 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:57.956513 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 06:25:57.956556 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:57.956539 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 06:25:57.956556 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:57.956552 2576 projected.go:196] Error preparing data for projected volume kube-api-access-4cx2h for pod openshift-network-diagnostics/network-check-target-b66w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:25:57.956728 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:57.956618 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h podName:e7c17f5a-207f-46c3-a64d-1c4c70c0a022 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:05.956598091 +0000 UTC m=+18.252125347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx2h" (UniqueName: "kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h") pod "network-check-target-b66w6" (UID: "e7c17f5a-207f-46c3-a64d-1c4c70c0a022") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:25:58.138297 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:58.137144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:25:58.138297 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:58.137417 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:25:58.138297 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:58.138184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:25:58.140362 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:58.140314 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:25:58.140513 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:25:58.140417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:25:58.140579 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:25:58.140564 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:00.136250 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:00.136209 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:00.136718 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:00.136369 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:00.136718 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:00.136446 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:00.136718 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:00.136538 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:00.136718 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:00.136591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:00.136718 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:00.136659 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:02.136212 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:02.136169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:02.136658 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:02.136169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:02.136658 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:02.136310 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:02.136658 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:02.136169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:02.136658 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:02.136522 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:02.136658 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:02.136563 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:04.135849 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:04.135816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:04.136413 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:04.135816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:04.136413 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:04.135963 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:04.136413 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:04.135967 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:04.136413 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:04.136079 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:04.136413 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:04.136153 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:05.915078 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:05.915031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:05.915546 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:05.915106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:05.915546 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:05.915174 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:26:05.915546 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:05.915226 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 06:26:05.915546 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:05.915252 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs podName:7a53739e-5156-4475-b741-e13c84564d26 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:21.915231926 +0000 UTC m=+34.210759187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs") pod "network-metrics-daemon-77v27" (UID: "7a53739e-5156-4475-b741-e13c84564d26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:26:05.915546 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:05.915270 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret podName:d2462d75-6125-4066-a0d8-335ffe11dc4a nodeName:}" failed. No retries permitted until 2026-06-15 06:26:21.91526246 +0000 UTC m=+34.210789718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret") pod "global-pull-secret-syncer-jb6rn" (UID: "d2462d75-6125-4066-a0d8-335ffe11dc4a") : object "kube-system"/"original-pull-secret" not registered Jun 15 06:26:06.016178 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:06.016142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx2h\" (UniqueName: \"kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h\") pod \"network-check-target-b66w6\" (UID: \"e7c17f5a-207f-46c3-a64d-1c4c70c0a022\") " pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:06.016377 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:06.016323 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 06:26:06.016377 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:06.016345 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 06:26:06.016377 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:06.016357 2576 projected.go:196] Error preparing data for projected volume kube-api-access-4cx2h for pod openshift-network-diagnostics/network-check-target-b66w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:26:06.016536 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:06.016423 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h podName:e7c17f5a-207f-46c3-a64d-1c4c70c0a022 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:22.016405542 +0000 UTC m=+34.311932803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx2h" (UniqueName: "kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h") pod "network-check-target-b66w6" (UID: "e7c17f5a-207f-46c3-a64d-1c4c70c0a022") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:26:06.136512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:06.136471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:06.136699 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:06.136471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:06.136699 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:06.136636 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:06.136699 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:06.136473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:06.136853 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:06.136719 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:06.136853 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:06.136808 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:08.137254 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:08.137220 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:08.137755 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:08.137318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:08.137755 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:08.137346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:08.137755 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:08.137366 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:08.137755 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:08.137425 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:08.137755 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:08.137492 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:10.136775 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.136475 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:10.137402 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.136523 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:10.137402 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:10.136862 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:10.137402 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.136475 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:10.137402 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:10.136968 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:10.137402 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:10.137109 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:10.327925 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.327889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r6lk5" event={"ID":"85f05280-f319-4538-a205-ad382136d787","Type":"ContainerStarted","Data":"7350e6297e9735d0dcff4bec7901a305ea0a280024050f37d9db61041215cb7e"} Jun 15 06:26:10.329636 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.329604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rjxcq" event={"ID":"1193db8a-f0f2-4f9f-8eef-fd4f79f8b088","Type":"ContainerStarted","Data":"bf4d6ee83e0130e699c7e028780939d96cb7ed10f73302b7e7f9e5c2e4ebdf15"} Jun 15 06:26:10.331164 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.331138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qjd6k" event={"ID":"be585863-e1e4-43d4-a260-c9409de3709e","Type":"ContainerStarted","Data":"9e283d196d63461130b061e3dd5dadb3f7016ae84eefdd37893d61f99b5a7387"} Jun 15 06:26:10.332735 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.332708 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rjjk5" event={"ID":"3d30991d-9f2c-4702-a141-1d265a9c1970","Type":"ContainerStarted","Data":"f2346b7c3466b54849bb27f1076c5f5817f802e714bc73276bfe12b3e81fc153"} Jun 15 06:26:10.334260 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.334233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q6c66" event={"ID":"1fc8c279-c62e-42e7-b14f-7bf0339b9282","Type":"ContainerStarted","Data":"f441684fd8377fe881833cca34633d0a038542a4af1173f65e2f7b9aa81910ef"} Jun 15 06:26:10.337310 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.337283 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:26:10.337624 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.337595 2576 generic.go:356] "Generic (PLEG): container finished" podID="fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc" containerID="1146837b3bbda36fe26042d8bab8fa8ec565aa5c8414c78ddb24cbe739f7721d" exitCode=1 Jun 15 06:26:10.337722 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.337658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" event={"ID":"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc","Type":"ContainerStarted","Data":"6ed6d056ead7c274bbe02bdd8a01f820feb7c76cdccf24e7a0019a4fe863be5a"} Jun 15 06:26:10.337792 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.337732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" event={"ID":"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc","Type":"ContainerStarted","Data":"f9cc459595f24212e53e711f70e28d0908d8add6a80028c94544642fe867c94c"} Jun 15 06:26:10.337792 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.337787 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" event={"ID":"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc","Type":"ContainerStarted","Data":"c4f385359f549f91974510a8b366583c7fd0d0e709a3ac82995290b75f99eec5"} Jun 15 06:26:10.337920 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.337904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" event={"ID":"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc","Type":"ContainerStarted","Data":"208592fc4cb4eb2e755265dd148bdd48b6359c1b1e8707ef7821267a860826da"} Jun 15 06:26:10.337973 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.337961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" event={"ID":"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc","Type":"ContainerDied","Data":"1146837b3bbda36fe26042d8bab8fa8ec565aa5c8414c78ddb24cbe739f7721d"} Jun 15 06:26:10.338032 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.338012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" event={"ID":"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc","Type":"ContainerStarted","Data":"dd9bc857e569dccbf4d0870244964dd0e7b0a2b763a55d9f7b04a2087bf084f9"} Jun 15 06:26:10.339212 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.339190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" event={"ID":"f36afae1-3424-4f5d-9c5c-cf417ad82ae0","Type":"ContainerStarted","Data":"de9da7def02aeff5e1500eb921b2ee788fe1aeee86d686268d946d72ed8bf7bf"} Jun 15 06:26:10.340677 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.340655 2576 generic.go:356] "Generic (PLEG): container finished" podID="de2eb6e4-34bf-4853-a6eb-0d4b9170c30b" containerID="b64a586fb4456fcd8b947769ce254faacd584053674814eed5996086bf641ac1" exitCode=0 Jun 15 06:26:10.340769 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.340689 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" event={"ID":"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b","Type":"ContainerDied","Data":"b64a586fb4456fcd8b947769ce254faacd584053674814eed5996086bf641ac1"} Jun 15 06:26:10.342157 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.342034 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r6lk5" podStartSLOduration=3.866926909 podStartE2EDuration="22.342018879s" totalImagesPullingTime="18.47509197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:10.341999675 +0000 UTC m=+22.637526952" watchObservedRunningTime="2026-06-15 06:26:10.342018879 +0000 UTC m=+22.637546158" Jun 15 06:26:10.372665 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.372604 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q6c66" podStartSLOduration=3.924574186 podStartE2EDuration="22.372587995s" totalImagesPullingTime="18.448013809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:10.372227279 +0000 UTC m=+22.667754764" watchObservedRunningTime="2026-06-15 06:26:10.372587995 +0000 UTC m=+22.668115270" Jun 15 06:26:10.385060 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.385014 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rjjk5" podStartSLOduration=12.192952314 podStartE2EDuration="22.384997508s" totalImagesPullingTime="10.192045194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:10.384754624 +0000 UTC m=+22.680281910" watchObservedRunningTime="2026-06-15 06:26:10.384997508 +0000 UTC m=+22.680524784" Jun 15 06:26:10.398267 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.398172 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rjxcq" podStartSLOduration=3.957416508 podStartE2EDuration="22.398155325s" totalImagesPullingTime="18.440738817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:10.397886059 +0000 UTC m=+22.693413326" watchObservedRunningTime="2026-06-15 06:26:10.398155325 +0000 UTC m=+22.693682600" Jun 15 06:26:10.412660 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:10.412607 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qjd6k" podStartSLOduration=3.9772590880000003 podStartE2EDuration="22.412592196s" totalImagesPullingTime="18.435333108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:10.412354544 +0000 UTC m=+22.707881820" watchObservedRunningTime="2026-06-15 06:26:10.412592196 +0000 UTC m=+22.708119471" Jun 15 06:26:11.091616 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:11.091591 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 06:26:11.132365 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:11.132276 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T06:26:11.091612128Z","UUID":"7db36e1c-fc53-4d92-af96-c7ce26727aaf","Handler":null,"Name":"","Endpoint":""} Jun 15 06:26:11.134020 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:11.133983 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 06:26:11.134169 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:11.134045 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 06:26:11.344304 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:11.344207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bdzkh" event={"ID":"5c22328c-7c4e-4aca-9bed-8218bae58f69","Type":"ContainerStarted","Data":"044100cd19b4985d202ad512662f7f690aff47b624cc1831f28e83f881a8639a"} Jun 15 06:26:11.346091 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:11.346052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" event={"ID":"f36afae1-3424-4f5d-9c5c-cf417ad82ae0","Type":"ContainerStarted","Data":"33c224a644eaf080d868d1da99b82b78ed4c1663c2fc900f0cddb7f85b007bbf"} Jun 15 06:26:11.359320 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:11.359274 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bdzkh" podStartSLOduration=4.920222713 podStartE2EDuration="23.359260364s" totalImagesPullingTime="18.439037651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:11.358679273 +0000 UTC m=+23.654206549" watchObservedRunningTime="2026-06-15 06:26:11.359260364 +0000 UTC m=+23.654787640" Jun 15 06:26:12.135978 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:12.135933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:12.135978 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:12.135959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:12.135978 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:12.135933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:12.136279 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:12.136084 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:12.136279 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:12.136122 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:12.136279 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:12.136254 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:12.350268 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:12.350232 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" event={"ID":"f36afae1-3424-4f5d-9c5c-cf417ad82ae0","Type":"ContainerStarted","Data":"ccacfd69c09aae61cf434315d478bbd870cb953d2b10c331b6acb9f67e273126"} Jun 15 06:26:12.366315 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:12.366265 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sh5b" podStartSLOduration=4.119587678 podStartE2EDuration="24.366247711s" totalImagesPullingTime="20.246660033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:12.365966517 +0000 UTC m=+24.661493789" watchObservedRunningTime="2026-06-15 06:26:12.366247711 +0000 UTC m=+24.661774986" Jun 15 06:26:13.356744 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:13.356715 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:26:13.357193 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:13.357171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" event={"ID":"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc","Type":"ContainerStarted","Data":"79f927fe77868430fc272e1c6f0f628dfa6c16d3d9a219d556b8fd4a66df4f60"} Jun 15 06:26:14.136494 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:14.136458 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:14.136684 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:14.136458 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:14.136684 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:14.136588 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:14.136684 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:14.136467 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:14.136684 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:14.136648 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:14.136901 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:14.136714 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:15.050954 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:15.050690 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:26:15.051430 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:15.051379 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:26:15.362510 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:15.362478 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:26:15.363019 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:15.363001 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rjjk5" Jun 15 06:26:16.135678 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:16.135645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:16.136517 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:16.135689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:16.136517 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:16.135777 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:16.136517 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:16.135817 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:16.136517 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:16.135858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:16.136517 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:16.135951 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:16.368347 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:16.368324 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:26:16.368854 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:16.368738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" event={"ID":"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc","Type":"ContainerStarted","Data":"1cd301320bde7dbb29611fe35a6e29e4f5abb96730fb4775e4590c88ce1c2455"} Jun 15 06:26:16.369022 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:16.368987 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:26:16.369223 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:16.369201 2576 scope.go:117] "RemoveContainer" containerID="1146837b3bbda36fe26042d8bab8fa8ec565aa5c8414c78ddb24cbe739f7721d" Jun 15 06:26:16.370784 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:16.370759 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" event={"ID":"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b","Type":"ContainerStarted","Data":"4edaecd8528a075cb7090cd4d911595b7064371e0a4fdc3c2d0fc31da52c746f"} Jun 15 06:26:16.384749 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:16.384727 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:26:17.375469 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.375243 2576 generic.go:356] "Generic (PLEG): container finished" podID="de2eb6e4-34bf-4853-a6eb-0d4b9170c30b" containerID="4edaecd8528a075cb7090cd4d911595b7064371e0a4fdc3c2d0fc31da52c746f" exitCode=0 Jun 15 06:26:17.375934 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.375329 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" event={"ID":"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b","Type":"ContainerDied","Data":"4edaecd8528a075cb7090cd4d911595b7064371e0a4fdc3c2d0fc31da52c746f"} Jun 15 06:26:17.379694 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.379676 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:26:17.380173 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.380151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" event={"ID":"fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc","Type":"ContainerStarted","Data":"d6e295c92af63ca591dfbc6ce019040511c163a349d9e88ac0ccd84f22650849"} Jun 15 06:26:17.380389 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.380342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:26:17.380448 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.380414 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:26:17.395797 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.395770 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:26:17.414746 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.414691 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" podStartSLOduration=10.899806006 podStartE2EDuration="29.414675634s" totalImagesPullingTime="18.514869628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:17.414255824 +0000 UTC m=+29.709783133" watchObservedRunningTime="2026-06-15 06:26:17.414675634 +0000 UTC m=+29.710202909" Jun 15 06:26:17.938971 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.938906 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-77v27"] Jun 15 06:26:17.939312 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.939067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:17.939312 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:17.939199 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:17.939723 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.939688 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jb6rn"] Jun 15 06:26:17.939855 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.939837 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:17.940162 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:17.939985 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:17.940416 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.940394 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b66w6"] Jun 15 06:26:17.940510 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:17.940497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:17.940612 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:17.940593 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:19.385969 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:19.385887 2576 generic.go:356] "Generic (PLEG): container finished" podID="de2eb6e4-34bf-4853-a6eb-0d4b9170c30b" containerID="c80d2fa57db52ade7dc504888ca987c128e51797c050dc3e623a5ad688ec4840" exitCode=0 Jun 15 06:26:19.386299 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:19.385963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" event={"ID":"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b","Type":"ContainerDied","Data":"c80d2fa57db52ade7dc504888ca987c128e51797c050dc3e623a5ad688ec4840"} Jun 15 06:26:20.136267 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:20.136237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:20.136448 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:20.136285 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:20.136448 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:20.136238 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:20.136448 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:20.136365 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:20.136448 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:20.136423 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:20.136649 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:20.136507 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:21.393487 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:21.393448 2576 generic.go:356] "Generic (PLEG): container finished" podID="de2eb6e4-34bf-4853-a6eb-0d4b9170c30b" containerID="87746d4ccf1cf9638a97ec3e0d016ba65918d2629881c405c1219afeecd00204" exitCode=0 Jun 15 06:26:21.394021 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:21.393500 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" event={"ID":"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b","Type":"ContainerDied","Data":"87746d4ccf1cf9638a97ec3e0d016ba65918d2629881c405c1219afeecd00204"} Jun 15 06:26:21.938884 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:21.938832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:21.939075 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:21.938896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:21.939075 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:21.938997 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 06:26:21.939075 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:21.939053 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret podName:d2462d75-6125-4066-a0d8-335ffe11dc4a nodeName:}" failed. No retries permitted until 2026-06-15 06:26:53.939038821 +0000 UTC m=+66.234566074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret") pod "global-pull-secret-syncer-jb6rn" (UID: "d2462d75-6125-4066-a0d8-335ffe11dc4a") : object "kube-system"/"original-pull-secret" not registered Jun 15 06:26:21.939240 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:21.938997 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:26:21.939240 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:21.939172 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs podName:7a53739e-5156-4475-b741-e13c84564d26 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:53.939148427 +0000 UTC m=+66.234675701 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs") pod "network-metrics-daemon-77v27" (UID: "7a53739e-5156-4475-b741-e13c84564d26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 06:26:22.039369 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.039334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx2h\" (UniqueName: \"kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h\") pod \"network-check-target-b66w6\" (UID: \"e7c17f5a-207f-46c3-a64d-1c4c70c0a022\") " pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:22.039554 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:22.039516 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 06:26:22.039554 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:22.039541 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 06:26:22.039554 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:22.039550 2576 projected.go:196] Error preparing data for projected volume kube-api-access-4cx2h for pod openshift-network-diagnostics/network-check-target-b66w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:26:22.039676 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:22.039603 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h podName:e7c17f5a-207f-46c3-a64d-1c4c70c0a022 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:54.039588687 +0000 UTC m=+66.335115940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx2h" (UniqueName: "kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h") pod "network-check-target-b66w6" (UID: "e7c17f5a-207f-46c3-a64d-1c4c70c0a022") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 06:26:22.136042 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.136002 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:22.136220 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.136053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:22.136220 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.136004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:22.136220 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:22.136146 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b66w6" podUID="e7c17f5a-207f-46c3-a64d-1c4c70c0a022" Jun 15 06:26:22.136387 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:22.136275 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:26:22.136453 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:22.136377 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6rn" podUID="d2462d75-6125-4066-a0d8-335ffe11dc4a" Jun 15 06:26:22.524400 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.524369 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-165.ec2.internal" event="NodeReady" Jun 15 06:26:22.524802 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.524516 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 06:26:22.568397 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.568357 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-grmt5"] Jun 15 06:26:22.587475 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.587228 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pgbtz"] Jun 15 06:26:22.587475 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.587352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.589370 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.589343 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4w8v\"" Jun 15 06:26:22.589370 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.589341 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 06:26:22.589565 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.589348 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 06:26:22.605082 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.605041 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-grmt5"] Jun 15 06:26:22.605082 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.605090 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pgbtz"] Jun 15 06:26:22.605275 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.605181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgbtz" Jun 15 06:26:22.607201 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.607158 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 06:26:22.607201 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.607172 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jf85d\"" Jun 15 06:26:22.607399 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.607205 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 06:26:22.607399 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.607218 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 06:26:22.744947 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.744911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d5138e6-62ab-4f06-a188-6bc66ed14d7f-cert\") pod \"ingress-canary-pgbtz\" (UID: \"4d5138e6-62ab-4f06-a188-6bc66ed14d7f\") " pod="openshift-ingress-canary/ingress-canary-pgbtz" Jun 15 06:26:22.744947 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.744952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgjxd\" (UniqueName: \"kubernetes.io/projected/4d5138e6-62ab-4f06-a188-6bc66ed14d7f-kube-api-access-dgjxd\") pod \"ingress-canary-pgbtz\" (UID: \"4d5138e6-62ab-4f06-a188-6bc66ed14d7f\") " pod="openshift-ingress-canary/ingress-canary-pgbtz" Jun 15 06:26:22.745195 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.744973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/569583f2-a93b-4cfe-84b2-33896cfb27b2-tmp-dir\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.745195 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.744997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ttfz\" (UniqueName: \"kubernetes.io/projected/569583f2-a93b-4cfe-84b2-33896cfb27b2-kube-api-access-8ttfz\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.745195 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.745065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.745195 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.745126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/569583f2-a93b-4cfe-84b2-33896cfb27b2-config-volume\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.846313 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.846224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d5138e6-62ab-4f06-a188-6bc66ed14d7f-cert\") pod \"ingress-canary-pgbtz\" (UID: \"4d5138e6-62ab-4f06-a188-6bc66ed14d7f\") " pod="openshift-ingress-canary/ingress-canary-pgbtz" Jun 15 06:26:22.846313 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.846264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgjxd\" (UniqueName: \"kubernetes.io/projected/4d5138e6-62ab-4f06-a188-6bc66ed14d7f-kube-api-access-dgjxd\") pod \"ingress-canary-pgbtz\" (UID: \"4d5138e6-62ab-4f06-a188-6bc66ed14d7f\") " pod="openshift-ingress-canary/ingress-canary-pgbtz" Jun 15 06:26:22.846313 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.846284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/569583f2-a93b-4cfe-84b2-33896cfb27b2-tmp-dir\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.846313 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.846307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ttfz\" (UniqueName: \"kubernetes.io/projected/569583f2-a93b-4cfe-84b2-33896cfb27b2-kube-api-access-8ttfz\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.846589 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.846519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.846589 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.846577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/569583f2-a93b-4cfe-84b2-33896cfb27b2-config-volume\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.846714 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.846695 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/569583f2-a93b-4cfe-84b2-33896cfb27b2-tmp-dir\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.846752 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:22.846706 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 06:26:22.846804 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:22.846791 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls podName:569583f2-a93b-4cfe-84b2-33896cfb27b2 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:23.346768993 +0000 UTC m=+35.642296256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls") pod "dns-default-grmt5" (UID: "569583f2-a93b-4cfe-84b2-33896cfb27b2") : secret "dns-default-metrics-tls" not found Jun 15 06:26:22.847183 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.847161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/569583f2-a93b-4cfe-84b2-33896cfb27b2-config-volume\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.851512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.851488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d5138e6-62ab-4f06-a188-6bc66ed14d7f-cert\") pod \"ingress-canary-pgbtz\" (UID: \"4d5138e6-62ab-4f06-a188-6bc66ed14d7f\") " pod="openshift-ingress-canary/ingress-canary-pgbtz" Jun 15 06:26:22.854009 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.853985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ttfz\" (UniqueName: \"kubernetes.io/projected/569583f2-a93b-4cfe-84b2-33896cfb27b2-kube-api-access-8ttfz\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:22.855458 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.855436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgjxd\" (UniqueName: \"kubernetes.io/projected/4d5138e6-62ab-4f06-a188-6bc66ed14d7f-kube-api-access-dgjxd\") pod \"ingress-canary-pgbtz\" (UID: \"4d5138e6-62ab-4f06-a188-6bc66ed14d7f\") " pod="openshift-ingress-canary/ingress-canary-pgbtz" Jun 15 06:26:22.917416 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:22.917380 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgbtz" Jun 15 06:26:23.133020 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:23.132889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pgbtz"] Jun 15 06:26:23.138329 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:26:23.138296 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5138e6_62ab_4f06_a188_6bc66ed14d7f.slice/crio-0ed5faff30e2ce72d684eaed820d766e88c3d9f3b1ff194e800d3c6ce8b081fd WatchSource:0}: Error finding container 0ed5faff30e2ce72d684eaed820d766e88c3d9f3b1ff194e800d3c6ce8b081fd: Status 404 returned error can't find the container with id 0ed5faff30e2ce72d684eaed820d766e88c3d9f3b1ff194e800d3c6ce8b081fd Jun 15 06:26:23.352280 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:23.352226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:23.352475 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:23.352351 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 06:26:23.352475 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:23.352418 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls podName:569583f2-a93b-4cfe-84b2-33896cfb27b2 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:24.352399007 +0000 UTC m=+36.647926262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls") pod "dns-default-grmt5" (UID: "569583f2-a93b-4cfe-84b2-33896cfb27b2") : secret "dns-default-metrics-tls" not found Jun 15 06:26:23.399631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:23.399546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pgbtz" event={"ID":"4d5138e6-62ab-4f06-a188-6bc66ed14d7f","Type":"ContainerStarted","Data":"0ed5faff30e2ce72d684eaed820d766e88c3d9f3b1ff194e800d3c6ce8b081fd"} Jun 15 06:26:24.136422 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:24.136167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:24.137226 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:24.136167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:24.137226 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:24.136199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:24.138634 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:24.138607 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 06:26:24.138767 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:24.138676 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 06:26:24.138986 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:24.138950 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pvw5d\"" Jun 15 06:26:24.139088 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:24.139025 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 06:26:24.139088 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:24.139071 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 06:26:24.139193 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:24.138954 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv827\"" Jun 15 06:26:24.359761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:24.359725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:24.359970 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:24.359916 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 06:26:24.360043 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:24.360012 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls podName:569583f2-a93b-4cfe-84b2-33896cfb27b2 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:26.359988143 +0000 UTC m=+38.655515401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls") pod "dns-default-grmt5" (UID: "569583f2-a93b-4cfe-84b2-33896cfb27b2") : secret "dns-default-metrics-tls" not found Jun 15 06:26:26.373437 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:26.373380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:26.373825 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:26.373529 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 06:26:26.373825 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:26.373604 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls podName:569583f2-a93b-4cfe-84b2-33896cfb27b2 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:30.37358354 +0000 UTC m=+42.669110799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls") pod "dns-default-grmt5" (UID: "569583f2-a93b-4cfe-84b2-33896cfb27b2") : secret "dns-default-metrics-tls" not found Jun 15 06:26:26.410022 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:26.409985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" event={"ID":"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b","Type":"ContainerStarted","Data":"21bec5294fc4d4863364a764525f38fb50b2573fc0afe764bfd9c4c728d0d200"} Jun 15 06:26:27.415540 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:27.415506 2576 generic.go:356] "Generic (PLEG): container finished" podID="de2eb6e4-34bf-4853-a6eb-0d4b9170c30b" containerID="21bec5294fc4d4863364a764525f38fb50b2573fc0afe764bfd9c4c728d0d200" exitCode=0 Jun 15 06:26:27.416060 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:27.415558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" event={"ID":"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b","Type":"ContainerDied","Data":"21bec5294fc4d4863364a764525f38fb50b2573fc0afe764bfd9c4c728d0d200"} Jun 15 06:26:27.417116 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:27.417095 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pgbtz" event={"ID":"4d5138e6-62ab-4f06-a188-6bc66ed14d7f","Type":"ContainerStarted","Data":"aef66f092615bb587c57f0c83bf5d229d74b7619a883d2cfbc7c789bdc7c4f32"} Jun 15 06:26:27.452752 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:27.452684 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pgbtz" podStartSLOduration=2.287228817 podStartE2EDuration="5.45266202s" totalImagesPullingTime="3.165433203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:27.45134563 +0000 UTC m=+39.746872909" watchObservedRunningTime="2026-06-15 06:26:27.45266202 +0000 UTC m=+39.748189296" Jun 15 06:26:28.422171 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:28.422134 2576 generic.go:356] "Generic (PLEG): container finished" podID="de2eb6e4-34bf-4853-a6eb-0d4b9170c30b" containerID="85b8f9d88c184dd2e5f5a1f332802fb6bbd089209f9ba7bcc7fa77b8cc14a66c" exitCode=0 Jun 15 06:26:28.422652 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:28.422224 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" event={"ID":"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b","Type":"ContainerDied","Data":"85b8f9d88c184dd2e5f5a1f332802fb6bbd089209f9ba7bcc7fa77b8cc14a66c"} Jun 15 06:26:29.427435 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:29.427402 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" event={"ID":"de2eb6e4-34bf-4853-a6eb-0d4b9170c30b","Type":"ContainerStarted","Data":"66ffa50efb85351cd5294364f71669e12f9865faef05647e888c0b08fa4a4215"} Jun 15 06:26:29.452311 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:29.452246 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m2d6t" podStartSLOduration=9.9925253 podStartE2EDuration="41.452226422s" totalImagesPullingTime="31.459701122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:29.451950365 +0000 UTC m=+41.747477642" watchObservedRunningTime="2026-06-15 06:26:29.452226422 +0000 UTC m=+41.747753698" Jun 15 06:26:30.400130 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:30.400084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:30.400292 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:30.400232 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 06:26:30.400359 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:30.400299 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls podName:569583f2-a93b-4cfe-84b2-33896cfb27b2 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:38.400283056 +0000 UTC m=+50.695810311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls") pod "dns-default-grmt5" (UID: "569583f2-a93b-4cfe-84b2-33896cfb27b2") : secret "dns-default-metrics-tls" not found Jun 15 06:26:38.458537 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:38.458501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:38.459175 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:38.458607 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 06:26:38.459175 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:38.458665 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls podName:569583f2-a93b-4cfe-84b2-33896cfb27b2 nodeName:}" failed. No retries permitted until 2026-06-15 06:26:54.45864922 +0000 UTC m=+66.754176476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls") pod "dns-default-grmt5" (UID: "569583f2-a93b-4cfe-84b2-33896cfb27b2") : secret "dns-default-metrics-tls" not found Jun 15 06:26:49.397135 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:49.397105 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fgsvg" Jun 15 06:26:53.964495 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:53.964439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:26:53.964951 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:53.964514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:53.966324 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:53.966304 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 06:26:53.966378 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:53.966361 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 06:26:53.974856 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:53.974834 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 06:26:53.974970 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:53.974958 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs podName:7a53739e-5156-4475-b741-e13c84564d26 nodeName:}" failed. No retries permitted until 2026-06-15 06:27:57.974940617 +0000 UTC m=+130.270467875 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs") pod "network-metrics-daemon-77v27" (UID: "7a53739e-5156-4475-b741-e13c84564d26") : secret "metrics-daemon-secret" not found Jun 15 06:26:53.978638 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:53.978605 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2462d75-6125-4066-a0d8-335ffe11dc4a-original-pull-secret\") pod \"global-pull-secret-syncer-jb6rn\" (UID: \"d2462d75-6125-4066-a0d8-335ffe11dc4a\") " pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:54.065324 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.065287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx2h\" (UniqueName: \"kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h\") pod \"network-check-target-b66w6\" (UID: \"e7c17f5a-207f-46c3-a64d-1c4c70c0a022\") " pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:54.067273 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.067254 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 06:26:54.078048 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.078024 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 06:26:54.088974 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.088945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cx2h\" (UniqueName: \"kubernetes.io/projected/e7c17f5a-207f-46c3-a64d-1c4c70c0a022-kube-api-access-4cx2h\") pod \"network-check-target-b66w6\" (UID: \"e7c17f5a-207f-46c3-a64d-1c4c70c0a022\") " pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:54.150582 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.150549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6rn" Jun 15 06:26:54.160540 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.160514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pvw5d\"" Jun 15 06:26:54.169258 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.169227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:54.281984 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.281944 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jb6rn"] Jun 15 06:26:54.286322 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:26:54.286295 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2462d75_6125_4066_a0d8_335ffe11dc4a.slice/crio-8449f624efc9810a6e43d5b48df4d8f420d63c09546223bd239bdfe8e67b6ad3 WatchSource:0}: Error finding container 8449f624efc9810a6e43d5b48df4d8f420d63c09546223bd239bdfe8e67b6ad3: Status 404 returned error can't find the container with id 8449f624efc9810a6e43d5b48df4d8f420d63c09546223bd239bdfe8e67b6ad3 Jun 15 06:26:54.296230 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.296200 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b66w6"] Jun 15 06:26:54.299671 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:26:54.299642 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c17f5a_207f_46c3_a64d_1c4c70c0a022.slice/crio-a06a39e3496c0c7e4b3527f37410dda6f3fb4f1ac0899806af32fcbb3df1d36a WatchSource:0}: Error finding container a06a39e3496c0c7e4b3527f37410dda6f3fb4f1ac0899806af32fcbb3df1d36a: Status 404 returned error can't find the container with id a06a39e3496c0c7e4b3527f37410dda6f3fb4f1ac0899806af32fcbb3df1d36a Jun 15 06:26:54.467588 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.467539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:26:54.467777 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:54.467684 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 06:26:54.467777 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:26:54.467752 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls podName:569583f2-a93b-4cfe-84b2-33896cfb27b2 nodeName:}" failed. No retries permitted until 2026-06-15 06:27:26.46773508 +0000 UTC m=+98.763262333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls") pod "dns-default-grmt5" (UID: "569583f2-a93b-4cfe-84b2-33896cfb27b2") : secret "dns-default-metrics-tls" not found Jun 15 06:26:54.488790 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.488702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jb6rn" event={"ID":"d2462d75-6125-4066-a0d8-335ffe11dc4a","Type":"ContainerStarted","Data":"8449f624efc9810a6e43d5b48df4d8f420d63c09546223bd239bdfe8e67b6ad3"} Jun 15 06:26:54.489674 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:54.489648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b66w6" event={"ID":"e7c17f5a-207f-46c3-a64d-1c4c70c0a022","Type":"ContainerStarted","Data":"a06a39e3496c0c7e4b3527f37410dda6f3fb4f1ac0899806af32fcbb3df1d36a"} Jun 15 06:26:59.505167 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:59.505123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b66w6" event={"ID":"e7c17f5a-207f-46c3-a64d-1c4c70c0a022","Type":"ContainerStarted","Data":"fc5736006bfd511aba03efe1896b85f67214f99240ce38e4803e98c62e2ea862"} Jun 15 06:26:59.505692 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:59.505231 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:26:59.506594 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:59.506569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jb6rn" event={"ID":"d2462d75-6125-4066-a0d8-335ffe11dc4a","Type":"ContainerStarted","Data":"99095988bdf96466f473c0d787af0e08511d4e8b0be1db2ff00fa624782c073e"} Jun 15 06:26:59.530145 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:59.530089 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jb6rn" podStartSLOduration=66.99071381 podStartE2EDuration="1m11.53006966s" totalImagesPullingTime="4.53935585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:59.529903005 +0000 UTC m=+71.825430280" watchObservedRunningTime="2026-06-15 06:26:59.53006966 +0000 UTC m=+71.825596933" Jun 15 06:26:59.530564 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:26:59.530535 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b66w6" podStartSLOduration=67.01063912 podStartE2EDuration="1m11.530524644s" totalImagesPullingTime="4.519885524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:26:59.518001837 +0000 UTC m=+71.813529124" watchObservedRunningTime="2026-06-15 06:26:59.530524644 +0000 UTC m=+71.826051911" Jun 15 06:27:26.477400 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:27:26.477354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:27:26.477820 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:27:26.477505 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 06:27:26.477820 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:27:26.477599 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls podName:569583f2-a93b-4cfe-84b2-33896cfb27b2 nodeName:}" failed. No retries permitted until 2026-06-15 06:28:30.477581539 +0000 UTC m=+162.773108794 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls") pod "dns-default-grmt5" (UID: "569583f2-a93b-4cfe-84b2-33896cfb27b2") : secret "dns-default-metrics-tls" not found Jun 15 06:27:30.511615 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:27:30.511582 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b66w6" Jun 15 06:27:57.987741 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:27:57.987700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:27:57.988241 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:27:57.987861 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 06:27:57.988241 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:27:57.987947 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs podName:7a53739e-5156-4475-b741-e13c84564d26 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:59.987930883 +0000 UTC m=+252.283458136 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs") pod "network-metrics-daemon-77v27" (UID: "7a53739e-5156-4475-b741-e13c84564d26") : secret "metrics-daemon-secret" not found Jun 15 06:28:25.598529 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:28:25.598467 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-grmt5" podUID="569583f2-a93b-4cfe-84b2-33896cfb27b2" Jun 15 06:28:25.711441 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:28:25.711413 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-grmt5" Jun 15 06:28:27.165328 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:28:27.165281 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-77v27" podUID="7a53739e-5156-4475-b741-e13c84564d26" Jun 15 06:28:30.515878 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:28:30.515831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:28:30.516359 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:28:30.515957 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 06:28:30.516359 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:28:30.516028 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls podName:569583f2-a93b-4cfe-84b2-33896cfb27b2 nodeName:}" failed. No retries permitted until 2026-06-15 06:30:32.516011103 +0000 UTC m=+284.811538359 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls") pod "dns-default-grmt5" (UID: "569583f2-a93b-4cfe-84b2-33896cfb27b2") : secret "dns-default-metrics-tls" not found Jun 15 06:28:39.136019 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:28:39.135920 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:29:01.872919 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.872880 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9"] Jun 15 06:29:01.874720 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.874706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:01.877013 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.876988 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5ffcd796f6-fff9z"] Jun 15 06:29:01.877940 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.877856 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 15 06:29:01.877940 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.877935 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wvvdf\"" Jun 15 06:29:01.878207 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.878183 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 15 06:29:01.878308 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.878231 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 15 06:29:01.878308 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.878244 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 15 06:29:01.878604 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.878581 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-bpkcx"] Jun 15 06:29:01.878700 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.878688 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:01.881073 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.881049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:01.881505 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.881483 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 06:29:01.881596 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.881540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 15 06:29:01.881596 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.881553 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 15 06:29:01.881596 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.881591 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 15 06:29:01.881767 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.881750 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 15 06:29:01.881846 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.881831 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-crqgq\"" Jun 15 06:29:01.881951 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.881937 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 06:29:01.884179 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.884160 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 06:29:01.884278 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.884263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-w2bxg\"" Jun 15 06:29:01.884343 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.884282 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 15 06:29:01.886439 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.886417 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 15 06:29:01.887041 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.887022 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 06:29:01.890512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.890211 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9"] Jun 15 06:29:01.894588 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.894568 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 15 06:29:01.897246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.897226 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-bpkcx"] Jun 15 06:29:01.899809 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.899759 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5ffcd796f6-fff9z"] Jun 15 06:29:01.915361 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-serving-cert\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:01.915516 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79bbe5ab-1776-47bb-bfa1-6704f115928e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-p78v9\" (UID: \"79bbe5ab-1776-47bb-bfa1-6704f115928e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:01.915516 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqbpr\" (UniqueName: \"kubernetes.io/projected/79bbe5ab-1776-47bb-bfa1-6704f115928e-kube-api-access-hqbpr\") pod \"service-ca-operator-7ccbfd59dc-p78v9\" (UID: \"79bbe5ab-1776-47bb-bfa1-6704f115928e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:01.915516 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-tmp\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:01.915516 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rfhq\" (UniqueName: \"kubernetes.io/projected/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-kube-api-access-5rfhq\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:01.915791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-snapshots\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:01.915791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:01.915791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79bbe5ab-1776-47bb-bfa1-6704f115928e-config\") pod \"service-ca-operator-7ccbfd59dc-p78v9\" (UID: \"79bbe5ab-1776-47bb-bfa1-6704f115928e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:01.915791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-default-certificate\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:01.915791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:01.915791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-stats-auth\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:01.915791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgz6p\" (UniqueName: \"kubernetes.io/projected/e9504a48-d19f-4e36-bd5e-977e2e91be54-kube-api-access-rgz6p\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:01.915791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:01.916088 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.915807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:01.972619 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.972584 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2"] Jun 15 06:29:01.974474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.974458 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:01.976600 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.976568 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 15 06:29:01.976600 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.976594 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 15 06:29:01.976777 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.976643 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 15 06:29:01.976777 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.976682 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zcjzs\"" Jun 15 06:29:01.981216 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.981196 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx"] Jun 15 06:29:01.983229 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.983213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx" Jun 15 06:29:01.985014 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.984997 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4db2f\"" Jun 15 06:29:01.988283 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.988260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2"] Jun 15 06:29:01.994414 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:01.994389 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx"] Jun 15 06:29:02.016928 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.016888 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgz6p\" (UniqueName: \"kubernetes.io/projected/e9504a48-d19f-4e36-bd5e-977e2e91be54-kube-api-access-rgz6p\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:02.016928 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.016928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:02.017172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.016950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.017172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.016969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-serving-cert\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.017172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.016995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79bbe5ab-1776-47bb-bfa1-6704f115928e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-p78v9\" (UID: \"79bbe5ab-1776-47bb-bfa1-6704f115928e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:02.017172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqbpr\" (UniqueName: \"kubernetes.io/projected/79bbe5ab-1776-47bb-bfa1-6704f115928e-kube-api-access-hqbpr\") pod \"service-ca-operator-7ccbfd59dc-p78v9\" (UID: \"79bbe5ab-1776-47bb-bfa1-6704f115928e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:02.017172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-tmp\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.017172 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:02.017041 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 06:29:02.017172 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:02.017128 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:02.517105407 +0000 UTC m=+194.812632664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : secret "router-metrics-certs-default" not found Jun 15 06:29:02.017172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rfhq\" (UniqueName: \"kubernetes.io/projected/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-kube-api-access-5rfhq\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.017536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:02.017536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-snapshots\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.017536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gstc\" (UniqueName: \"kubernetes.io/projected/d3366df9-10f4-45b6-b16b-6c2815bdeeef-kube-api-access-2gstc\") pod \"network-check-source-6947749cfc-7vcfx\" (UID: \"d3366df9-10f4-45b6-b16b-6c2815bdeeef\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx" Jun 15 06:29:02.017536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.017536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79bbe5ab-1776-47bb-bfa1-6704f115928e-config\") pod \"service-ca-operator-7ccbfd59dc-p78v9\" (UID: \"79bbe5ab-1776-47bb-bfa1-6704f115928e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:02.017536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-default-certificate\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:02.017536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-tmp\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.017536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:02.017958 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-stats-auth\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:02.017958 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.017574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxjd8\" (UniqueName: \"kubernetes.io/projected/ed4ff54f-4512-48d8-8574-149f122d5851-kube-api-access-vxjd8\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:02.017958 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:02.017743 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:02.51772485 +0000 UTC m=+194.813252119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : configmap references non-existent config key: service-ca.crt Jun 15 06:29:02.018116 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.018013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79bbe5ab-1776-47bb-bfa1-6704f115928e-config\") pod \"service-ca-operator-7ccbfd59dc-p78v9\" (UID: \"79bbe5ab-1776-47bb-bfa1-6704f115928e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:02.018173 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.018122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.018288 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.018251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-snapshots\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.018882 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.018840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.019578 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.019551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79bbe5ab-1776-47bb-bfa1-6704f115928e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-p78v9\" (UID: \"79bbe5ab-1776-47bb-bfa1-6704f115928e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:02.019839 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.019823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-default-certificate\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:02.019985 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.019969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-serving-cert\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.020048 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.020029 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-stats-auth\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:02.035467 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.035436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqbpr\" (UniqueName: \"kubernetes.io/projected/79bbe5ab-1776-47bb-bfa1-6704f115928e-kube-api-access-hqbpr\") pod \"service-ca-operator-7ccbfd59dc-p78v9\" (UID: \"79bbe5ab-1776-47bb-bfa1-6704f115928e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:02.035715 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.035691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rfhq\" (UniqueName: \"kubernetes.io/projected/f90f885d-a57e-4f6b-aad4-1c83c98d06ce-kube-api-access-5rfhq\") pod \"insights-operator-5bbd86d6bd-bpkcx\" (UID: \"f90f885d-a57e-4f6b-aad4-1c83c98d06ce\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.036209 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.036193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgz6p\" (UniqueName: \"kubernetes.io/projected/e9504a48-d19f-4e36-bd5e-977e2e91be54-kube-api-access-rgz6p\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:02.077143 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.077107 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp"] Jun 15 06:29:02.079574 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.079560 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.083638 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.083616 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 15 06:29:02.084221 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.084204 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 15 06:29:02.084461 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.084441 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bpk8j\"" Jun 15 06:29:02.084461 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.084449 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 15 06:29:02.084601 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.084470 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 15 06:29:02.091994 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.091970 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp"] Jun 15 06:29:02.118882 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.118834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxjd8\" (UniqueName: \"kubernetes.io/projected/ed4ff54f-4512-48d8-8574-149f122d5851-kube-api-access-vxjd8\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:02.119039 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.118888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/171a15a6-9d97-4ff2-ba21-d81a93a93cdb-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-4pvgp\" (UID: \"171a15a6-9d97-4ff2-ba21-d81a93a93cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.119039 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.118928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s8zn\" (UniqueName: \"kubernetes.io/projected/171a15a6-9d97-4ff2-ba21-d81a93a93cdb-kube-api-access-7s8zn\") pod \"kube-storage-version-migrator-operator-7c578b78fc-4pvgp\" (UID: \"171a15a6-9d97-4ff2-ba21-d81a93a93cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.119039 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.118958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:02.119039 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.118976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/171a15a6-9d97-4ff2-ba21-d81a93a93cdb-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-4pvgp\" (UID: \"171a15a6-9d97-4ff2-ba21-d81a93a93cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.119169 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.119045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gstc\" (UniqueName: \"kubernetes.io/projected/d3366df9-10f4-45b6-b16b-6c2815bdeeef-kube-api-access-2gstc\") pod \"network-check-source-6947749cfc-7vcfx\" (UID: \"d3366df9-10f4-45b6-b16b-6c2815bdeeef\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx" Jun 15 06:29:02.119169 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:02.119076 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 06:29:02.119169 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:02.119144 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls podName:ed4ff54f-4512-48d8-8574-149f122d5851 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:02.61912382 +0000 UTC m=+194.914651074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls") pod "cluster-samples-operator-9547488fd-clqp2" (UID: "ed4ff54f-4512-48d8-8574-149f122d5851") : secret "samples-operator-tls" not found Jun 15 06:29:02.128900 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.128817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gstc\" (UniqueName: \"kubernetes.io/projected/d3366df9-10f4-45b6-b16b-6c2815bdeeef-kube-api-access-2gstc\") pod \"network-check-source-6947749cfc-7vcfx\" (UID: \"d3366df9-10f4-45b6-b16b-6c2815bdeeef\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx" Jun 15 06:29:02.129008 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.128898 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxjd8\" (UniqueName: \"kubernetes.io/projected/ed4ff54f-4512-48d8-8574-149f122d5851-kube-api-access-vxjd8\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:02.186555 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.186518 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" Jun 15 06:29:02.202702 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.202677 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" Jun 15 06:29:02.219908 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.219863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/171a15a6-9d97-4ff2-ba21-d81a93a93cdb-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-4pvgp\" (UID: \"171a15a6-9d97-4ff2-ba21-d81a93a93cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.220043 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.219953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/171a15a6-9d97-4ff2-ba21-d81a93a93cdb-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-4pvgp\" (UID: \"171a15a6-9d97-4ff2-ba21-d81a93a93cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.220043 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.219985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s8zn\" (UniqueName: \"kubernetes.io/projected/171a15a6-9d97-4ff2-ba21-d81a93a93cdb-kube-api-access-7s8zn\") pod \"kube-storage-version-migrator-operator-7c578b78fc-4pvgp\" (UID: \"171a15a6-9d97-4ff2-ba21-d81a93a93cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.220553 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.220528 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/171a15a6-9d97-4ff2-ba21-d81a93a93cdb-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-4pvgp\" (UID: \"171a15a6-9d97-4ff2-ba21-d81a93a93cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.223895 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.223848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/171a15a6-9d97-4ff2-ba21-d81a93a93cdb-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-4pvgp\" (UID: \"171a15a6-9d97-4ff2-ba21-d81a93a93cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.227159 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.227131 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s8zn\" (UniqueName: \"kubernetes.io/projected/171a15a6-9d97-4ff2-ba21-d81a93a93cdb-kube-api-access-7s8zn\") pod \"kube-storage-version-migrator-operator-7c578b78fc-4pvgp\" (UID: \"171a15a6-9d97-4ff2-ba21-d81a93a93cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.291104 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.291068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx" Jun 15 06:29:02.315290 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.315250 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9"] Jun 15 06:29:02.320493 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:02.320457 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bbe5ab_1776_47bb_bfa1_6704f115928e.slice/crio-85d43098b6438d75cf900b2fe9402bfe0ba6afc2f97e0187f3cf436845e3bb23 WatchSource:0}: Error finding container 85d43098b6438d75cf900b2fe9402bfe0ba6afc2f97e0187f3cf436845e3bb23: Status 404 returned error can't find the container with id 85d43098b6438d75cf900b2fe9402bfe0ba6afc2f97e0187f3cf436845e3bb23 Jun 15 06:29:02.331241 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.331131 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-bpkcx"] Jun 15 06:29:02.337655 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:02.337631 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90f885d_a57e_4f6b_aad4_1c83c98d06ce.slice/crio-b0f5904b8fff3a94f6eb6e93ef1004d30516ac5a5f0277a27b8fdd4a6651d5f0 WatchSource:0}: Error finding container b0f5904b8fff3a94f6eb6e93ef1004d30516ac5a5f0277a27b8fdd4a6651d5f0: Status 404 returned error can't find the container with id b0f5904b8fff3a94f6eb6e93ef1004d30516ac5a5f0277a27b8fdd4a6651d5f0 Jun 15 06:29:02.389289 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.389211 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" Jun 15 06:29:02.416097 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.416063 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx"] Jun 15 06:29:02.419175 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:02.419150 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3366df9_10f4_45b6_b16b_6c2815bdeeef.slice/crio-67ff22d177fd2a5a43166749df3812dba1494dcb27517f3a55257ff9a28b396b WatchSource:0}: Error finding container 67ff22d177fd2a5a43166749df3812dba1494dcb27517f3a55257ff9a28b396b: Status 404 returned error can't find the container with id 67ff22d177fd2a5a43166749df3812dba1494dcb27517f3a55257ff9a28b396b Jun 15 06:29:02.517242 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.517206 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp"] Jun 15 06:29:02.520555 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:02.520525 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171a15a6_9d97_4ff2_ba21_d81a93a93cdb.slice/crio-5a2fa9ececc94b2fa89beacb49f819c9fdc8ab4eed78910398a6e5b99d4d2e5f WatchSource:0}: Error finding container 5a2fa9ececc94b2fa89beacb49f819c9fdc8ab4eed78910398a6e5b99d4d2e5f: Status 404 returned error can't find the container with id 5a2fa9ececc94b2fa89beacb49f819c9fdc8ab4eed78910398a6e5b99d4d2e5f Jun 15 06:29:02.521494 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.521474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:02.521569 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.521513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:02.521659 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:02.521645 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 06:29:02.521722 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:02.521646 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:03.52163038 +0000 UTC m=+195.817157633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : configmap references non-existent config key: service-ca.crt Jun 15 06:29:02.521722 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:02.521714 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:03.521700965 +0000 UTC m=+195.817228224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : secret "router-metrics-certs-default" not found Jun 15 06:29:02.622255 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.622223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:02.622439 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:02.622378 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 06:29:02.622482 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:02.622443 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls podName:ed4ff54f-4512-48d8-8574-149f122d5851 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:03.622427285 +0000 UTC m=+195.917954540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls") pod "cluster-samples-operator-9547488fd-clqp2" (UID: "ed4ff54f-4512-48d8-8574-149f122d5851") : secret "samples-operator-tls" not found Jun 15 06:29:02.803013 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.802903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" event={"ID":"79bbe5ab-1776-47bb-bfa1-6704f115928e","Type":"ContainerStarted","Data":"85d43098b6438d75cf900b2fe9402bfe0ba6afc2f97e0187f3cf436845e3bb23"} Jun 15 06:29:02.804303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.804263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" event={"ID":"f90f885d-a57e-4f6b-aad4-1c83c98d06ce","Type":"ContainerStarted","Data":"b0f5904b8fff3a94f6eb6e93ef1004d30516ac5a5f0277a27b8fdd4a6651d5f0"} Jun 15 06:29:02.806386 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.806021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx" event={"ID":"d3366df9-10f4-45b6-b16b-6c2815bdeeef","Type":"ContainerStarted","Data":"7fe29bddf9f9d754d418ddd0b8f15a1a8873bb66fa29e24fd2258ac422711b4a"} Jun 15 06:29:02.806386 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.806066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx" event={"ID":"d3366df9-10f4-45b6-b16b-6c2815bdeeef","Type":"ContainerStarted","Data":"67ff22d177fd2a5a43166749df3812dba1494dcb27517f3a55257ff9a28b396b"} Jun 15 06:29:02.807288 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.807239 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" event={"ID":"171a15a6-9d97-4ff2-ba21-d81a93a93cdb","Type":"ContainerStarted","Data":"5a2fa9ececc94b2fa89beacb49f819c9fdc8ab4eed78910398a6e5b99d4d2e5f"} Jun 15 06:29:02.820655 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:02.820599 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-7vcfx" podStartSLOduration=1.820580334 podStartE2EDuration="1.820580334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:02.819457362 +0000 UTC m=+195.114984640" watchObservedRunningTime="2026-06-15 06:29:02.820580334 +0000 UTC m=+195.116107613" Jun 15 06:29:03.531696 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:03.530771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:03.531696 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:03.530837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:03.531696 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:03.531069 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 06:29:03.531696 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:03.531137 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:05.531115925 +0000 UTC m=+197.826643209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : secret "router-metrics-certs-default" not found Jun 15 06:29:03.531696 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:03.531652 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:05.531634368 +0000 UTC m=+197.827161624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : configmap references non-existent config key: service-ca.crt Jun 15 06:29:03.632091 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:03.631935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:03.632091 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:03.632073 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 06:29:03.632337 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:03.632137 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls podName:ed4ff54f-4512-48d8-8574-149f122d5851 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:05.632122282 +0000 UTC m=+197.927649536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls") pod "cluster-samples-operator-9547488fd-clqp2" (UID: "ed4ff54f-4512-48d8-8574-149f122d5851") : secret "samples-operator-tls" not found Jun 15 06:29:05.550040 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:05.549931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:05.550040 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:05.549978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:05.550552 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:05.550090 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 06:29:05.550552 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:05.550136 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:09.550112257 +0000 UTC m=+201.845639525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : configmap references non-existent config key: service-ca.crt Jun 15 06:29:05.550552 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:05.550206 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:09.550181437 +0000 UTC m=+201.845708706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : secret "router-metrics-certs-default" not found Jun 15 06:29:05.650762 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:05.650710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:05.650961 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:05.650908 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 06:29:05.651011 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:05.650987 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls podName:ed4ff54f-4512-48d8-8574-149f122d5851 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:09.650965912 +0000 UTC m=+201.946493178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls") pod "cluster-samples-operator-9547488fd-clqp2" (UID: "ed4ff54f-4512-48d8-8574-149f122d5851") : secret "samples-operator-tls" not found Jun 15 06:29:05.823247 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:05.823211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" event={"ID":"f90f885d-a57e-4f6b-aad4-1c83c98d06ce","Type":"ContainerStarted","Data":"4349ff457f73baa6ead6a4d1be538b6453c7db1e7e763f2ce119666f0af5cfcf"} Jun 15 06:29:05.824823 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:05.824769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" event={"ID":"171a15a6-9d97-4ff2-ba21-d81a93a93cdb","Type":"ContainerStarted","Data":"fb0cc755245494bc1e099f34331d4a295d40b2b7fac3442ed6fb4d3037f9e8b1"} Jun 15 06:29:05.826424 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:05.826393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" event={"ID":"79bbe5ab-1776-47bb-bfa1-6704f115928e","Type":"ContainerStarted","Data":"05796c1b2db81f155ad91a67861f8d6fab83aa75f18818fd20a66198a8006b52"} Jun 15 06:29:05.837714 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:05.837652 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" podStartSLOduration=1.950553649 podStartE2EDuration="4.83763684s" totalImagesPullingTime="2.887083191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:05.836975766 +0000 UTC m=+198.132503045" watchObservedRunningTime="2026-06-15 06:29:05.83763684 +0000 UTC m=+198.133164115" Jun 15 06:29:05.853698 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:05.853631 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" podStartSLOduration=1.953694837 podStartE2EDuration="4.853611497s" totalImagesPullingTime="2.89991666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:05.852131663 +0000 UTC m=+198.147658941" watchObservedRunningTime="2026-06-15 06:29:05.853611497 +0000 UTC m=+198.149138774" Jun 15 06:29:05.865456 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:05.865401 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" podStartSLOduration=1.159566205 podStartE2EDuration="3.865381308s" totalImagesPullingTime="2.705815103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:05.865223218 +0000 UTC m=+198.160750497" watchObservedRunningTime="2026-06-15 06:29:05.865381308 +0000 UTC m=+198.160908585" Jun 15 06:29:06.362893 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.362846 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nxm22"] Jun 15 06:29:06.365931 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.365912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.368559 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.368530 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zj5h\"" Jun 15 06:29:06.369105 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.369078 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 06:29:06.369605 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.369583 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 06:29:06.378513 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.378083 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nxm22"] Jun 15 06:29:06.457983 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.457950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxd9r\" (UniqueName: \"kubernetes.io/projected/20af2241-970a-4103-863b-6ab58ee334ae-kube-api-access-sxd9r\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.457983 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.457991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.458168 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.458008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.458168 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.458075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20af2241-970a-4103-863b-6ab58ee334ae-crio-socket\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.458253 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.458204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20af2241-970a-4103-863b-6ab58ee334ae-data-volume\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.558795 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.558752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20af2241-970a-4103-863b-6ab58ee334ae-data-volume\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.559246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.558807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxd9r\" (UniqueName: \"kubernetes.io/projected/20af2241-970a-4103-863b-6ab58ee334ae-kube-api-access-sxd9r\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.559246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.558856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.559246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.558892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.559246 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:06.558983 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 06:29:06.559246 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:06.558996 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 06:29:06.559246 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:06.559056 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls podName:20af2241-970a-4103-863b-6ab58ee334ae nodeName:}" failed. No retries permitted until 2026-06-15 06:29:07.059036347 +0000 UTC m=+199.354563605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxm22" (UID: "20af2241-970a-4103-863b-6ab58ee334ae") : secret "insights-runtime-extractor-tls" not found Jun 15 06:29:06.559246 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:06.559075 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm podName:20af2241-970a-4103-863b-6ab58ee334ae nodeName:}" failed. No retries permitted until 2026-06-15 06:29:07.059064504 +0000 UTC m=+199.354591764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxm22" (UID: "20af2241-970a-4103-863b-6ab58ee334ae") : configmap "kube-rbac-proxy" not found Jun 15 06:29:06.559246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.559047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20af2241-970a-4103-863b-6ab58ee334ae-crio-socket\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.559246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.559122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20af2241-970a-4103-863b-6ab58ee334ae-crio-socket\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.559246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.559191 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20af2241-970a-4103-863b-6ab58ee334ae-data-volume\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:06.567700 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:06.567673 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxd9r\" (UniqueName: \"kubernetes.io/projected/20af2241-970a-4103-863b-6ab58ee334ae-kube-api-access-sxd9r\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:07.062747 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:07.062709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:07.062747 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:07.062745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:07.063057 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:07.062860 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 06:29:07.063057 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:07.062957 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm podName:20af2241-970a-4103-863b-6ab58ee334ae nodeName:}" failed. No retries permitted until 2026-06-15 06:29:08.062937015 +0000 UTC m=+200.358464328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxm22" (UID: "20af2241-970a-4103-863b-6ab58ee334ae") : configmap "kube-rbac-proxy" not found Jun 15 06:29:07.063057 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:07.063045 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 06:29:07.063226 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:07.063107 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls podName:20af2241-970a-4103-863b-6ab58ee334ae nodeName:}" failed. No retries permitted until 2026-06-15 06:29:08.063090459 +0000 UTC m=+200.358617718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxm22" (UID: "20af2241-970a-4103-863b-6ab58ee334ae") : secret "insights-runtime-extractor-tls" not found Jun 15 06:29:08.071421 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:08.071380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:08.071421 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:08.071424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:08.071840 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:08.071510 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 06:29:08.071840 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:08.071574 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm podName:20af2241-970a-4103-863b-6ab58ee334ae nodeName:}" failed. No retries permitted until 2026-06-15 06:29:10.071559715 +0000 UTC m=+202.367086974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxm22" (UID: "20af2241-970a-4103-863b-6ab58ee334ae") : configmap "kube-rbac-proxy" not found Jun 15 06:29:08.071840 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:08.071618 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 06:29:08.071840 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:08.071673 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls podName:20af2241-970a-4103-863b-6ab58ee334ae nodeName:}" failed. No retries permitted until 2026-06-15 06:29:10.071660737 +0000 UTC m=+202.367187994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxm22" (UID: "20af2241-970a-4103-863b-6ab58ee334ae") : secret "insights-runtime-extractor-tls" not found Jun 15 06:29:08.546242 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:08.546173 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rjxcq_1193db8a-f0f2-4f9f-8eef-fd4f79f8b088/dns-node-resolver/0.log" Jun 15 06:29:09.540695 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:09.540666 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qjd6k_be585863-e1e4-43d4-a260-c9409de3709e/node-ca/0.log" Jun 15 06:29:09.584928 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:09.584826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:09.585087 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:09.584983 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 06:29:09.585087 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:09.584999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:09.585087 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:09.585051 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:17.585032923 +0000 UTC m=+209.880560178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : secret "router-metrics-certs-default" not found Jun 15 06:29:09.585194 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:09.585115 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:17.585103985 +0000 UTC m=+209.880631254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : configmap references non-existent config key: service-ca.crt Jun 15 06:29:09.686128 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:09.686091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:09.686277 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:09.686233 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 06:29:09.686334 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:09.686301 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls podName:ed4ff54f-4512-48d8-8574-149f122d5851 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:17.686284908 +0000 UTC m=+209.981812162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls") pod "cluster-samples-operator-9547488fd-clqp2" (UID: "ed4ff54f-4512-48d8-8574-149f122d5851") : secret "samples-operator-tls" not found Jun 15 06:29:10.088820 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.088766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:10.088820 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.088819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:10.089125 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:10.088936 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 06:29:10.089125 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:10.088985 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls podName:20af2241-970a-4103-863b-6ab58ee334ae nodeName:}" failed. No retries permitted until 2026-06-15 06:29:14.088970773 +0000 UTC m=+206.384498027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxm22" (UID: "20af2241-970a-4103-863b-6ab58ee334ae") : secret "insights-runtime-extractor-tls" not found Jun 15 06:29:10.089125 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:10.089026 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 06:29:10.089125 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:10.089096 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm podName:20af2241-970a-4103-863b-6ab58ee334ae nodeName:}" failed. No retries permitted until 2026-06-15 06:29:14.089078487 +0000 UTC m=+206.384605742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxm22" (UID: "20af2241-970a-4103-863b-6ab58ee334ae") : configmap "kube-rbac-proxy" not found Jun 15 06:29:10.140622 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.140595 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pgbtz_4d5138e6-62ab-4f06-a188-6bc66ed14d7f/serve-healthcheck-canary/0.log" Jun 15 06:29:10.181427 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.181389 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6k68q"] Jun 15 06:29:10.184043 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.184027 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.185779 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.185759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-88wts\"" Jun 15 06:29:10.186199 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.186182 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 15 06:29:10.186199 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.186193 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 15 06:29:10.186340 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.186193 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 15 06:29:10.186340 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.186196 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 15 06:29:10.192611 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.192575 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6k68q"] Jun 15 06:29:10.290843 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.290806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2ab7427-e728-4bd8-b1af-048b7d800964-signing-cabundle\") pod \"service-ca-7b994bc59-6k68q\" (UID: \"d2ab7427-e728-4bd8-b1af-048b7d800964\") " pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.291012 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.290855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bstqw\" (UniqueName: \"kubernetes.io/projected/d2ab7427-e728-4bd8-b1af-048b7d800964-kube-api-access-bstqw\") pod \"service-ca-7b994bc59-6k68q\" (UID: \"d2ab7427-e728-4bd8-b1af-048b7d800964\") " pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.291012 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.290942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2ab7427-e728-4bd8-b1af-048b7d800964-signing-key\") pod \"service-ca-7b994bc59-6k68q\" (UID: \"d2ab7427-e728-4bd8-b1af-048b7d800964\") " pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.391743 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.391641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bstqw\" (UniqueName: \"kubernetes.io/projected/d2ab7427-e728-4bd8-b1af-048b7d800964-kube-api-access-bstqw\") pod \"service-ca-7b994bc59-6k68q\" (UID: \"d2ab7427-e728-4bd8-b1af-048b7d800964\") " pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.391743 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.391707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2ab7427-e728-4bd8-b1af-048b7d800964-signing-key\") pod \"service-ca-7b994bc59-6k68q\" (UID: \"d2ab7427-e728-4bd8-b1af-048b7d800964\") " pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.392025 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.391786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2ab7427-e728-4bd8-b1af-048b7d800964-signing-cabundle\") pod \"service-ca-7b994bc59-6k68q\" (UID: \"d2ab7427-e728-4bd8-b1af-048b7d800964\") " pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.392445 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.392426 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2ab7427-e728-4bd8-b1af-048b7d800964-signing-cabundle\") pod \"service-ca-7b994bc59-6k68q\" (UID: \"d2ab7427-e728-4bd8-b1af-048b7d800964\") " pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.394146 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.394127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2ab7427-e728-4bd8-b1af-048b7d800964-signing-key\") pod \"service-ca-7b994bc59-6k68q\" (UID: \"d2ab7427-e728-4bd8-b1af-048b7d800964\") " pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.399591 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.399565 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bstqw\" (UniqueName: \"kubernetes.io/projected/d2ab7427-e728-4bd8-b1af-048b7d800964-kube-api-access-bstqw\") pod \"service-ca-7b994bc59-6k68q\" (UID: \"d2ab7427-e728-4bd8-b1af-048b7d800964\") " pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.494857 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.494817 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-6k68q" Jun 15 06:29:10.618160 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.618073 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6k68q"] Jun 15 06:29:10.620270 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:10.620232 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ab7427_e728_4bd8_b1af_048b7d800964.slice/crio-e4f9ea8b718f0a857f62c94b61dbf25b43a1c745f1a48d7a799190319a3535c3 WatchSource:0}: Error finding container e4f9ea8b718f0a857f62c94b61dbf25b43a1c745f1a48d7a799190319a3535c3: Status 404 returned error can't find the container with id e4f9ea8b718f0a857f62c94b61dbf25b43a1c745f1a48d7a799190319a3535c3 Jun 15 06:29:10.845219 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.845181 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-6k68q" event={"ID":"d2ab7427-e728-4bd8-b1af-048b7d800964","Type":"ContainerStarted","Data":"9e47acfb1ee53e7a72234113e7b5a403ad7345119c75f34a2a0ecedebfd68ba3"} Jun 15 06:29:10.845395 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.845230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-6k68q" event={"ID":"d2ab7427-e728-4bd8-b1af-048b7d800964","Type":"ContainerStarted","Data":"e4f9ea8b718f0a857f62c94b61dbf25b43a1c745f1a48d7a799190319a3535c3"} Jun 15 06:29:10.860736 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:10.860688 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-6k68q" podStartSLOduration=0.860673009 podStartE2EDuration="860.673009ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:10.859958495 +0000 UTC m=+203.155485771" watchObservedRunningTime="2026-06-15 06:29:10.860673009 +0000 UTC m=+203.156200323" Jun 15 06:29:14.125743 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:14.125695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:14.125743 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:14.125744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:14.126250 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:14.125839 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 06:29:14.126250 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:14.125844 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 06:29:14.126250 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:14.125926 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm podName:20af2241-970a-4103-863b-6ab58ee334ae nodeName:}" failed. No retries permitted until 2026-06-15 06:29:22.125906124 +0000 UTC m=+214.421433393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxm22" (UID: "20af2241-970a-4103-863b-6ab58ee334ae") : configmap "kube-rbac-proxy" not found Jun 15 06:29:14.126250 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:14.125970 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls podName:20af2241-970a-4103-863b-6ab58ee334ae nodeName:}" failed. No retries permitted until 2026-06-15 06:29:22.125951517 +0000 UTC m=+214.421478787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxm22" (UID: "20af2241-970a-4103-863b-6ab58ee334ae") : secret "insights-runtime-extractor-tls" not found Jun 15 06:29:17.653767 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:17.653719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:17.654271 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:17.653827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:17.654271 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:17.654043 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle podName:e9504a48-d19f-4e36-bd5e-977e2e91be54 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:33.654018651 +0000 UTC m=+225.949545923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle") pod "router-default-5ffcd796f6-fff9z" (UID: "e9504a48-d19f-4e36-bd5e-977e2e91be54") : configmap references non-existent config key: service-ca.crt Jun 15 06:29:17.656165 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:17.656141 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9504a48-d19f-4e36-bd5e-977e2e91be54-metrics-certs\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:17.754739 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:17.754698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:17.757331 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:17.757303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed4ff54f-4512-48d8-8574-149f122d5851-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-clqp2\" (UID: \"ed4ff54f-4512-48d8-8574-149f122d5851\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:17.883695 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:17.883648 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" Jun 15 06:29:18.015735 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:18.015695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2"] Jun 15 06:29:18.872366 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:18.872318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" event={"ID":"ed4ff54f-4512-48d8-8574-149f122d5851","Type":"ContainerStarted","Data":"40520d8fb9f16b14f96a25dfbe16072088d16688359f9d62e47326498e7b9640"} Jun 15 06:29:19.877621 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:19.877512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" event={"ID":"ed4ff54f-4512-48d8-8574-149f122d5851","Type":"ContainerStarted","Data":"14af1e252264bb839c392e506a2999c598696b4716d629e8b948b764fe478c7f"} Jun 15 06:29:20.882954 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:20.882915 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" event={"ID":"ed4ff54f-4512-48d8-8574-149f122d5851","Type":"ContainerStarted","Data":"655a6187dd17b1f82029c678414a54745552d3e8d958364c00ad787164be806c"} Jun 15 06:29:20.897667 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:20.897617 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-clqp2" podStartSLOduration=18.196731317 podStartE2EDuration="19.897601319s" totalImagesPullingTime="1.700870002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:20.896180168 +0000 UTC m=+213.191707443" watchObservedRunningTime="2026-06-15 06:29:20.897601319 +0000 UTC m=+213.193128596" Jun 15 06:29:22.192780 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:22.192737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:22.192780 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:22.192779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:22.193447 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:22.193423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20af2241-970a-4103-863b-6ab58ee334ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:22.195194 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:22.195175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20af2241-970a-4103-863b-6ab58ee334ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxm22\" (UID: \"20af2241-970a-4103-863b-6ab58ee334ae\") " pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:22.281687 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:22.281639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nxm22" Jun 15 06:29:22.406209 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:22.406172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nxm22"] Jun 15 06:29:22.408928 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:22.408901 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20af2241_970a_4103_863b_6ab58ee334ae.slice/crio-631534b659a365514d1e0ca6acce7b60e3051945580ea41a5c94ecce2807e240 WatchSource:0}: Error finding container 631534b659a365514d1e0ca6acce7b60e3051945580ea41a5c94ecce2807e240: Status 404 returned error can't find the container with id 631534b659a365514d1e0ca6acce7b60e3051945580ea41a5c94ecce2807e240 Jun 15 06:29:22.892387 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:22.892346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxm22" event={"ID":"20af2241-970a-4103-863b-6ab58ee334ae","Type":"ContainerStarted","Data":"631534b659a365514d1e0ca6acce7b60e3051945580ea41a5c94ecce2807e240"} Jun 15 06:29:25.904010 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:25.903922 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxm22" event={"ID":"20af2241-970a-4103-863b-6ab58ee334ae","Type":"ContainerStarted","Data":"adf9f73e2561f70a96de18e83b5884a9055fe4cf5e3c1a7f07e46ffc7b5db97c"} Jun 15 06:29:26.910331 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:26.910291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxm22" event={"ID":"20af2241-970a-4103-863b-6ab58ee334ae","Type":"ContainerStarted","Data":"79d27b3b14f1d4508b9a792f0c6d66b9c2955de276d391a7ad69d39a7097a374"} Jun 15 06:29:28.918964 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:28.918924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxm22" event={"ID":"20af2241-970a-4103-863b-6ab58ee334ae","Type":"ContainerStarted","Data":"34c9cac7626e3506e8f862eeaeea8d8118b5cfecf3152f00bb929fbd1bf93db0"} Jun 15 06:29:28.936957 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:28.936828 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nxm22" podStartSLOduration=17.436857074 podStartE2EDuration="22.936808236s" totalImagesPullingTime="5.499951162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:29:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:28.936428059 +0000 UTC m=+221.231955336" watchObservedRunningTime="2026-06-15 06:29:28.936808236 +0000 UTC m=+221.232335515" Jun 15 06:29:30.802947 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:30.802913 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-945wd"] Jun 15 06:29:30.805140 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:30.805118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-945wd" Jun 15 06:29:30.807065 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:30.807041 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 06:29:30.807208 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:30.807042 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 06:29:30.807208 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:30.807105 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8z6b4\"" Jun 15 06:29:30.822303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:30.822271 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-945wd"] Jun 15 06:29:30.970239 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:30.970203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pzs4\" (UniqueName: \"kubernetes.io/projected/5e9d1f40-9f29-4723-9fa7-98f7bc8e22b3-kube-api-access-4pzs4\") pod \"downloads-694c955b9-945wd\" (UID: \"5e9d1f40-9f29-4723-9fa7-98f7bc8e22b3\") " pod="openshift-console/downloads-694c955b9-945wd" Jun 15 06:29:31.070763 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:31.070739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pzs4\" (UniqueName: \"kubernetes.io/projected/5e9d1f40-9f29-4723-9fa7-98f7bc8e22b3-kube-api-access-4pzs4\") pod \"downloads-694c955b9-945wd\" (UID: \"5e9d1f40-9f29-4723-9fa7-98f7bc8e22b3\") " pod="openshift-console/downloads-694c955b9-945wd" Jun 15 06:29:31.093179 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:31.093139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pzs4\" (UniqueName: \"kubernetes.io/projected/5e9d1f40-9f29-4723-9fa7-98f7bc8e22b3-kube-api-access-4pzs4\") pod \"downloads-694c955b9-945wd\" (UID: \"5e9d1f40-9f29-4723-9fa7-98f7bc8e22b3\") " pod="openshift-console/downloads-694c955b9-945wd" Jun 15 06:29:31.114171 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:31.114126 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-945wd" Jun 15 06:29:31.279826 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:31.279792 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-945wd"] Jun 15 06:29:31.282781 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:31.282758 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e9d1f40_9f29_4723_9fa7_98f7bc8e22b3.slice/crio-4b3f035a35dc08ef82bd89443085622216ac7d3a0c909f0d6d3aa4d0fedd109d WatchSource:0}: Error finding container 4b3f035a35dc08ef82bd89443085622216ac7d3a0c909f0d6d3aa4d0fedd109d: Status 404 returned error can't find the container with id 4b3f035a35dc08ef82bd89443085622216ac7d3a0c909f0d6d3aa4d0fedd109d Jun 15 06:29:31.931222 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:31.931181 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-945wd" event={"ID":"5e9d1f40-9f29-4723-9fa7-98f7bc8e22b3","Type":"ContainerStarted","Data":"4b3f035a35dc08ef82bd89443085622216ac7d3a0c909f0d6d3aa4d0fedd109d"} Jun 15 06:29:33.695248 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:33.695202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:33.695855 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:33.695832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9504a48-d19f-4e36-bd5e-977e2e91be54-service-ca-bundle\") pod \"router-default-5ffcd796f6-fff9z\" (UID: \"e9504a48-d19f-4e36-bd5e-977e2e91be54\") " pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:33.696001 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:33.695986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:33.839932 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:33.839902 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5ffcd796f6-fff9z"] Jun 15 06:29:33.842919 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:33.842887 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9504a48_d19f_4e36_bd5e_977e2e91be54.slice/crio-e5f97a2d4310210a1a3d1eb63203e2482b8a46e3cb504086114323476afb427f WatchSource:0}: Error finding container e5f97a2d4310210a1a3d1eb63203e2482b8a46e3cb504086114323476afb427f: Status 404 returned error can't find the container with id e5f97a2d4310210a1a3d1eb63203e2482b8a46e3cb504086114323476afb427f Jun 15 06:29:33.941579 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:33.941539 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5ffcd796f6-fff9z" event={"ID":"e9504a48-d19f-4e36-bd5e-977e2e91be54","Type":"ContainerStarted","Data":"bb6cc60283c5834b6a61f746fecad87d7a89a954d26b10c07383d4c8f56a7dde"} Jun 15 06:29:33.941763 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:33.941601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5ffcd796f6-fff9z" event={"ID":"e9504a48-d19f-4e36-bd5e-977e2e91be54","Type":"ContainerStarted","Data":"e5f97a2d4310210a1a3d1eb63203e2482b8a46e3cb504086114323476afb427f"} Jun 15 06:29:33.959216 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:33.959102 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5ffcd796f6-fff9z" podStartSLOduration=32.959082087 podStartE2EDuration="32.959082087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:33.958004242 +0000 UTC m=+226.253531543" watchObservedRunningTime="2026-06-15 06:29:33.959082087 +0000 UTC m=+226.254609366" Jun 15 06:29:34.697202 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:34.697167 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:34.700055 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:34.700028 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:34.946227 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:34.946194 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:34.947679 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:34.947618 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5ffcd796f6-fff9z" Jun 15 06:29:36.270646 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:36.270610 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf"] Jun 15 06:29:36.273196 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:36.273172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" Jun 15 06:29:36.276375 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:36.276350 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bdrv7\"" Jun 15 06:29:36.276610 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:36.276589 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 15 06:29:36.281985 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:36.281913 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf"] Jun 15 06:29:36.418633 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:36.418593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/11f66703-e868-4708-8b2a-09bce878ddc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-jwxsf\" (UID: \"11f66703-e868-4708-8b2a-09bce878ddc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" Jun 15 06:29:36.519274 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:36.519230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/11f66703-e868-4708-8b2a-09bce878ddc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-jwxsf\" (UID: \"11f66703-e868-4708-8b2a-09bce878ddc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" Jun 15 06:29:36.519449 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:36.519389 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 15 06:29:36.519503 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:36.519460 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f66703-e868-4708-8b2a-09bce878ddc4-tls-certificates podName:11f66703-e868-4708-8b2a-09bce878ddc4 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:37.019440695 +0000 UTC m=+229.314967954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/11f66703-e868-4708-8b2a-09bce878ddc4-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-jwxsf" (UID: "11f66703-e868-4708-8b2a-09bce878ddc4") : secret "prometheus-operator-admission-webhook-tls" not found Jun 15 06:29:37.022922 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.022834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/11f66703-e868-4708-8b2a-09bce878ddc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-jwxsf\" (UID: \"11f66703-e868-4708-8b2a-09bce878ddc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" Jun 15 06:29:37.025609 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.025580 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/11f66703-e868-4708-8b2a-09bce878ddc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-jwxsf\" (UID: \"11f66703-e868-4708-8b2a-09bce878ddc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" Jun 15 06:29:37.184635 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.184596 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" Jun 15 06:29:37.329191 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.329155 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf"] Jun 15 06:29:37.332790 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:37.332754 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f66703_e868_4708_8b2a_09bce878ddc4.slice/crio-42f8ebbba1cf147a05dcde71715c89854323dec6fb6ca0b6849074e4dc9da21f WatchSource:0}: Error finding container 42f8ebbba1cf147a05dcde71715c89854323dec6fb6ca0b6849074e4dc9da21f: Status 404 returned error can't find the container with id 42f8ebbba1cf147a05dcde71715c89854323dec6fb6ca0b6849074e4dc9da21f Jun 15 06:29:37.399140 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.399091 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65fdf7c896-6xtdq"] Jun 15 06:29:37.402187 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.402164 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.404061 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.404036 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 06:29:37.404198 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.404064 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 06:29:37.404198 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.404084 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 06:29:37.404566 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.404545 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 06:29:37.404661 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.404590 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 06:29:37.404661 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.404623 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-svgsx\"" Jun 15 06:29:37.413391 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.413324 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65fdf7c896-6xtdq"] Jun 15 06:29:37.527820 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.527725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-console-config\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.527820 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.527777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-serving-cert\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.528056 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.527901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-oauth-serving-cert\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.528056 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.527951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-service-ca\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.528056 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.528015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-oauth-config\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.528178 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.528078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdl7z\" (UniqueName: \"kubernetes.io/projected/742c1976-6cf0-4a9e-9596-6c310d682432-kube-api-access-qdl7z\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.628819 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.628778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-serving-cert\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.629007 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.628842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-oauth-serving-cert\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.629007 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.628891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-service-ca\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.629007 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.628923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-oauth-config\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.629007 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.628979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdl7z\" (UniqueName: \"kubernetes.io/projected/742c1976-6cf0-4a9e-9596-6c310d682432-kube-api-access-qdl7z\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.629207 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.629021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-console-config\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.629774 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.629710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-oauth-serving-cert\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.629774 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.629763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-console-config\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.629985 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.629816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-service-ca\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.631725 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.631699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-serving-cert\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.631850 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.631775 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-oauth-config\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.636550 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.636531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdl7z\" (UniqueName: \"kubernetes.io/projected/742c1976-6cf0-4a9e-9596-6c310d682432-kube-api-access-qdl7z\") pod \"console-65fdf7c896-6xtdq\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.715533 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.715491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:37.878404 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.878373 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65fdf7c896-6xtdq"] Jun 15 06:29:37.881677 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:37.881647 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742c1976_6cf0_4a9e_9596_6c310d682432.slice/crio-a9ae589f106cec443a6fb02c9720203bb13c3761d785fb56de84eda8a4d0e8b7 WatchSource:0}: Error finding container a9ae589f106cec443a6fb02c9720203bb13c3761d785fb56de84eda8a4d0e8b7: Status 404 returned error can't find the container with id a9ae589f106cec443a6fb02c9720203bb13c3761d785fb56de84eda8a4d0e8b7 Jun 15 06:29:37.958507 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.958465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" event={"ID":"11f66703-e868-4708-8b2a-09bce878ddc4","Type":"ContainerStarted","Data":"42f8ebbba1cf147a05dcde71715c89854323dec6fb6ca0b6849074e4dc9da21f"} Jun 15 06:29:37.959971 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:37.959905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fdf7c896-6xtdq" event={"ID":"742c1976-6cf0-4a9e-9596-6c310d682432","Type":"ContainerStarted","Data":"a9ae589f106cec443a6fb02c9720203bb13c3761d785fb56de84eda8a4d0e8b7"} Jun 15 06:29:38.964939 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:38.964900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" event={"ID":"11f66703-e868-4708-8b2a-09bce878ddc4","Type":"ContainerStarted","Data":"4037ab81188475b689884281e03ac1277dc7c37ad965af7558793cdd3a14bbb7"} Jun 15 06:29:38.965412 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:38.965223 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" Jun 15 06:29:38.971471 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:38.971445 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" Jun 15 06:29:38.978026 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:38.977973 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jwxsf" podStartSLOduration=1.9194873239999999 podStartE2EDuration="2.977954218s" totalImagesPullingTime="1.058466894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:38.977465299 +0000 UTC m=+231.272992578" watchObservedRunningTime="2026-06-15 06:29:38.977954218 +0000 UTC m=+231.273481494" Jun 15 06:29:39.324843 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.324763 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5"] Jun 15 06:29:39.338630 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.338598 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5"] Jun 15 06:29:39.338887 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.338743 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.340687 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.340663 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 15 06:29:39.340842 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.340710 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 15 06:29:39.340949 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.340931 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6kcwc\"" Jun 15 06:29:39.341365 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.341339 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 06:29:39.341515 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.341498 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 06:29:39.342171 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.341750 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 06:29:39.445295 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.445252 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bf8377c-ffe4-4266-b6d6-de0083afcc12-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.445525 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.445316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bf8377c-ffe4-4266-b6d6-de0083afcc12-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.445525 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.445370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bf8377c-ffe4-4266-b6d6-de0083afcc12-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.445525 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.445399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlgc2\" (UniqueName: \"kubernetes.io/projected/4bf8377c-ffe4-4266-b6d6-de0083afcc12-kube-api-access-vlgc2\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.545887 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.545819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bf8377c-ffe4-4266-b6d6-de0083afcc12-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.546079 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.545910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bf8377c-ffe4-4266-b6d6-de0083afcc12-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.546079 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.545969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bf8377c-ffe4-4266-b6d6-de0083afcc12-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.546079 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:39.545994 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 15 06:29:39.546079 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:29:39.546080 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bf8377c-ffe4-4266-b6d6-de0083afcc12-prometheus-operator-tls podName:4bf8377c-ffe4-4266-b6d6-de0083afcc12 nodeName:}" failed. No retries permitted until 2026-06-15 06:29:40.046063599 +0000 UTC m=+232.341590856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4bf8377c-ffe4-4266-b6d6-de0083afcc12-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-98wb5" (UID: "4bf8377c-ffe4-4266-b6d6-de0083afcc12") : secret "prometheus-operator-tls" not found Jun 15 06:29:39.546310 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.546207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlgc2\" (UniqueName: \"kubernetes.io/projected/4bf8377c-ffe4-4266-b6d6-de0083afcc12-kube-api-access-vlgc2\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.546742 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.546714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bf8377c-ffe4-4266-b6d6-de0083afcc12-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.548904 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.548859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bf8377c-ffe4-4266-b6d6-de0083afcc12-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:39.555966 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:39.555910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlgc2\" (UniqueName: \"kubernetes.io/projected/4bf8377c-ffe4-4266-b6d6-de0083afcc12-kube-api-access-vlgc2\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:40.051844 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:40.051605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bf8377c-ffe4-4266-b6d6-de0083afcc12-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:40.057366 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:40.057231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bf8377c-ffe4-4266-b6d6-de0083afcc12-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-98wb5\" (UID: \"4bf8377c-ffe4-4266-b6d6-de0083afcc12\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:40.253310 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:40.253272 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" Jun 15 06:29:40.469884 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:40.469833 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5"] Jun 15 06:29:41.563346 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:41.563313 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf8377c_ffe4_4266_b6d6_de0083afcc12.slice/crio-daad286695e539bd7b02f7fedb91ea2a56237374ad6f2cc9c49cb88e5d52b5e8 WatchSource:0}: Error finding container daad286695e539bd7b02f7fedb91ea2a56237374ad6f2cc9c49cb88e5d52b5e8: Status 404 returned error can't find the container with id daad286695e539bd7b02f7fedb91ea2a56237374ad6f2cc9c49cb88e5d52b5e8 Jun 15 06:29:41.979488 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:41.979396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" event={"ID":"4bf8377c-ffe4-4266-b6d6-de0083afcc12","Type":"ContainerStarted","Data":"daad286695e539bd7b02f7fedb91ea2a56237374ad6f2cc9c49cb88e5d52b5e8"} Jun 15 06:29:46.586955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.586917 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5884588dd5-jpqcv"] Jun 15 06:29:46.606275 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.606239 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5884588dd5-jpqcv"] Jun 15 06:29:46.606449 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.606385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.618028 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.617994 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 06:29:46.708436 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.708404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmnrw\" (UniqueName: \"kubernetes.io/projected/382f1290-f73a-42fd-8356-2778fa87c8ba-kube-api-access-fmnrw\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.708436 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.708441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-oauth-config\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.708675 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.708465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-service-ca\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.708675 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.708505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-oauth-serving-cert\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.708675 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.708533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-console-config\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.708675 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.708556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-serving-cert\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.708675 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.708581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-trusted-ca-bundle\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.809902 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.809845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-oauth-serving-cert\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.810092 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.809911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-console-config\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.810092 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.809938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-serving-cert\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.810092 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.809963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-trusted-ca-bundle\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.810092 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.810058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmnrw\" (UniqueName: \"kubernetes.io/projected/382f1290-f73a-42fd-8356-2778fa87c8ba-kube-api-access-fmnrw\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.810092 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.810090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-oauth-config\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.810358 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.810123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-service-ca\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.810744 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.810713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-oauth-serving-cert\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.810895 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.810769 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-console-config\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.810895 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.810854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-service-ca\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.811036 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.811014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-trusted-ca-bundle\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.813067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.813045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-oauth-config\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.813067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.813056 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-serving-cert\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.818057 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.818034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmnrw\" (UniqueName: \"kubernetes.io/projected/382f1290-f73a-42fd-8356-2778fa87c8ba-kube-api-access-fmnrw\") pod \"console-5884588dd5-jpqcv\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:46.918396 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:46.918301 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:48.658057 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:48.658022 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5884588dd5-jpqcv"] Jun 15 06:29:48.661447 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:48.661418 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382f1290_f73a_42fd_8356_2778fa87c8ba.slice/crio-85e21541dd8bb8b33dc35fad23fca59ae4e74e5abacf6c1fdbdde164d84bfb0c WatchSource:0}: Error finding container 85e21541dd8bb8b33dc35fad23fca59ae4e74e5abacf6c1fdbdde164d84bfb0c: Status 404 returned error can't find the container with id 85e21541dd8bb8b33dc35fad23fca59ae4e74e5abacf6c1fdbdde164d84bfb0c Jun 15 06:29:49.012338 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:49.012289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-945wd" event={"ID":"5e9d1f40-9f29-4723-9fa7-98f7bc8e22b3","Type":"ContainerStarted","Data":"edee78fa0810f56ebdd3874a651aa82cc43af7dc3cfa72ac986fca2cdde45b4c"} Jun 15 06:29:49.012536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:49.012467 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-945wd" Jun 15 06:29:49.014889 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:49.014702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5884588dd5-jpqcv" event={"ID":"382f1290-f73a-42fd-8356-2778fa87c8ba","Type":"ContainerStarted","Data":"b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0"} Jun 15 06:29:49.014889 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:49.014750 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5884588dd5-jpqcv" event={"ID":"382f1290-f73a-42fd-8356-2778fa87c8ba","Type":"ContainerStarted","Data":"85e21541dd8bb8b33dc35fad23fca59ae4e74e5abacf6c1fdbdde164d84bfb0c"} Jun 15 06:29:49.020771 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:49.018063 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fdf7c896-6xtdq" event={"ID":"742c1976-6cf0-4a9e-9596-6c310d682432","Type":"ContainerStarted","Data":"583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c"} Jun 15 06:29:49.028314 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:49.027579 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-945wd" podStartSLOduration=1.752649439 podStartE2EDuration="19.027561008s" totalImagesPullingTime="17.274911569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:49.026640961 +0000 UTC m=+241.322168238" watchObservedRunningTime="2026-06-15 06:29:49.027561008 +0000 UTC m=+241.323088287" Jun 15 06:29:49.032290 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:49.032099 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-945wd" Jun 15 06:29:49.045498 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:49.045431 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65fdf7c896-6xtdq" podStartSLOduration=1.407681247 podStartE2EDuration="12.045407706s" totalImagesPullingTime="10.637726459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:49.044361946 +0000 UTC m=+241.339889223" watchObservedRunningTime="2026-06-15 06:29:49.045407706 +0000 UTC m=+241.340934986" Jun 15 06:29:49.061036 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:49.060982 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5884588dd5-jpqcv" podStartSLOduration=3.060958045 podStartE2EDuration="3.060958045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:49.059554726 +0000 UTC m=+241.355082002" watchObservedRunningTime="2026-06-15 06:29:49.060958045 +0000 UTC m=+241.356485324" Jun 15 06:29:50.025495 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:50.025465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" event={"ID":"4bf8377c-ffe4-4266-b6d6-de0083afcc12","Type":"ContainerStarted","Data":"ab32a63f62be84c6a770df13f8158a77b2d1fd212104a00e3170fa0dbb0957fb"} Jun 15 06:29:51.032295 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:51.032249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" event={"ID":"4bf8377c-ffe4-4266-b6d6-de0083afcc12","Type":"ContainerStarted","Data":"fdd991f15b415a6ccdd113abca2c44fdc2827aa15fa27cd4a7e7448c346fca85"} Jun 15 06:29:51.048046 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:51.047976 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-98wb5" podStartSLOduration=3.7202597710000003 podStartE2EDuration="12.047955866s" totalImagesPullingTime="8.327696095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:51.046137921 +0000 UTC m=+243.341665208" watchObservedRunningTime="2026-06-15 06:29:51.047955866 +0000 UTC m=+243.343483141" Jun 15 06:29:52.689008 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.688963 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-98t7p"] Jun 15 06:29:52.712983 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.712951 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.715075 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.715047 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 06:29:52.715856 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.715830 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 06:29:52.716171 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.716154 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-77222\"" Jun 15 06:29:52.716574 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.716330 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 06:29:52.764252 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.764208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-tls\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.764454 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.764298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-textfile\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.764454 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.764326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.764454 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.764423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-wtmp\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.764638 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.764487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbc3078a-753e-4425-84ca-e7a4d38cffbe-sys\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.764638 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.764560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbc3078a-753e-4425-84ca-e7a4d38cffbe-metrics-client-ca\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.764638 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.764607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmvmm\" (UniqueName: \"kubernetes.io/projected/bbc3078a-753e-4425-84ca-e7a4d38cffbe-kube-api-access-bmvmm\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.764779 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.764638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bbc3078a-753e-4425-84ca-e7a4d38cffbe-root\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.764779 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.764662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-accelerators-collector-config\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.866437 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.866398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmvmm\" (UniqueName: \"kubernetes.io/projected/bbc3078a-753e-4425-84ca-e7a4d38cffbe-kube-api-access-bmvmm\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.866685 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.866667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bbc3078a-753e-4425-84ca-e7a4d38cffbe-root\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.866804 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.866789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-accelerators-collector-config\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.866940 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.866925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-tls\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.867077 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.867064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-textfile\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.867183 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.867170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.867304 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.867291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-wtmp\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.867426 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.867415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbc3078a-753e-4425-84ca-e7a4d38cffbe-sys\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.867546 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.867535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbc3078a-753e-4425-84ca-e7a4d38cffbe-metrics-client-ca\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.868350 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.868325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbc3078a-753e-4425-84ca-e7a4d38cffbe-metrics-client-ca\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.868928 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.868906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bbc3078a-753e-4425-84ca-e7a4d38cffbe-root\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.869529 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.869508 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-accelerators-collector-config\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.870644 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.870613 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbc3078a-753e-4425-84ca-e7a4d38cffbe-sys\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.870823 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.870796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-textfile\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.870907 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.870796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-wtmp\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.873173 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.873146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-tls\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.874393 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.874372 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbc3078a-753e-4425-84ca-e7a4d38cffbe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:52.877014 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:52.876990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmvmm\" (UniqueName: \"kubernetes.io/projected/bbc3078a-753e-4425-84ca-e7a4d38cffbe-kube-api-access-bmvmm\") pod \"node-exporter-98t7p\" (UID: \"bbc3078a-753e-4425-84ca-e7a4d38cffbe\") " pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:53.025629 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:53.025550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-98t7p" Jun 15 06:29:53.061187 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:53.061150 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc3078a_753e_4425_84ca_e7a4d38cffbe.slice/crio-9bedaec67c5c656b5dd3abdfad5ed51e1478b0e8ceb2d3ded67f6f391af13d77 WatchSource:0}: Error finding container 9bedaec67c5c656b5dd3abdfad5ed51e1478b0e8ceb2d3ded67f6f391af13d77: Status 404 returned error can't find the container with id 9bedaec67c5c656b5dd3abdfad5ed51e1478b0e8ceb2d3ded67f6f391af13d77 Jun 15 06:29:54.046386 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.046308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98t7p" event={"ID":"bbc3078a-753e-4425-84ca-e7a4d38cffbe","Type":"ContainerStarted","Data":"9bedaec67c5c656b5dd3abdfad5ed51e1478b0e8ceb2d3ded67f6f391af13d77"} Jun 15 06:29:54.633147 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.633114 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-865464b684-mdg64"] Jun 15 06:29:54.664174 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.664145 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-865464b684-mdg64"] Jun 15 06:29:54.664341 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.664235 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.666424 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.666394 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 15 06:29:54.666424 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.666433 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pmjsq\"" Jun 15 06:29:54.666644 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.666442 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 15 06:29:54.666990 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.666969 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 15 06:29:54.667244 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.667222 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 15 06:29:54.667430 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.667415 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 15 06:29:54.667819 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.667601 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fn0vl0bf16qps\"" Jun 15 06:29:54.786847 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.786811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.787054 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.786930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f774cc-855d-4724-80e6-2eb0c43f5a03-metrics-client-ca\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.787054 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.787033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cqjd\" (UniqueName: \"kubernetes.io/projected/e3f774cc-855d-4724-80e6-2eb0c43f5a03-kube-api-access-7cqjd\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.787169 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.787077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.787169 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.787142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-tls\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.787311 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.787290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.787368 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.787339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.787418 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.787379 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-grpc-tls\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.888384 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.888290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.888384 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.888344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-tls\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.888610 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.888426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.888610 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.888465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.888610 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.888484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-grpc-tls\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.888610 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.888535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.888610 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.888579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f774cc-855d-4724-80e6-2eb0c43f5a03-metrics-client-ca\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.888883 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.888626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqjd\" (UniqueName: \"kubernetes.io/projected/e3f774cc-855d-4724-80e6-2eb0c43f5a03-kube-api-access-7cqjd\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.889730 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.889672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f774cc-855d-4724-80e6-2eb0c43f5a03-metrics-client-ca\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.891498 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.891474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-tls\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.892359 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.891832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.892359 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.892314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.892506 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.892415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-grpc-tls\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.893692 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.893651 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.893822 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.893774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e3f774cc-855d-4724-80e6-2eb0c43f5a03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.895923 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.895899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cqjd\" (UniqueName: \"kubernetes.io/projected/e3f774cc-855d-4724-80e6-2eb0c43f5a03-kube-api-access-7cqjd\") pod \"thanos-querier-865464b684-mdg64\" (UID: \"e3f774cc-855d-4724-80e6-2eb0c43f5a03\") " pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:54.976714 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:54.976673 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:29:55.057679 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:55.057143 2576 generic.go:356] "Generic (PLEG): container finished" podID="bbc3078a-753e-4425-84ca-e7a4d38cffbe" containerID="efecb8966d1a1dc23f4f045ead7e079e4d82873e1e518a9c0cd5399a33a587fd" exitCode=0 Jun 15 06:29:55.057679 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:55.057195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98t7p" event={"ID":"bbc3078a-753e-4425-84ca-e7a4d38cffbe","Type":"ContainerDied","Data":"efecb8966d1a1dc23f4f045ead7e079e4d82873e1e518a9c0cd5399a33a587fd"} Jun 15 06:29:55.156705 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:55.156673 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-865464b684-mdg64"] Jun 15 06:29:55.159287 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:29:55.159259 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f774cc_855d_4724_80e6_2eb0c43f5a03.slice/crio-ba6ab4720ea8db65897fb88f1255e3ee0bdf90af8c2629d3c2cbb324942974d7 WatchSource:0}: Error finding container ba6ab4720ea8db65897fb88f1255e3ee0bdf90af8c2629d3c2cbb324942974d7: Status 404 returned error can't find the container with id ba6ab4720ea8db65897fb88f1255e3ee0bdf90af8c2629d3c2cbb324942974d7 Jun 15 06:29:56.064124 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:56.064076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" event={"ID":"e3f774cc-855d-4724-80e6-2eb0c43f5a03","Type":"ContainerStarted","Data":"ba6ab4720ea8db65897fb88f1255e3ee0bdf90af8c2629d3c2cbb324942974d7"} Jun 15 06:29:56.067945 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:56.067913 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98t7p" event={"ID":"bbc3078a-753e-4425-84ca-e7a4d38cffbe","Type":"ContainerStarted","Data":"3dbd3ca603fe6d49ea30e701fc16efa7844b8ff04fa7f344e2663d2ae4663acc"} Jun 15 06:29:56.068122 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:56.067970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98t7p" event={"ID":"bbc3078a-753e-4425-84ca-e7a4d38cffbe","Type":"ContainerStarted","Data":"1625d705919b479bcd4dddeb7eb2911d839e9e7d3e88b9a0a37a4f1272033813"} Jun 15 06:29:56.085396 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:56.085326 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-98t7p" podStartSLOduration=2.465216658 podStartE2EDuration="4.085309689s" totalImagesPullingTime="1.521341057s" totalInitContainerRuntime="98.751974ms" isStatefulPod=true podCreationTimestamp="2026-06-15 06:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:29:56.083078773 +0000 UTC m=+248.378606048" watchObservedRunningTime="2026-06-15 06:29:56.085309689 +0000 UTC m=+248.380836964" Jun 15 06:29:56.918904 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:56.918845 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:56.919126 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:56.918938 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:29:56.921209 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:56.920399 2576 patch_prober.go:28] interesting pod/console-5884588dd5-jpqcv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jun 15 06:29:56.921209 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:56.920472 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5884588dd5-jpqcv" podUID="382f1290-f73a-42fd-8356-2778fa87c8ba" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jun 15 06:29:57.716215 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:57.716178 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:57.716700 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:57.716273 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:29:57.717827 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:57.717802 2576 patch_prober.go:28] interesting pod/console-65fdf7c896-6xtdq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 15 06:29:57.717995 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:57.717842 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65fdf7c896-6xtdq" podUID="742c1976-6cf0-4a9e-9596-6c310d682432" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 15 06:29:58.005369 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:58.005343 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65fdf7c896-6xtdq"] Jun 15 06:29:58.077586 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:58.077552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" event={"ID":"e3f774cc-855d-4724-80e6-2eb0c43f5a03","Type":"ContainerStarted","Data":"43017f08fad595256c20c260208f66e0064f0e7a1f16353f252a68348fbd0316"} Jun 15 06:29:58.077766 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:58.077617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" event={"ID":"e3f774cc-855d-4724-80e6-2eb0c43f5a03","Type":"ContainerStarted","Data":"dc508d5abd367cb901686a7ca49f9433ce5c3faa013d3980170ff008a45133d1"} Jun 15 06:29:58.077766 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:29:58.077645 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" event={"ID":"e3f774cc-855d-4724-80e6-2eb0c43f5a03","Type":"ContainerStarted","Data":"0998961a52cbd6c23edcfe4545bee865a8778c640601dd7f3754cdcb12569f2a"} Jun 15 06:30:00.044893 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:00.044808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:30:00.047277 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:00.047244 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a53739e-5156-4475-b741-e13c84564d26-metrics-certs\") pod \"network-metrics-daemon-77v27\" (UID: \"7a53739e-5156-4475-b741-e13c84564d26\") " pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:30:00.094791 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:00.094755 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" event={"ID":"e3f774cc-855d-4724-80e6-2eb0c43f5a03","Type":"ContainerStarted","Data":"a3fb862376f1989aebcfa1febbc319d22692a85098553f277668af03ba099fc0"} Jun 15 06:30:00.095005 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:00.094842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" event={"ID":"e3f774cc-855d-4724-80e6-2eb0c43f5a03","Type":"ContainerStarted","Data":"daec6789cb216fa2bc6bb65cd97e2181e7ca8936e80aca74b16c8d4276301431"} Jun 15 06:30:00.095005 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:00.094893 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" event={"ID":"e3f774cc-855d-4724-80e6-2eb0c43f5a03","Type":"ContainerStarted","Data":"f8d56532121ea899a600f4870047d45a82b381a76578fd2139f251d0596fb2bf"} Jun 15 06:30:00.095005 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:00.094932 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:30:00.114983 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:00.114932 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" podStartSLOduration=2.484951146 podStartE2EDuration="6.114916685s" totalImagesPullingTime="3.629965539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:29:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:30:00.113995781 +0000 UTC m=+252.409523060" watchObservedRunningTime="2026-06-15 06:30:00.114916685 +0000 UTC m=+252.410443989" Jun 15 06:30:00.138113 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:00.138079 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv827\"" Jun 15 06:30:00.146475 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:00.146449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77v27" Jun 15 06:30:00.293786 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:00.293551 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-77v27"] Jun 15 06:30:00.296172 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:30:00.296111 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a53739e_5156_4475_b741_e13c84564d26.slice/crio-575886a98fbd9112b4e4c512ff5b0ac3147ba9a0d28f9dc0f9ca02314a0bf9ed WatchSource:0}: Error finding container 575886a98fbd9112b4e4c512ff5b0ac3147ba9a0d28f9dc0f9ca02314a0bf9ed: Status 404 returned error can't find the container with id 575886a98fbd9112b4e4c512ff5b0ac3147ba9a0d28f9dc0f9ca02314a0bf9ed Jun 15 06:30:01.100189 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.100147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77v27" event={"ID":"7a53739e-5156-4475-b741-e13c84564d26","Type":"ContainerStarted","Data":"575886a98fbd9112b4e4c512ff5b0ac3147ba9a0d28f9dc0f9ca02314a0bf9ed"} Jun 15 06:30:01.203447 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.203410 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5884588dd5-jpqcv"] Jun 15 06:30:01.234205 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.234169 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-95f88d64f-sthh7"] Jun 15 06:30:01.248214 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.248183 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95f88d64f-sthh7"] Jun 15 06:30:01.248366 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.248336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.354812 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.354707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-oauth-serving-cert\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.355018 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.354818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-oauth-config\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.355018 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.354923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-config\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.355018 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.354975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-trusted-ca-bundle\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.355018 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.355015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-service-ca\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.355240 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.355115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-serving-cert\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.355240 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.355160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g5b2\" (UniqueName: \"kubernetes.io/projected/877121d9-942b-4db5-81fb-fd0d76e3f18d-kube-api-access-6g5b2\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.456419 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.456377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-oauth-config\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.456618 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.456431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-config\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.456618 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.456459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-trusted-ca-bundle\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.456618 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.456492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-service-ca\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.456618 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.456544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-serving-cert\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.456618 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.456578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5b2\" (UniqueName: \"kubernetes.io/projected/877121d9-942b-4db5-81fb-fd0d76e3f18d-kube-api-access-6g5b2\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.456618 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.456606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-oauth-serving-cert\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.457343 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.457319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-service-ca\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.457504 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.457483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-config\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.457504 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.457493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-oauth-serving-cert\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.457584 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.457483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-trusted-ca-bundle\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.458967 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.458942 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-oauth-config\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.459172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.459155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-serving-cert\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.464934 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.464910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g5b2\" (UniqueName: \"kubernetes.io/projected/877121d9-942b-4db5-81fb-fd0d76e3f18d-kube-api-access-6g5b2\") pod \"console-95f88d64f-sthh7\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.561059 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.561010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:01.856510 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:01.856418 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95f88d64f-sthh7"] Jun 15 06:30:01.859976 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:30:01.859947 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877121d9_942b_4db5_81fb_fd0d76e3f18d.slice/crio-b681d3d796411b3a9e563f9d18307c420b77a45a7434665559e9e01034cf9560 WatchSource:0}: Error finding container b681d3d796411b3a9e563f9d18307c420b77a45a7434665559e9e01034cf9560: Status 404 returned error can't find the container with id b681d3d796411b3a9e563f9d18307c420b77a45a7434665559e9e01034cf9560 Jun 15 06:30:02.110451 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:02.110412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77v27" event={"ID":"7a53739e-5156-4475-b741-e13c84564d26","Type":"ContainerStarted","Data":"3c8e7bb7269a9f823aea75a2e2ed8dbb29ba6d6343808e12bafa131d6e41aa15"} Jun 15 06:30:02.110992 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:02.110470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77v27" event={"ID":"7a53739e-5156-4475-b741-e13c84564d26","Type":"ContainerStarted","Data":"599b622d033d95d253cb867ef18f0aa9f2c63509fcfe2843c801f2331c4f4323"} Jun 15 06:30:02.112201 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:02.112175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95f88d64f-sthh7" event={"ID":"877121d9-942b-4db5-81fb-fd0d76e3f18d","Type":"ContainerStarted","Data":"62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a"} Jun 15 06:30:02.112320 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:02.112219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95f88d64f-sthh7" event={"ID":"877121d9-942b-4db5-81fb-fd0d76e3f18d","Type":"ContainerStarted","Data":"b681d3d796411b3a9e563f9d18307c420b77a45a7434665559e9e01034cf9560"} Jun 15 06:30:02.124299 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:02.124245 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-77v27" podStartSLOduration=252.699264649 podStartE2EDuration="4m14.124229382s" totalImagesPullingTime="1.424964733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:30:02.123938873 +0000 UTC m=+254.419466149" watchObservedRunningTime="2026-06-15 06:30:02.124229382 +0000 UTC m=+254.419756635" Jun 15 06:30:02.141540 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:02.141468 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-95f88d64f-sthh7" podStartSLOduration=1.141444686 podStartE2EDuration="1.141444686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:30:02.140593621 +0000 UTC m=+254.436120899" watchObservedRunningTime="2026-06-15 06:30:02.141444686 +0000 UTC m=+254.436971965" Jun 15 06:30:06.106270 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:06.106241 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-865464b684-mdg64" Jun 15 06:30:11.561519 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:11.561466 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:11.561519 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:11.561538 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:11.562930 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:11.562902 2576 patch_prober.go:28] interesting pod/console-95f88d64f-sthh7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 15 06:30:11.563032 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:11.562949 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-95f88d64f-sthh7" podUID="877121d9-942b-4db5-81fb-fd0d76e3f18d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 15 06:30:21.565880 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:21.565833 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:21.570189 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:21.570162 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:30:24.106797 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.106759 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65fdf7c896-6xtdq" podUID="742c1976-6cf0-4a9e-9596-6c310d682432" containerName="console" containerID="cri-o://583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c" gracePeriod=15 Jun 15 06:30:24.377968 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.377885 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:30:24.465601 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.465570 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-service-ca\") pod \"742c1976-6cf0-4a9e-9596-6c310d682432\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " Jun 15 06:30:24.465796 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.465629 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-serving-cert\") pod \"742c1976-6cf0-4a9e-9596-6c310d682432\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " Jun 15 06:30:24.465796 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.465660 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-console-config\") pod \"742c1976-6cf0-4a9e-9596-6c310d682432\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " Jun 15 06:30:24.465796 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.465678 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-oauth-serving-cert\") pod \"742c1976-6cf0-4a9e-9596-6c310d682432\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " Jun 15 06:30:24.465796 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.465713 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdl7z\" (UniqueName: \"kubernetes.io/projected/742c1976-6cf0-4a9e-9596-6c310d682432-kube-api-access-qdl7z\") pod \"742c1976-6cf0-4a9e-9596-6c310d682432\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " Jun 15 06:30:24.465796 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.465738 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-oauth-config\") pod \"742c1976-6cf0-4a9e-9596-6c310d682432\" (UID: \"742c1976-6cf0-4a9e-9596-6c310d682432\") " Jun 15 06:30:24.466089 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.466044 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-service-ca" (OuterVolumeSpecName: "service-ca") pod "742c1976-6cf0-4a9e-9596-6c310d682432" (UID: "742c1976-6cf0-4a9e-9596-6c310d682432"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:30:24.466138 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.466105 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "742c1976-6cf0-4a9e-9596-6c310d682432" (UID: "742c1976-6cf0-4a9e-9596-6c310d682432"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:30:24.466138 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.466118 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-console-config" (OuterVolumeSpecName: "console-config") pod "742c1976-6cf0-4a9e-9596-6c310d682432" (UID: "742c1976-6cf0-4a9e-9596-6c310d682432"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:30:24.468039 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.468014 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "742c1976-6cf0-4a9e-9596-6c310d682432" (UID: "742c1976-6cf0-4a9e-9596-6c310d682432"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:30:24.468151 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.468054 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "742c1976-6cf0-4a9e-9596-6c310d682432" (UID: "742c1976-6cf0-4a9e-9596-6c310d682432"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:30:24.468151 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.468132 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/742c1976-6cf0-4a9e-9596-6c310d682432-kube-api-access-qdl7z" (OuterVolumeSpecName: "kube-api-access-qdl7z") pod "742c1976-6cf0-4a9e-9596-6c310d682432" (UID: "742c1976-6cf0-4a9e-9596-6c310d682432"). InnerVolumeSpecName "kube-api-access-qdl7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:30:24.567166 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.567125 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-serving-cert\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:24.567166 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.567159 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-console-config\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:24.567166 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.567172 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-oauth-serving-cert\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:24.567404 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.567184 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdl7z\" (UniqueName: \"kubernetes.io/projected/742c1976-6cf0-4a9e-9596-6c310d682432-kube-api-access-qdl7z\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:24.567404 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.567196 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/742c1976-6cf0-4a9e-9596-6c310d682432-console-oauth-config\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:24.567404 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:24.567207 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/742c1976-6cf0-4a9e-9596-6c310d682432-service-ca\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:25.199492 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:25.199458 2576 generic.go:356] "Generic (PLEG): container finished" podID="742c1976-6cf0-4a9e-9596-6c310d682432" containerID="583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c" exitCode=0 Jun 15 06:30:25.199958 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:25.199508 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fdf7c896-6xtdq" Jun 15 06:30:25.199958 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:25.199547 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fdf7c896-6xtdq" event={"ID":"742c1976-6cf0-4a9e-9596-6c310d682432","Type":"ContainerDied","Data":"583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c"} Jun 15 06:30:25.199958 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:25.199602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fdf7c896-6xtdq" event={"ID":"742c1976-6cf0-4a9e-9596-6c310d682432","Type":"ContainerDied","Data":"a9ae589f106cec443a6fb02c9720203bb13c3761d785fb56de84eda8a4d0e8b7"} Jun 15 06:30:25.199958 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:25.199624 2576 scope.go:117] "RemoveContainer" containerID="583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c" Jun 15 06:30:25.208448 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:25.208432 2576 scope.go:117] "RemoveContainer" containerID="583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c" Jun 15 06:30:25.208724 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:30:25.208701 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c\": container with ID starting with 583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c not found: ID does not exist" containerID="583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c" Jun 15 06:30:25.208793 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:25.208740 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c"} err="failed to get container status \"583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c\": rpc error: code = NotFound desc = could not find container \"583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c\": container with ID starting with 583d9d0eee48f409148d1f10e7fd78e68934af9bca4c1976f98a2a347673763c not found: ID does not exist" Jun 15 06:30:25.223006 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:25.218732 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65fdf7c896-6xtdq"] Jun 15 06:30:25.224836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:25.224813 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65fdf7c896-6xtdq"] Jun 15 06:30:26.141965 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.141929 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="742c1976-6cf0-4a9e-9596-6c310d682432" path="/var/lib/kubelet/pods/742c1976-6cf0-4a9e-9596-6c310d682432/volumes" Jun 15 06:30:26.225706 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.225664 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5884588dd5-jpqcv" podUID="382f1290-f73a-42fd-8356-2778fa87c8ba" containerName="console" containerID="cri-o://b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0" gracePeriod=15 Jun 15 06:30:26.537342 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.537309 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:30:26.582890 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.582842 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-trusted-ca-bundle\") pod \"382f1290-f73a-42fd-8356-2778fa87c8ba\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " Jun 15 06:30:26.583057 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.582914 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-serving-cert\") pod \"382f1290-f73a-42fd-8356-2778fa87c8ba\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " Jun 15 06:30:26.583057 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.582949 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-oauth-config\") pod \"382f1290-f73a-42fd-8356-2778fa87c8ba\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " Jun 15 06:30:26.583057 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.582978 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-console-config\") pod \"382f1290-f73a-42fd-8356-2778fa87c8ba\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " Jun 15 06:30:26.583057 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.583039 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmnrw\" (UniqueName: \"kubernetes.io/projected/382f1290-f73a-42fd-8356-2778fa87c8ba-kube-api-access-fmnrw\") pod \"382f1290-f73a-42fd-8356-2778fa87c8ba\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " Jun 15 06:30:26.583215 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.583072 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-service-ca\") pod \"382f1290-f73a-42fd-8356-2778fa87c8ba\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " Jun 15 06:30:26.583215 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.583136 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-oauth-serving-cert\") pod \"382f1290-f73a-42fd-8356-2778fa87c8ba\" (UID: \"382f1290-f73a-42fd-8356-2778fa87c8ba\") " Jun 15 06:30:26.583329 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.583297 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "382f1290-f73a-42fd-8356-2778fa87c8ba" (UID: "382f1290-f73a-42fd-8356-2778fa87c8ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:30:26.583442 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.583415 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-trusted-ca-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:26.583536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.583508 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "382f1290-f73a-42fd-8356-2778fa87c8ba" (UID: "382f1290-f73a-42fd-8356-2778fa87c8ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:30:26.583591 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.583542 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "382f1290-f73a-42fd-8356-2778fa87c8ba" (UID: "382f1290-f73a-42fd-8356-2778fa87c8ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:30:26.583681 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.583663 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-console-config" (OuterVolumeSpecName: "console-config") pod "382f1290-f73a-42fd-8356-2778fa87c8ba" (UID: "382f1290-f73a-42fd-8356-2778fa87c8ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:30:26.585151 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.585129 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "382f1290-f73a-42fd-8356-2778fa87c8ba" (UID: "382f1290-f73a-42fd-8356-2778fa87c8ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:30:26.585618 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.585602 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "382f1290-f73a-42fd-8356-2778fa87c8ba" (UID: "382f1290-f73a-42fd-8356-2778fa87c8ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:30:26.585664 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.585627 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/382f1290-f73a-42fd-8356-2778fa87c8ba-kube-api-access-fmnrw" (OuterVolumeSpecName: "kube-api-access-fmnrw") pod "382f1290-f73a-42fd-8356-2778fa87c8ba" (UID: "382f1290-f73a-42fd-8356-2778fa87c8ba"). InnerVolumeSpecName "kube-api-access-fmnrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:30:26.684927 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.684816 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-oauth-serving-cert\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:26.684927 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.684845 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-serving-cert\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:26.684927 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.684855 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382f1290-f73a-42fd-8356-2778fa87c8ba-console-oauth-config\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:26.684927 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.684888 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-console-config\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:26.684927 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.684897 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmnrw\" (UniqueName: \"kubernetes.io/projected/382f1290-f73a-42fd-8356-2778fa87c8ba-kube-api-access-fmnrw\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:26.684927 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:26.684906 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382f1290-f73a-42fd-8356-2778fa87c8ba-service-ca\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:30:27.210977 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.210944 2576 generic.go:356] "Generic (PLEG): container finished" podID="382f1290-f73a-42fd-8356-2778fa87c8ba" containerID="b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0" exitCode=0 Jun 15 06:30:27.211172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.210996 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5884588dd5-jpqcv" Jun 15 06:30:27.211172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.211033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5884588dd5-jpqcv" event={"ID":"382f1290-f73a-42fd-8356-2778fa87c8ba","Type":"ContainerDied","Data":"b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0"} Jun 15 06:30:27.211172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.211101 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5884588dd5-jpqcv" event={"ID":"382f1290-f73a-42fd-8356-2778fa87c8ba","Type":"ContainerDied","Data":"85e21541dd8bb8b33dc35fad23fca59ae4e74e5abacf6c1fdbdde164d84bfb0c"} Jun 15 06:30:27.211172 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.211132 2576 scope.go:117] "RemoveContainer" containerID="b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0" Jun 15 06:30:27.212575 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.212554 2576 generic.go:356] "Generic (PLEG): container finished" podID="171a15a6-9d97-4ff2-ba21-d81a93a93cdb" containerID="fb0cc755245494bc1e099f34331d4a295d40b2b7fac3442ed6fb4d3037f9e8b1" exitCode=0 Jun 15 06:30:27.212693 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.212631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" event={"ID":"171a15a6-9d97-4ff2-ba21-d81a93a93cdb","Type":"ContainerDied","Data":"fb0cc755245494bc1e099f34331d4a295d40b2b7fac3442ed6fb4d3037f9e8b1"} Jun 15 06:30:27.212950 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.212933 2576 scope.go:117] "RemoveContainer" containerID="fb0cc755245494bc1e099f34331d4a295d40b2b7fac3442ed6fb4d3037f9e8b1" Jun 15 06:30:27.220316 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.220300 2576 scope.go:117] "RemoveContainer" containerID="b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0" Jun 15 06:30:27.220601 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:30:27.220580 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0\": container with ID starting with b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0 not found: ID does not exist" containerID="b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0" Jun 15 06:30:27.220721 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.220607 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0"} err="failed to get container status \"b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0\": rpc error: code = NotFound desc = could not find container \"b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0\": container with ID starting with b873cdc1299abc4a913228afddef2c5ef2980cc59849a8147278f939bf7ee5d0 not found: ID does not exist" Jun 15 06:30:27.256545 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.256517 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5884588dd5-jpqcv"] Jun 15 06:30:27.267147 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:27.267120 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5884588dd5-jpqcv"] Jun 15 06:30:28.141469 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:28.141436 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="382f1290-f73a-42fd-8356-2778fa87c8ba" path="/var/lib/kubelet/pods/382f1290-f73a-42fd-8356-2778fa87c8ba/volumes" Jun 15 06:30:28.219362 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:28.219330 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-4pvgp" event={"ID":"171a15a6-9d97-4ff2-ba21-d81a93a93cdb","Type":"ContainerStarted","Data":"5cdc0fa14ac2d2dd9af50b12dbc65ef5dea1c00306d539d8d5001b91506e9835"} Jun 15 06:30:28.712063 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:30:28.712023 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-grmt5" podUID="569583f2-a93b-4cfe-84b2-33896cfb27b2" Jun 15 06:30:29.222814 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:29.222779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-grmt5" Jun 15 06:30:31.231840 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:31.231810 2576 generic.go:356] "Generic (PLEG): container finished" podID="79bbe5ab-1776-47bb-bfa1-6704f115928e" containerID="05796c1b2db81f155ad91a67861f8d6fab83aa75f18818fd20a66198a8006b52" exitCode=0 Jun 15 06:30:31.232287 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:31.231904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" event={"ID":"79bbe5ab-1776-47bb-bfa1-6704f115928e","Type":"ContainerDied","Data":"05796c1b2db81f155ad91a67861f8d6fab83aa75f18818fd20a66198a8006b52"} Jun 15 06:30:31.232287 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:31.232204 2576 scope.go:117] "RemoveContainer" containerID="05796c1b2db81f155ad91a67861f8d6fab83aa75f18818fd20a66198a8006b52" Jun 15 06:30:32.237941 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:32.237903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-p78v9" event={"ID":"79bbe5ab-1776-47bb-bfa1-6704f115928e","Type":"ContainerStarted","Data":"41c1bc3fc5b622776f6c27e7099e7050baf17aa3e3d9f246da411a4b143171ff"} Jun 15 06:30:32.535536 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:32.535451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:30:32.537785 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:32.537742 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/569583f2-a93b-4cfe-84b2-33896cfb27b2-metrics-tls\") pod \"dns-default-grmt5\" (UID: \"569583f2-a93b-4cfe-84b2-33896cfb27b2\") " pod="openshift-dns/dns-default-grmt5" Jun 15 06:30:32.825559 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:32.825521 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4w8v\"" Jun 15 06:30:32.834314 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:32.834278 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-grmt5" Jun 15 06:30:32.984565 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:32.984541 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-grmt5"] Jun 15 06:30:32.987064 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:30:32.987019 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569583f2_a93b_4cfe_84b2_33896cfb27b2.slice/crio-99545ffa61a7025cb6278aede2343bbf7bda39da8d293ab83fca1ebe757fa775 WatchSource:0}: Error finding container 99545ffa61a7025cb6278aede2343bbf7bda39da8d293ab83fca1ebe757fa775: Status 404 returned error can't find the container with id 99545ffa61a7025cb6278aede2343bbf7bda39da8d293ab83fca1ebe757fa775 Jun 15 06:30:33.242963 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:33.242879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-grmt5" event={"ID":"569583f2-a93b-4cfe-84b2-33896cfb27b2","Type":"ContainerStarted","Data":"99545ffa61a7025cb6278aede2343bbf7bda39da8d293ab83fca1ebe757fa775"} Jun 15 06:30:35.253382 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:35.253354 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-grmt5" event={"ID":"569583f2-a93b-4cfe-84b2-33896cfb27b2","Type":"ContainerStarted","Data":"db6ba5e40562079a2c9f6f0d369c03ac0603be21428d68604f34f936f564656a"} Jun 15 06:30:36.260915 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:36.260880 2576 generic.go:356] "Generic (PLEG): container finished" podID="f90f885d-a57e-4f6b-aad4-1c83c98d06ce" containerID="4349ff457f73baa6ead6a4d1be538b6453c7db1e7e763f2ce119666f0af5cfcf" exitCode=0 Jun 15 06:30:36.261338 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:36.260937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" event={"ID":"f90f885d-a57e-4f6b-aad4-1c83c98d06ce","Type":"ContainerDied","Data":"4349ff457f73baa6ead6a4d1be538b6453c7db1e7e763f2ce119666f0af5cfcf"} Jun 15 06:30:36.261338 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:36.261322 2576 scope.go:117] "RemoveContainer" containerID="4349ff457f73baa6ead6a4d1be538b6453c7db1e7e763f2ce119666f0af5cfcf" Jun 15 06:30:36.262718 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:36.262636 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-grmt5" event={"ID":"569583f2-a93b-4cfe-84b2-33896cfb27b2","Type":"ContainerStarted","Data":"88eddf535067d6fd4e053a080d9bb7a3583dd28bf9c846caf75ef145a4481ab4"} Jun 15 06:30:36.262773 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:36.262759 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-grmt5" Jun 15 06:30:36.298361 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:36.298300 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-grmt5" podStartSLOduration=252.25868345 podStartE2EDuration="4m14.298278238s" totalImagesPullingTime="2.039594788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:30:36.297079722 +0000 UTC m=+288.592606998" watchObservedRunningTime="2026-06-15 06:30:36.298278238 +0000 UTC m=+288.593805515" Jun 15 06:30:36.864170 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:36.864137 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-grmt5_569583f2-a93b-4cfe-84b2-33896cfb27b2/dns/0.log" Jun 15 06:30:37.061666 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:37.061637 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-grmt5_569583f2-a93b-4cfe-84b2-33896cfb27b2/kube-rbac-proxy/0.log" Jun 15 06:30:37.268939 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:37.268834 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-bpkcx" event={"ID":"f90f885d-a57e-4f6b-aad4-1c83c98d06ce","Type":"ContainerStarted","Data":"08ac43af52285b9363212e0cf1c27929d1de6924a98ffc30b4eb464a22d7fb9c"} Jun 15 06:30:38.464212 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:38.464185 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rjxcq_1193db8a-f0f2-4f9f-8eef-fd4f79f8b088/dns-node-resolver/0.log" Jun 15 06:30:38.663372 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:38.663335 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ffcd796f6-fff9z_e9504a48-d19f-4e36-bd5e-977e2e91be54/router/0.log" Jun 15 06:30:39.061897 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:39.061839 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pgbtz_4d5138e6-62ab-4f06-a188-6bc66ed14d7f/serve-healthcheck-canary/0.log" Jun 15 06:30:46.271369 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:46.271341 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-grmt5" Jun 15 06:30:48.094151 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:48.094109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:30:48.094508 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:48.094279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:30:48.097743 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:30:48.097726 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 06:31:15.089104 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.089063 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55d9864dfc-nw9k4"] Jun 15 06:31:15.090897 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.089516 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="382f1290-f73a-42fd-8356-2778fa87c8ba" containerName="console" Jun 15 06:31:15.090897 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.089535 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="382f1290-f73a-42fd-8356-2778fa87c8ba" containerName="console" Jun 15 06:31:15.090897 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.089549 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="742c1976-6cf0-4a9e-9596-6c310d682432" containerName="console" Jun 15 06:31:15.090897 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.089558 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="742c1976-6cf0-4a9e-9596-6c310d682432" containerName="console" Jun 15 06:31:15.090897 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.089609 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="382f1290-f73a-42fd-8356-2778fa87c8ba" containerName="console" Jun 15 06:31:15.090897 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.089619 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="742c1976-6cf0-4a9e-9596-6c310d682432" containerName="console" Jun 15 06:31:15.091390 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.091372 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.104816 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.104785 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d9864dfc-nw9k4"] Jun 15 06:31:15.288804 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.288743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-service-ca\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.289032 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.288863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-serving-cert\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.289032 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.288966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kfnx\" (UniqueName: \"kubernetes.io/projected/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-kube-api-access-2kfnx\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.289032 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.289018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-trusted-ca-bundle\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.289195 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.289075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-oauth-config\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.289195 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.289102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-config\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.289195 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.289142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-oauth-serving-cert\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.389577 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.389474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kfnx\" (UniqueName: \"kubernetes.io/projected/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-kube-api-access-2kfnx\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.389577 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.389522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-trusted-ca-bundle\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.389577 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.389554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-oauth-config\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.389577 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.389571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-config\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.389994 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.389597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-oauth-serving-cert\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.389994 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.389616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-service-ca\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.389994 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.389650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-serving-cert\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.390502 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.390476 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-config\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.390616 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.390544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-oauth-serving-cert\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.390670 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.390610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-service-ca\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.390706 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.390677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-trusted-ca-bundle\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.392609 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.392584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-oauth-config\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.392714 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.392698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-serving-cert\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.396491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.396468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kfnx\" (UniqueName: \"kubernetes.io/projected/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-kube-api-access-2kfnx\") pod \"console-55d9864dfc-nw9k4\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.401200 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.401177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:15.528419 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:15.528384 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d9864dfc-nw9k4"] Jun 15 06:31:15.531508 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:31:15.531483 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ced15f_607a_4188_b07c_0a1bdf1fdce5.slice/crio-d21f760322d4f70a8a3b08eeefe3f7271f8f415523bd20a310587f53e0a807f8 WatchSource:0}: Error finding container d21f760322d4f70a8a3b08eeefe3f7271f8f415523bd20a310587f53e0a807f8: Status 404 returned error can't find the container with id d21f760322d4f70a8a3b08eeefe3f7271f8f415523bd20a310587f53e0a807f8 Jun 15 06:31:16.424067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:16.424031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d9864dfc-nw9k4" event={"ID":"f8ced15f-607a-4188-b07c-0a1bdf1fdce5","Type":"ContainerStarted","Data":"492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59"} Jun 15 06:31:16.424511 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:16.424081 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d9864dfc-nw9k4" event={"ID":"f8ced15f-607a-4188-b07c-0a1bdf1fdce5","Type":"ContainerStarted","Data":"d21f760322d4f70a8a3b08eeefe3f7271f8f415523bd20a310587f53e0a807f8"} Jun 15 06:31:16.439507 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:16.439446 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55d9864dfc-nw9k4" podStartSLOduration=1.4394251630000001 podStartE2EDuration="1.439425163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:31:16.43927896 +0000 UTC m=+328.734806237" watchObservedRunningTime="2026-06-15 06:31:16.439425163 +0000 UTC m=+328.734952443" Jun 15 06:31:25.402134 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:25.402091 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:25.402561 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:25.402163 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:25.406958 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:25.406936 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:25.463713 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:25.463685 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:31:25.510051 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:25.505906 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95f88d64f-sthh7"] Jun 15 06:31:50.540143 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.540056 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-95f88d64f-sthh7" podUID="877121d9-942b-4db5-81fb-fd0d76e3f18d" containerName="console" containerID="cri-o://62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a" gracePeriod=15 Jun 15 06:31:50.792953 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.792850 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:31:50.859043 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859000 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-oauth-serving-cert\") pod \"877121d9-942b-4db5-81fb-fd0d76e3f18d\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " Jun 15 06:31:50.859043 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859048 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-service-ca\") pod \"877121d9-942b-4db5-81fb-fd0d76e3f18d\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " Jun 15 06:31:50.859246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859068 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-trusted-ca-bundle\") pod \"877121d9-942b-4db5-81fb-fd0d76e3f18d\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " Jun 15 06:31:50.859246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859093 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g5b2\" (UniqueName: \"kubernetes.io/projected/877121d9-942b-4db5-81fb-fd0d76e3f18d-kube-api-access-6g5b2\") pod \"877121d9-942b-4db5-81fb-fd0d76e3f18d\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " Jun 15 06:31:50.859387 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859268 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-config\") pod \"877121d9-942b-4db5-81fb-fd0d76e3f18d\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " Jun 15 06:31:50.859387 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859320 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-serving-cert\") pod \"877121d9-942b-4db5-81fb-fd0d76e3f18d\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " Jun 15 06:31:50.859499 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859415 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-oauth-config\") pod \"877121d9-942b-4db5-81fb-fd0d76e3f18d\" (UID: \"877121d9-942b-4db5-81fb-fd0d76e3f18d\") " Jun 15 06:31:50.859499 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859481 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "877121d9-942b-4db5-81fb-fd0d76e3f18d" (UID: "877121d9-942b-4db5-81fb-fd0d76e3f18d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:31:50.859635 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859609 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "877121d9-942b-4db5-81fb-fd0d76e3f18d" (UID: "877121d9-942b-4db5-81fb-fd0d76e3f18d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:31:50.859699 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859635 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-service-ca" (OuterVolumeSpecName: "service-ca") pod "877121d9-942b-4db5-81fb-fd0d76e3f18d" (UID: "877121d9-942b-4db5-81fb-fd0d76e3f18d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:31:50.859699 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859680 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-config" (OuterVolumeSpecName: "console-config") pod "877121d9-942b-4db5-81fb-fd0d76e3f18d" (UID: "877121d9-942b-4db5-81fb-fd0d76e3f18d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:31:50.859771 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859732 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-trusted-ca-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:31:50.859771 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859748 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-oauth-serving-cert\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:31:50.859771 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.859761 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-service-ca\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:31:50.861286 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.861256 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/877121d9-942b-4db5-81fb-fd0d76e3f18d-kube-api-access-6g5b2" (OuterVolumeSpecName: "kube-api-access-6g5b2") pod "877121d9-942b-4db5-81fb-fd0d76e3f18d" (UID: "877121d9-942b-4db5-81fb-fd0d76e3f18d"). InnerVolumeSpecName "kube-api-access-6g5b2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:31:50.861411 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.861394 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "877121d9-942b-4db5-81fb-fd0d76e3f18d" (UID: "877121d9-942b-4db5-81fb-fd0d76e3f18d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:31:50.861475 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.861463 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "877121d9-942b-4db5-81fb-fd0d76e3f18d" (UID: "877121d9-942b-4db5-81fb-fd0d76e3f18d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:31:50.960383 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.960346 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-config\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:31:50.960383 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.960375 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-serving-cert\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:31:50.960383 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.960387 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/877121d9-942b-4db5-81fb-fd0d76e3f18d-console-oauth-config\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:31:50.960615 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:50.960398 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g5b2\" (UniqueName: \"kubernetes.io/projected/877121d9-942b-4db5-81fb-fd0d76e3f18d-kube-api-access-6g5b2\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:31:51.559534 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:51.559496 2576 generic.go:356] "Generic (PLEG): container finished" podID="877121d9-942b-4db5-81fb-fd0d76e3f18d" containerID="62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a" exitCode=0 Jun 15 06:31:51.559954 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:51.559543 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95f88d64f-sthh7" Jun 15 06:31:51.559954 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:51.559554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95f88d64f-sthh7" event={"ID":"877121d9-942b-4db5-81fb-fd0d76e3f18d","Type":"ContainerDied","Data":"62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a"} Jun 15 06:31:51.559954 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:51.559598 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95f88d64f-sthh7" event={"ID":"877121d9-942b-4db5-81fb-fd0d76e3f18d","Type":"ContainerDied","Data":"b681d3d796411b3a9e563f9d18307c420b77a45a7434665559e9e01034cf9560"} Jun 15 06:31:51.559954 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:51.559619 2576 scope.go:117] "RemoveContainer" containerID="62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a" Jun 15 06:31:51.569919 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:51.569890 2576 scope.go:117] "RemoveContainer" containerID="62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a" Jun 15 06:31:51.570231 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:31:51.570211 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a\": container with ID starting with 62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a not found: ID does not exist" containerID="62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a" Jun 15 06:31:51.570288 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:51.570240 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a"} err="failed to get container status \"62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a\": rpc error: code = NotFound desc = could not find container \"62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a\": container with ID starting with 62aec827928280568b22ccba057b6f843faa49f1c4da31ba803d356ccd00256a not found: ID does not exist" Jun 15 06:31:51.581595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:51.581564 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95f88d64f-sthh7"] Jun 15 06:31:51.585115 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:51.585090 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-95f88d64f-sthh7"] Jun 15 06:31:52.140552 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:31:52.140508 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="877121d9-942b-4db5-81fb-fd0d76e3f18d" path="/var/lib/kubelet/pods/877121d9-942b-4db5-81fb-fd0d76e3f18d/volumes" Jun 15 06:32:08.505234 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.505198 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f"] Jun 15 06:32:08.505631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.505512 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="877121d9-942b-4db5-81fb-fd0d76e3f18d" containerName="console" Jun 15 06:32:08.505631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.505523 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="877121d9-942b-4db5-81fb-fd0d76e3f18d" containerName="console" Jun 15 06:32:08.505631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.505573 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="877121d9-942b-4db5-81fb-fd0d76e3f18d" containerName="console" Jun 15 06:32:08.508659 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.508643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.510799 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.510775 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw8gs\"" Jun 15 06:32:08.510799 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.510776 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 06:32:08.511020 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.511007 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 06:32:08.516431 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.516407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f"] Jun 15 06:32:08.601807 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.601764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.602007 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.601835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.602007 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.601908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s7vx\" (UniqueName: \"kubernetes.io/projected/1ec3ec09-c1c6-4665-af4c-f99280a06554-kube-api-access-8s7vx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.703063 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.703029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s7vx\" (UniqueName: \"kubernetes.io/projected/1ec3ec09-c1c6-4665-af4c-f99280a06554-kube-api-access-8s7vx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.703063 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.703067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.703281 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.703112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.703463 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.703447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.703515 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.703495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.710651 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.710622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s7vx\" (UniqueName: \"kubernetes.io/projected/1ec3ec09-c1c6-4665-af4c-f99280a06554-kube-api-access-8s7vx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.818485 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.818452 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:08.960747 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.960719 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f"] Jun 15 06:32:08.963249 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:32:08.963217 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec3ec09_c1c6_4665_af4c_f99280a06554.slice/crio-f934a9295999a39d38c519f6fc799db5ef39b50b535a330da29d98c8d869a2be WatchSource:0}: Error finding container f934a9295999a39d38c519f6fc799db5ef39b50b535a330da29d98c8d869a2be: Status 404 returned error can't find the container with id f934a9295999a39d38c519f6fc799db5ef39b50b535a330da29d98c8d869a2be Jun 15 06:32:08.965285 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:08.965264 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 06:32:09.630853 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:09.630815 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" event={"ID":"1ec3ec09-c1c6-4665-af4c-f99280a06554","Type":"ContainerStarted","Data":"f934a9295999a39d38c519f6fc799db5ef39b50b535a330da29d98c8d869a2be"} Jun 15 06:32:16.662595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:16.662560 2576 generic.go:356] "Generic (PLEG): container finished" podID="1ec3ec09-c1c6-4665-af4c-f99280a06554" containerID="deca5d19e8a0ee1c403a17ffcfa101f5669a9e9fe1c47aa39bf283cd442778e1" exitCode=0 Jun 15 06:32:16.663010 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:16.662639 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" event={"ID":"1ec3ec09-c1c6-4665-af4c-f99280a06554","Type":"ContainerDied","Data":"deca5d19e8a0ee1c403a17ffcfa101f5669a9e9fe1c47aa39bf283cd442778e1"} Jun 15 06:32:19.678600 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:19.678558 2576 generic.go:356] "Generic (PLEG): container finished" podID="1ec3ec09-c1c6-4665-af4c-f99280a06554" containerID="7e3a245385706c28600f8d8507f440733d1dbc49f770e05b9fc3be55d451bc80" exitCode=0 Jun 15 06:32:19.678991 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:19.678634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" event={"ID":"1ec3ec09-c1c6-4665-af4c-f99280a06554","Type":"ContainerDied","Data":"7e3a245385706c28600f8d8507f440733d1dbc49f770e05b9fc3be55d451bc80"} Jun 15 06:32:25.706479 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:25.706442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" event={"ID":"1ec3ec09-c1c6-4665-af4c-f99280a06554","Type":"ContainerStarted","Data":"cee17d0b047b11bef594c3d6472b9f5b0a0c938d5104e235ffcb52de802c7a52"} Jun 15 06:32:25.728204 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:25.728153 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" podStartSLOduration=3.138165291 podStartE2EDuration="17.728134623s" totalImagesPullingTime="14.589969332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:32:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:32:25.726901687 +0000 UTC m=+398.022428962" watchObservedRunningTime="2026-06-15 06:32:25.728134623 +0000 UTC m=+398.023661901" Jun 15 06:32:26.717384 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:26.717349 2576 generic.go:356] "Generic (PLEG): container finished" podID="1ec3ec09-c1c6-4665-af4c-f99280a06554" containerID="cee17d0b047b11bef594c3d6472b9f5b0a0c938d5104e235ffcb52de802c7a52" exitCode=0 Jun 15 06:32:26.717755 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:26.717413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" event={"ID":"1ec3ec09-c1c6-4665-af4c-f99280a06554","Type":"ContainerDied","Data":"cee17d0b047b11bef594c3d6472b9f5b0a0c938d5104e235ffcb52de802c7a52"} Jun 15 06:32:27.891450 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:27.891413 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:27.970448 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:27.970414 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-util\") pod \"1ec3ec09-c1c6-4665-af4c-f99280a06554\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " Jun 15 06:32:27.970645 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:27.970460 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s7vx\" (UniqueName: \"kubernetes.io/projected/1ec3ec09-c1c6-4665-af4c-f99280a06554-kube-api-access-8s7vx\") pod \"1ec3ec09-c1c6-4665-af4c-f99280a06554\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " Jun 15 06:32:27.970645 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:27.970485 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-bundle\") pod \"1ec3ec09-c1c6-4665-af4c-f99280a06554\" (UID: \"1ec3ec09-c1c6-4665-af4c-f99280a06554\") " Jun 15 06:32:27.971225 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:27.971197 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-bundle" (OuterVolumeSpecName: "bundle") pod "1ec3ec09-c1c6-4665-af4c-f99280a06554" (UID: "1ec3ec09-c1c6-4665-af4c-f99280a06554"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:32:27.972665 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:27.972635 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec3ec09-c1c6-4665-af4c-f99280a06554-kube-api-access-8s7vx" (OuterVolumeSpecName: "kube-api-access-8s7vx") pod "1ec3ec09-c1c6-4665-af4c-f99280a06554" (UID: "1ec3ec09-c1c6-4665-af4c-f99280a06554"). InnerVolumeSpecName "kube-api-access-8s7vx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:32:27.975223 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:27.975197 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-util" (OuterVolumeSpecName: "util") pod "1ec3ec09-c1c6-4665-af4c-f99280a06554" (UID: "1ec3ec09-c1c6-4665-af4c-f99280a06554"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:32:28.071407 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:28.071372 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:32:28.071407 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:28.071401 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec3ec09-c1c6-4665-af4c-f99280a06554-util\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:32:28.071407 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:28.071410 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s7vx\" (UniqueName: \"kubernetes.io/projected/1ec3ec09-c1c6-4665-af4c-f99280a06554-kube-api-access-8s7vx\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:32:28.727450 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:28.727409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" event={"ID":"1ec3ec09-c1c6-4665-af4c-f99280a06554","Type":"ContainerDied","Data":"f934a9295999a39d38c519f6fc799db5ef39b50b535a330da29d98c8d869a2be"} Jun 15 06:32:28.727450 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:28.727447 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dw969f" Jun 15 06:32:28.727661 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:28.727464 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f934a9295999a39d38c519f6fc799db5ef39b50b535a330da29d98c8d869a2be" Jun 15 06:32:34.593527 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.593489 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm"] Jun 15 06:32:34.593964 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.593792 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec3ec09-c1c6-4665-af4c-f99280a06554" containerName="extract" Jun 15 06:32:34.593964 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.593803 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec3ec09-c1c6-4665-af4c-f99280a06554" containerName="extract" Jun 15 06:32:34.593964 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.593820 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec3ec09-c1c6-4665-af4c-f99280a06554" containerName="pull" Jun 15 06:32:34.593964 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.593826 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec3ec09-c1c6-4665-af4c-f99280a06554" containerName="pull" Jun 15 06:32:34.593964 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.593841 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec3ec09-c1c6-4665-af4c-f99280a06554" containerName="util" Jun 15 06:32:34.593964 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.593847 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec3ec09-c1c6-4665-af4c-f99280a06554" containerName="util" Jun 15 06:32:34.593964 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.593910 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ec3ec09-c1c6-4665-af4c-f99280a06554" containerName="extract" Jun 15 06:32:34.595921 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.595905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" Jun 15 06:32:34.598610 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.598587 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 15 06:32:34.598610 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.598604 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 15 06:32:34.598882 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.598855 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-9dpt6\"" Jun 15 06:32:34.608775 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.608747 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm"] Jun 15 06:32:34.616189 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.616164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bhdp\" (UniqueName: \"kubernetes.io/projected/4af32e40-d1a6-4ceb-a41d-a8e49b22426a-kube-api-access-8bhdp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-s8vrm\" (UID: \"4af32e40-d1a6-4ceb-a41d-a8e49b22426a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" Jun 15 06:32:34.616318 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.616206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4af32e40-d1a6-4ceb-a41d-a8e49b22426a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-s8vrm\" (UID: \"4af32e40-d1a6-4ceb-a41d-a8e49b22426a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" Jun 15 06:32:34.717414 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.717368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bhdp\" (UniqueName: \"kubernetes.io/projected/4af32e40-d1a6-4ceb-a41d-a8e49b22426a-kube-api-access-8bhdp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-s8vrm\" (UID: \"4af32e40-d1a6-4ceb-a41d-a8e49b22426a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" Jun 15 06:32:34.717580 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.717440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4af32e40-d1a6-4ceb-a41d-a8e49b22426a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-s8vrm\" (UID: \"4af32e40-d1a6-4ceb-a41d-a8e49b22426a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" Jun 15 06:32:34.717858 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.717836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4af32e40-d1a6-4ceb-a41d-a8e49b22426a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-s8vrm\" (UID: \"4af32e40-d1a6-4ceb-a41d-a8e49b22426a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" Jun 15 06:32:34.731092 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.731062 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bhdp\" (UniqueName: \"kubernetes.io/projected/4af32e40-d1a6-4ceb-a41d-a8e49b22426a-kube-api-access-8bhdp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-s8vrm\" (UID: \"4af32e40-d1a6-4ceb-a41d-a8e49b22426a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" Jun 15 06:32:34.905796 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:34.905705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" Jun 15 06:32:35.036756 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:35.036727 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm"] Jun 15 06:32:35.039403 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:32:35.039363 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af32e40_d1a6_4ceb_a41d_a8e49b22426a.slice/crio-32e2430b36d9918125ab198510b10373a23814f82b7d02df713a57d1e9e2436c WatchSource:0}: Error finding container 32e2430b36d9918125ab198510b10373a23814f82b7d02df713a57d1e9e2436c: Status 404 returned error can't find the container with id 32e2430b36d9918125ab198510b10373a23814f82b7d02df713a57d1e9e2436c Jun 15 06:32:35.757760 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:35.757716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" event={"ID":"4af32e40-d1a6-4ceb-a41d-a8e49b22426a","Type":"ContainerStarted","Data":"32e2430b36d9918125ab198510b10373a23814f82b7d02df713a57d1e9e2436c"} Jun 15 06:32:37.769479 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:37.769382 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" event={"ID":"4af32e40-d1a6-4ceb-a41d-a8e49b22426a","Type":"ContainerStarted","Data":"a250f71916de48c1ee80e0236ccdbd82bbcaeb0b0fd7b9e95f9370a02409bbaa"} Jun 15 06:32:37.787768 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:37.787709 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-s8vrm" podStartSLOduration=1.3248791039999999 podStartE2EDuration="3.787693186s" totalImagesPullingTime="2.462814082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:32:37.785511353 +0000 UTC m=+410.081038629" watchObservedRunningTime="2026-06-15 06:32:37.787693186 +0000 UTC m=+410.083220462" Jun 15 06:32:38.442393 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.442356 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf"] Jun 15 06:32:38.445089 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.445074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.447020 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.446991 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 06:32:38.447165 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.447006 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 06:32:38.447236 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.447163 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw8gs\"" Jun 15 06:32:38.455755 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.455731 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf"] Jun 15 06:32:38.551210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.551172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.551210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.551213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4wmb\" (UniqueName: \"kubernetes.io/projected/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-kube-api-access-f4wmb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.551414 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.551288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.652142 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.652105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.652334 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.652157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.652334 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.652182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4wmb\" (UniqueName: \"kubernetes.io/projected/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-kube-api-access-f4wmb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.652517 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.652497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.652566 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.652550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.671077 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.671041 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4wmb\" (UniqueName: \"kubernetes.io/projected/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-kube-api-access-f4wmb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.754226 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.754131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:38.898719 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:38.898691 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf"] Jun 15 06:32:38.901043 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:32:38.901012 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a824969_18f9_43ea_b6cc_0a0fdbaa3317.slice/crio-2c7323cb35815fd2f5dab9d3bf96aff8c473fe7c0314ee29cb425215fc9f4b39 WatchSource:0}: Error finding container 2c7323cb35815fd2f5dab9d3bf96aff8c473fe7c0314ee29cb425215fc9f4b39: Status 404 returned error can't find the container with id 2c7323cb35815fd2f5dab9d3bf96aff8c473fe7c0314ee29cb425215fc9f4b39 Jun 15 06:32:39.780881 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:39.780842 2576 generic.go:356] "Generic (PLEG): container finished" podID="9a824969-18f9-43ea-b6cc-0a0fdbaa3317" containerID="82c21d3cd94a4262d1f2bd89b1094d1bd8ce214857534bddc8b18db455ba0a5c" exitCode=0 Jun 15 06:32:39.781033 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:39.780905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" event={"ID":"9a824969-18f9-43ea-b6cc-0a0fdbaa3317","Type":"ContainerDied","Data":"82c21d3cd94a4262d1f2bd89b1094d1bd8ce214857534bddc8b18db455ba0a5c"} Jun 15 06:32:39.781033 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:39.780949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" event={"ID":"9a824969-18f9-43ea-b6cc-0a0fdbaa3317","Type":"ContainerStarted","Data":"2c7323cb35815fd2f5dab9d3bf96aff8c473fe7c0314ee29cb425215fc9f4b39"} Jun 15 06:32:39.955194 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:39.955109 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq"] Jun 15 06:32:39.957402 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:39.957386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" Jun 15 06:32:39.959302 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:39.959276 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 15 06:32:39.959412 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:39.959276 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 15 06:32:39.959412 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:39.959343 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7ntrt\"" Jun 15 06:32:39.966252 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:39.966223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq"] Jun 15 06:32:40.064446 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:40.064397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2g6b\" (UniqueName: \"kubernetes.io/projected/af3bc7f9-6bf8-4959-9b62-c3982e209fc7-kube-api-access-r2g6b\") pod \"cert-manager-webhook-7dc76cbb94-8kwdq\" (UID: \"af3bc7f9-6bf8-4959-9b62-c3982e209fc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" Jun 15 06:32:40.064446 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:40.064447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af3bc7f9-6bf8-4959-9b62-c3982e209fc7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-8kwdq\" (UID: \"af3bc7f9-6bf8-4959-9b62-c3982e209fc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" Jun 15 06:32:40.165312 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:40.165279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af3bc7f9-6bf8-4959-9b62-c3982e209fc7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-8kwdq\" (UID: \"af3bc7f9-6bf8-4959-9b62-c3982e209fc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" Jun 15 06:32:40.165504 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:40.165384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2g6b\" (UniqueName: \"kubernetes.io/projected/af3bc7f9-6bf8-4959-9b62-c3982e209fc7-kube-api-access-r2g6b\") pod \"cert-manager-webhook-7dc76cbb94-8kwdq\" (UID: \"af3bc7f9-6bf8-4959-9b62-c3982e209fc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" Jun 15 06:32:40.172566 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:40.172534 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af3bc7f9-6bf8-4959-9b62-c3982e209fc7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-8kwdq\" (UID: \"af3bc7f9-6bf8-4959-9b62-c3982e209fc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" Jun 15 06:32:40.172752 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:40.172730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2g6b\" (UniqueName: \"kubernetes.io/projected/af3bc7f9-6bf8-4959-9b62-c3982e209fc7-kube-api-access-r2g6b\") pod \"cert-manager-webhook-7dc76cbb94-8kwdq\" (UID: \"af3bc7f9-6bf8-4959-9b62-c3982e209fc7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" Jun 15 06:32:40.273598 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:40.273497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" Jun 15 06:32:40.409973 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:40.409947 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq"] Jun 15 06:32:40.412530 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:32:40.412496 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf3bc7f9_6bf8_4959_9b62_c3982e209fc7.slice/crio-3d0cd3230f088ede413f93ae16eab5f1d51d09204f4ad43b2f648c8ad023e5b1 WatchSource:0}: Error finding container 3d0cd3230f088ede413f93ae16eab5f1d51d09204f4ad43b2f648c8ad023e5b1: Status 404 returned error can't find the container with id 3d0cd3230f088ede413f93ae16eab5f1d51d09204f4ad43b2f648c8ad023e5b1 Jun 15 06:32:40.787770 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:40.787732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" event={"ID":"af3bc7f9-6bf8-4959-9b62-c3982e209fc7","Type":"ContainerStarted","Data":"3d0cd3230f088ede413f93ae16eab5f1d51d09204f4ad43b2f648c8ad023e5b1"} Jun 15 06:32:41.801149 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:41.801115 2576 generic.go:356] "Generic (PLEG): container finished" podID="9a824969-18f9-43ea-b6cc-0a0fdbaa3317" containerID="7d7f9570b8d7f7a79e7b51b131bad6f6fddc2ff2347dac12004689774a9b627c" exitCode=0 Jun 15 06:32:41.801587 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:41.801162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" event={"ID":"9a824969-18f9-43ea-b6cc-0a0fdbaa3317","Type":"ContainerDied","Data":"7d7f9570b8d7f7a79e7b51b131bad6f6fddc2ff2347dac12004689774a9b627c"} Jun 15 06:32:42.808583 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:42.808544 2576 generic.go:356] "Generic (PLEG): container finished" podID="9a824969-18f9-43ea-b6cc-0a0fdbaa3317" containerID="c345c81f3431d32f96fdeea8679d8779b4c7ada51f63f140f08b9eebfced7075" exitCode=0 Jun 15 06:32:42.809008 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:42.808629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" event={"ID":"9a824969-18f9-43ea-b6cc-0a0fdbaa3317","Type":"ContainerDied","Data":"c345c81f3431d32f96fdeea8679d8779b4c7ada51f63f140f08b9eebfced7075"} Jun 15 06:32:43.816451 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:43.816413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" event={"ID":"af3bc7f9-6bf8-4959-9b62-c3982e209fc7","Type":"ContainerStarted","Data":"87adde2c969fcf749c45ae1b258bddf7845e9162ef4fa9aa7bddb9c1684f7896"} Jun 15 06:32:43.816950 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:43.816601 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" Jun 15 06:32:43.831675 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:43.831626 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" podStartSLOduration=1.8168568459999999 podStartE2EDuration="4.831609818s" totalImagesPullingTime="3.014752972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:32:43.830404379 +0000 UTC m=+416.125931656" watchObservedRunningTime="2026-06-15 06:32:43.831609818 +0000 UTC m=+416.127137093" Jun 15 06:32:43.957761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:43.957739 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:43.998378 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:43.998342 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-util\") pod \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " Jun 15 06:32:43.998521 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:43.998454 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4wmb\" (UniqueName: \"kubernetes.io/projected/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-kube-api-access-f4wmb\") pod \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " Jun 15 06:32:43.998521 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:43.998492 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-bundle\") pod \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\" (UID: \"9a824969-18f9-43ea-b6cc-0a0fdbaa3317\") " Jun 15 06:32:43.998916 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:43.998884 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-bundle" (OuterVolumeSpecName: "bundle") pod "9a824969-18f9-43ea-b6cc-0a0fdbaa3317" (UID: "9a824969-18f9-43ea-b6cc-0a0fdbaa3317"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:32:44.000599 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:44.000575 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-kube-api-access-f4wmb" (OuterVolumeSpecName: "kube-api-access-f4wmb") pod "9a824969-18f9-43ea-b6cc-0a0fdbaa3317" (UID: "9a824969-18f9-43ea-b6cc-0a0fdbaa3317"). InnerVolumeSpecName "kube-api-access-f4wmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:32:44.004118 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:44.004086 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-util" (OuterVolumeSpecName: "util") pod "9a824969-18f9-43ea-b6cc-0a0fdbaa3317" (UID: "9a824969-18f9-43ea-b6cc-0a0fdbaa3317"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:32:44.099419 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:44.099336 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4wmb\" (UniqueName: \"kubernetes.io/projected/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-kube-api-access-f4wmb\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:32:44.099419 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:44.099364 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:32:44.099419 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:44.099374 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a824969-18f9-43ea-b6cc-0a0fdbaa3317-util\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:32:44.823454 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:44.823422 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" event={"ID":"9a824969-18f9-43ea-b6cc-0a0fdbaa3317","Type":"ContainerDied","Data":"2c7323cb35815fd2f5dab9d3bf96aff8c473fe7c0314ee29cb425215fc9f4b39"} Jun 15 06:32:44.823827 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:44.823461 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fccrgf" Jun 15 06:32:44.823827 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:44.823470 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c7323cb35815fd2f5dab9d3bf96aff8c473fe7c0314ee29cb425215fc9f4b39" Jun 15 06:32:49.826288 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:49.826257 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-8kwdq" Jun 15 06:32:51.469862 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.469814 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn"] Jun 15 06:32:51.470254 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.470170 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a824969-18f9-43ea-b6cc-0a0fdbaa3317" containerName="util" Jun 15 06:32:51.470254 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.470182 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a824969-18f9-43ea-b6cc-0a0fdbaa3317" containerName="util" Jun 15 06:32:51.470254 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.470189 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a824969-18f9-43ea-b6cc-0a0fdbaa3317" containerName="pull" Jun 15 06:32:51.470254 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.470194 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a824969-18f9-43ea-b6cc-0a0fdbaa3317" containerName="pull" Jun 15 06:32:51.470254 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.470212 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a824969-18f9-43ea-b6cc-0a0fdbaa3317" containerName="extract" Jun 15 06:32:51.470254 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.470218 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a824969-18f9-43ea-b6cc-0a0fdbaa3317" containerName="extract" Jun 15 06:32:51.470429 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.470269 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a824969-18f9-43ea-b6cc-0a0fdbaa3317" containerName="extract" Jun 15 06:32:51.472788 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.472770 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" Jun 15 06:32:51.474502 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.474484 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 06:32:51.474838 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.474825 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 06:32:51.474900 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.474837 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-t9mzd\"" Jun 15 06:32:51.483546 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.483521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn"] Jun 15 06:32:51.570087 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.570047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8deba7-7202-4725-81a3-4d73f959b7e7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-znxqn\" (UID: \"5b8deba7-7202-4725-81a3-4d73f959b7e7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" Jun 15 06:32:51.570087 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.570090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9stm\" (UniqueName: \"kubernetes.io/projected/5b8deba7-7202-4725-81a3-4d73f959b7e7-kube-api-access-b9stm\") pod \"openshift-lws-operator-fd8ccff4c-znxqn\" (UID: \"5b8deba7-7202-4725-81a3-4d73f959b7e7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" Jun 15 06:32:51.671309 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.671266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8deba7-7202-4725-81a3-4d73f959b7e7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-znxqn\" (UID: \"5b8deba7-7202-4725-81a3-4d73f959b7e7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" Jun 15 06:32:51.671471 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.671314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9stm\" (UniqueName: \"kubernetes.io/projected/5b8deba7-7202-4725-81a3-4d73f959b7e7-kube-api-access-b9stm\") pod \"openshift-lws-operator-fd8ccff4c-znxqn\" (UID: \"5b8deba7-7202-4725-81a3-4d73f959b7e7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" Jun 15 06:32:51.671676 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.671657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8deba7-7202-4725-81a3-4d73f959b7e7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-znxqn\" (UID: \"5b8deba7-7202-4725-81a3-4d73f959b7e7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" Jun 15 06:32:51.678713 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.678684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9stm\" (UniqueName: \"kubernetes.io/projected/5b8deba7-7202-4725-81a3-4d73f959b7e7-kube-api-access-b9stm\") pod \"openshift-lws-operator-fd8ccff4c-znxqn\" (UID: \"5b8deba7-7202-4725-81a3-4d73f959b7e7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" Jun 15 06:32:51.782332 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.782228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" Jun 15 06:32:51.908971 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:51.908939 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn"] Jun 15 06:32:51.911775 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:32:51.911740 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b8deba7_7202_4725_81a3_4d73f959b7e7.slice/crio-7b9f6b855500d4975da86c6a3cacd53ec669a4b0358eba98713b3ce2179caf68 WatchSource:0}: Error finding container 7b9f6b855500d4975da86c6a3cacd53ec669a4b0358eba98713b3ce2179caf68: Status 404 returned error can't find the container with id 7b9f6b855500d4975da86c6a3cacd53ec669a4b0358eba98713b3ce2179caf68 Jun 15 06:32:52.862224 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:52.862190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" event={"ID":"5b8deba7-7202-4725-81a3-4d73f959b7e7","Type":"ContainerStarted","Data":"7b9f6b855500d4975da86c6a3cacd53ec669a4b0358eba98713b3ce2179caf68"} Jun 15 06:32:53.869831 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:53.869781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" event={"ID":"5b8deba7-7202-4725-81a3-4d73f959b7e7","Type":"ContainerStarted","Data":"69a999ec0d2d5f413302e553e70734c6167d1b75ab460b434c11c804dfaf8010"} Jun 15 06:32:53.885713 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:53.885662 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znxqn" podStartSLOduration=1.110682942 podStartE2EDuration="2.885646328s" totalImagesPullingTime="1.774963386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:32:53.884210437 +0000 UTC m=+426.179737713" watchObservedRunningTime="2026-06-15 06:32:53.885646328 +0000 UTC m=+426.181173603" Jun 15 06:32:56.499030 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.498992 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb"] Jun 15 06:32:56.517817 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.517782 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb"] Jun 15 06:32:56.517977 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.517951 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.519767 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.519737 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 06:32:56.520006 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.519805 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 06:32:56.520108 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.520091 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw8gs\"" Jun 15 06:32:56.615419 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.615381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmwsb\" (UniqueName: \"kubernetes.io/projected/4eeb6f65-eeb8-49dc-88c8-9468d192f952-kube-api-access-gmwsb\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.615579 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.615440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.615579 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.615538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.716137 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.716099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.716290 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.716170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmwsb\" (UniqueName: \"kubernetes.io/projected/4eeb6f65-eeb8-49dc-88c8-9468d192f952-kube-api-access-gmwsb\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.716290 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.716220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.716585 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.716563 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.716631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.716585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.723611 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.723577 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmwsb\" (UniqueName: \"kubernetes.io/projected/4eeb6f65-eeb8-49dc-88c8-9468d192f952-kube-api-access-gmwsb\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.827697 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.827654 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:32:56.968544 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:56.968518 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb"] Jun 15 06:32:56.970923 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:32:56.970894 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eeb6f65_eeb8_49dc_88c8_9468d192f952.slice/crio-1f42f9dc0292efd9a59c9b0636f534d21f8bd8d70af30f8b3ce4e52a83d9b138 WatchSource:0}: Error finding container 1f42f9dc0292efd9a59c9b0636f534d21f8bd8d70af30f8b3ce4e52a83d9b138: Status 404 returned error can't find the container with id 1f42f9dc0292efd9a59c9b0636f534d21f8bd8d70af30f8b3ce4e52a83d9b138 Jun 15 06:32:57.889582 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:57.889545 2576 generic.go:356] "Generic (PLEG): container finished" podID="4eeb6f65-eeb8-49dc-88c8-9468d192f952" containerID="4b1d42da9b16da50aa213e7023c0814402e8c4cae7ea6f6d6f70a12ff49729bb" exitCode=0 Jun 15 06:32:57.890036 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:57.889626 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" event={"ID":"4eeb6f65-eeb8-49dc-88c8-9468d192f952","Type":"ContainerDied","Data":"4b1d42da9b16da50aa213e7023c0814402e8c4cae7ea6f6d6f70a12ff49729bb"} Jun 15 06:32:57.890036 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:57.889694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" event={"ID":"4eeb6f65-eeb8-49dc-88c8-9468d192f952","Type":"ContainerStarted","Data":"1f42f9dc0292efd9a59c9b0636f534d21f8bd8d70af30f8b3ce4e52a83d9b138"} Jun 15 06:32:58.948256 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:58.948223 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2vf44"] Jun 15 06:32:58.981533 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:58.981505 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2vf44"] Jun 15 06:32:58.981677 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:58.981609 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2vf44" Jun 15 06:32:58.983457 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:58.983433 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jb4sl\"" Jun 15 06:32:59.033719 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.033685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdt8\" (UniqueName: \"kubernetes.io/projected/26755834-f88b-4794-b743-f765a965f4c6-kube-api-access-4hdt8\") pod \"cert-manager-59c77684cc-2vf44\" (UID: \"26755834-f88b-4794-b743-f765a965f4c6\") " pod="cert-manager/cert-manager-59c77684cc-2vf44" Jun 15 06:32:59.033839 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.033727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26755834-f88b-4794-b743-f765a965f4c6-bound-sa-token\") pod \"cert-manager-59c77684cc-2vf44\" (UID: \"26755834-f88b-4794-b743-f765a965f4c6\") " pod="cert-manager/cert-manager-59c77684cc-2vf44" Jun 15 06:32:59.135521 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.135485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdt8\" (UniqueName: \"kubernetes.io/projected/26755834-f88b-4794-b743-f765a965f4c6-kube-api-access-4hdt8\") pod \"cert-manager-59c77684cc-2vf44\" (UID: \"26755834-f88b-4794-b743-f765a965f4c6\") " pod="cert-manager/cert-manager-59c77684cc-2vf44" Jun 15 06:32:59.135521 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.135527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26755834-f88b-4794-b743-f765a965f4c6-bound-sa-token\") pod \"cert-manager-59c77684cc-2vf44\" (UID: \"26755834-f88b-4794-b743-f765a965f4c6\") " pod="cert-manager/cert-manager-59c77684cc-2vf44" Jun 15 06:32:59.142823 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.142797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26755834-f88b-4794-b743-f765a965f4c6-bound-sa-token\") pod \"cert-manager-59c77684cc-2vf44\" (UID: \"26755834-f88b-4794-b743-f765a965f4c6\") " pod="cert-manager/cert-manager-59c77684cc-2vf44" Jun 15 06:32:59.142997 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.142980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdt8\" (UniqueName: \"kubernetes.io/projected/26755834-f88b-4794-b743-f765a965f4c6-kube-api-access-4hdt8\") pod \"cert-manager-59c77684cc-2vf44\" (UID: \"26755834-f88b-4794-b743-f765a965f4c6\") " pod="cert-manager/cert-manager-59c77684cc-2vf44" Jun 15 06:32:59.296153 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.296050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2vf44" Jun 15 06:32:59.444516 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.444344 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2vf44"] Jun 15 06:32:59.447144 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:32:59.447104 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26755834_f88b_4794_b743_f765a965f4c6.slice/crio-f35c78b036c2db28fb63acfef903f5ea81cfc20951115033ad9ef36c737211f4 WatchSource:0}: Error finding container f35c78b036c2db28fb63acfef903f5ea81cfc20951115033ad9ef36c737211f4: Status 404 returned error can't find the container with id f35c78b036c2db28fb63acfef903f5ea81cfc20951115033ad9ef36c737211f4 Jun 15 06:32:59.900369 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.900320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2vf44" event={"ID":"26755834-f88b-4794-b743-f765a965f4c6","Type":"ContainerStarted","Data":"d568cb0eef7f52e98cc693cd332e326db2953288265f5cae422f44617fa9b42c"} Jun 15 06:32:59.900369 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.900373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2vf44" event={"ID":"26755834-f88b-4794-b743-f765a965f4c6","Type":"ContainerStarted","Data":"f35c78b036c2db28fb63acfef903f5ea81cfc20951115033ad9ef36c737211f4"} Jun 15 06:32:59.901999 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.901971 2576 generic.go:356] "Generic (PLEG): container finished" podID="4eeb6f65-eeb8-49dc-88c8-9468d192f952" containerID="cfbe292c396785a8b5b154a0261cb3bb858415ee6755a295dbce1fae58d49c60" exitCode=0 Jun 15 06:32:59.902135 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.902024 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" event={"ID":"4eeb6f65-eeb8-49dc-88c8-9468d192f952","Type":"ContainerDied","Data":"cfbe292c396785a8b5b154a0261cb3bb858415ee6755a295dbce1fae58d49c60"} Jun 15 06:32:59.914706 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:32:59.914647 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2vf44" podStartSLOduration=1.9146309590000001 podStartE2EDuration="1.914630959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:32:59.913887374 +0000 UTC m=+432.209414640" watchObservedRunningTime="2026-06-15 06:32:59.914630959 +0000 UTC m=+432.210158234" Jun 15 06:33:00.908482 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:00.908443 2576 generic.go:356] "Generic (PLEG): container finished" podID="4eeb6f65-eeb8-49dc-88c8-9468d192f952" containerID="a112dfdc83765213e4c4357d4ddaf4ac5da0c63d6b1bb0d2348d0f9882fa4bc1" exitCode=0 Jun 15 06:33:00.908881 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:00.908524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" event={"ID":"4eeb6f65-eeb8-49dc-88c8-9468d192f952","Type":"ContainerDied","Data":"a112dfdc83765213e4c4357d4ddaf4ac5da0c63d6b1bb0d2348d0f9882fa4bc1"} Jun 15 06:33:02.038616 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.038590 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:33:02.160278 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.160249 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-bundle\") pod \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " Jun 15 06:33:02.160447 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.160299 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmwsb\" (UniqueName: \"kubernetes.io/projected/4eeb6f65-eeb8-49dc-88c8-9468d192f952-kube-api-access-gmwsb\") pod \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " Jun 15 06:33:02.160447 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.160320 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-util\") pod \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\" (UID: \"4eeb6f65-eeb8-49dc-88c8-9468d192f952\") " Jun 15 06:33:02.161005 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.160978 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-bundle" (OuterVolumeSpecName: "bundle") pod "4eeb6f65-eeb8-49dc-88c8-9468d192f952" (UID: "4eeb6f65-eeb8-49dc-88c8-9468d192f952"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:33:02.162461 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.162435 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eeb6f65-eeb8-49dc-88c8-9468d192f952-kube-api-access-gmwsb" (OuterVolumeSpecName: "kube-api-access-gmwsb") pod "4eeb6f65-eeb8-49dc-88c8-9468d192f952" (UID: "4eeb6f65-eeb8-49dc-88c8-9468d192f952"). InnerVolumeSpecName "kube-api-access-gmwsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:33:02.165708 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.165667 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-util" (OuterVolumeSpecName: "util") pod "4eeb6f65-eeb8-49dc-88c8-9468d192f952" (UID: "4eeb6f65-eeb8-49dc-88c8-9468d192f952"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:33:02.261809 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.261771 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:33:02.261809 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.261807 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmwsb\" (UniqueName: \"kubernetes.io/projected/4eeb6f65-eeb8-49dc-88c8-9468d192f952-kube-api-access-gmwsb\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:33:02.261809 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.261829 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4eeb6f65-eeb8-49dc-88c8-9468d192f952-util\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:33:02.919711 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.919672 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" event={"ID":"4eeb6f65-eeb8-49dc-88c8-9468d192f952","Type":"ContainerDied","Data":"1f42f9dc0292efd9a59c9b0636f534d21f8bd8d70af30f8b3ce4e52a83d9b138"} Jun 15 06:33:02.919913 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.919718 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qsnb" Jun 15 06:33:02.919913 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:02.919734 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f42f9dc0292efd9a59c9b0636f534d21f8bd8d70af30f8b3ce4e52a83d9b138" Jun 15 06:33:11.557384 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.557341 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k"] Jun 15 06:33:11.557763 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.557676 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eeb6f65-eeb8-49dc-88c8-9468d192f952" containerName="pull" Jun 15 06:33:11.557763 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.557687 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eeb6f65-eeb8-49dc-88c8-9468d192f952" containerName="pull" Jun 15 06:33:11.557763 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.557701 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eeb6f65-eeb8-49dc-88c8-9468d192f952" containerName="util" Jun 15 06:33:11.557763 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.557706 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eeb6f65-eeb8-49dc-88c8-9468d192f952" containerName="util" Jun 15 06:33:11.557763 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.557716 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eeb6f65-eeb8-49dc-88c8-9468d192f952" containerName="extract" Jun 15 06:33:11.557763 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.557721 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eeb6f65-eeb8-49dc-88c8-9468d192f952" containerName="extract" Jun 15 06:33:11.557976 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.557790 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eeb6f65-eeb8-49dc-88c8-9468d192f952" containerName="extract" Jun 15 06:33:11.561995 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.561975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.564483 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.564447 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 06:33:11.564618 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.564562 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 06:33:11.564858 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.564794 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 06:33:11.564858 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.564811 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 06:33:11.564858 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.564841 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8kpxz\"" Jun 15 06:33:11.583285 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.583249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k"] Jun 15 06:33:11.640800 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.640765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/250dde14-4122-488f-b850-7a43f56547f5-tmp\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.640998 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.640806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/250dde14-4122-488f-b850-7a43f56547f5-manifests\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.640998 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.640837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/250dde14-4122-488f-b850-7a43f56547f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.640998 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.640926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/250dde14-4122-488f-b850-7a43f56547f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.640998 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.640965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdvxd\" (UniqueName: \"kubernetes.io/projected/250dde14-4122-488f-b850-7a43f56547f5-kube-api-access-gdvxd\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.741551 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.741509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/250dde14-4122-488f-b850-7a43f56547f5-tmp\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.741551 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.741555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/250dde14-4122-488f-b850-7a43f56547f5-manifests\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.741780 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.741682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/250dde14-4122-488f-b850-7a43f56547f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.741780 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.741745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/250dde14-4122-488f-b850-7a43f56547f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.741930 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.741800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdvxd\" (UniqueName: \"kubernetes.io/projected/250dde14-4122-488f-b850-7a43f56547f5-kube-api-access-gdvxd\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.741930 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.741913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/250dde14-4122-488f-b850-7a43f56547f5-manifests\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.743958 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.743925 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/250dde14-4122-488f-b850-7a43f56547f5-tmp\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.744171 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.744153 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/250dde14-4122-488f-b850-7a43f56547f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.744241 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.744179 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/250dde14-4122-488f-b850-7a43f56547f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.751168 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.751148 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdvxd\" (UniqueName: \"kubernetes.io/projected/250dde14-4122-488f-b850-7a43f56547f5-kube-api-access-gdvxd\") pod \"opendatahub-operator-controller-manager-6944f646d8-5pk4k\" (UID: \"250dde14-4122-488f-b850-7a43f56547f5\") " pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:11.873239 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:11.873196 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:12.024776 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:12.024598 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k"] Jun 15 06:33:12.027934 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:33:12.027906 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250dde14_4122_488f_b850_7a43f56547f5.slice/crio-18c276be17a5672b72797c855a9f48742fe132a541cabc8b4884dd099d75f196 WatchSource:0}: Error finding container 18c276be17a5672b72797c855a9f48742fe132a541cabc8b4884dd099d75f196: Status 404 returned error can't find the container with id 18c276be17a5672b72797c855a9f48742fe132a541cabc8b4884dd099d75f196 Jun 15 06:33:12.970084 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:12.970043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" event={"ID":"250dde14-4122-488f-b850-7a43f56547f5","Type":"ContainerStarted","Data":"18c276be17a5672b72797c855a9f48742fe132a541cabc8b4884dd099d75f196"} Jun 15 06:33:15.988650 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:15.988610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" event={"ID":"250dde14-4122-488f-b850-7a43f56547f5","Type":"ContainerStarted","Data":"e3435b2b10225b703672a2c98acbc3851fcdc9956866e00e74d128946f788cff"} Jun 15 06:33:16.995349 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:16.995312 2576 generic.go:356] "Generic (PLEG): container finished" podID="250dde14-4122-488f-b850-7a43f56547f5" containerID="e3435b2b10225b703672a2c98acbc3851fcdc9956866e00e74d128946f788cff" exitCode=0 Jun 15 06:33:16.995714 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:16.995358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" event={"ID":"250dde14-4122-488f-b850-7a43f56547f5","Type":"ContainerDied","Data":"e3435b2b10225b703672a2c98acbc3851fcdc9956866e00e74d128946f788cff"} Jun 15 06:33:18.001752 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:18.001716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" event={"ID":"250dde14-4122-488f-b850-7a43f56547f5","Type":"ContainerStarted","Data":"86a85d1bd3b4f6f2edc2004f89c0b461f482a92991d969d2d4bb4abd79eb8014"} Jun 15 06:33:18.002152 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:18.001836 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:18.020271 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:18.020221 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" podStartSLOduration=2.717446646 podStartE2EDuration="7.020206729s" totalImagesPullingTime="3.274292487s" totalInitContainerRuntime="1.028467596s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:33:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:33:18.018448172 +0000 UTC m=+450.313975448" watchObservedRunningTime="2026-06-15 06:33:18.020206729 +0000 UTC m=+450.315734004" Jun 15 06:33:29.009343 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:29.009307 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6944f646d8-5pk4k" Jun 15 06:33:31.320616 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.320579 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78f945c984-kf4jq"] Jun 15 06:33:31.329091 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.329068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:31.332773 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.332750 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 15 06:33:31.332927 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.332793 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 15 06:33:31.360641 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.360601 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78f945c984-kf4jq"] Jun 15 06:33:31.407743 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.407715 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abedeecc-9cc3-4f1a-8344-001a5378e936-tls-certs\") pod \"kube-auth-proxy-78f945c984-kf4jq\" (UID: \"abedeecc-9cc3-4f1a-8344-001a5378e936\") " pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:31.408176 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.407761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkkz6\" (UniqueName: \"kubernetes.io/projected/abedeecc-9cc3-4f1a-8344-001a5378e936-kube-api-access-dkkz6\") pod \"kube-auth-proxy-78f945c984-kf4jq\" (UID: \"abedeecc-9cc3-4f1a-8344-001a5378e936\") " pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:31.408176 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.407795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abedeecc-9cc3-4f1a-8344-001a5378e936-tmp\") pod \"kube-auth-proxy-78f945c984-kf4jq\" (UID: \"abedeecc-9cc3-4f1a-8344-001a5378e936\") " pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:31.508659 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.508618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abedeecc-9cc3-4f1a-8344-001a5378e936-tmp\") pod \"kube-auth-proxy-78f945c984-kf4jq\" (UID: \"abedeecc-9cc3-4f1a-8344-001a5378e936\") " pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:31.508835 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.508718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abedeecc-9cc3-4f1a-8344-001a5378e936-tls-certs\") pod \"kube-auth-proxy-78f945c984-kf4jq\" (UID: \"abedeecc-9cc3-4f1a-8344-001a5378e936\") " pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:31.508835 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.508770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkkz6\" (UniqueName: \"kubernetes.io/projected/abedeecc-9cc3-4f1a-8344-001a5378e936-kube-api-access-dkkz6\") pod \"kube-auth-proxy-78f945c984-kf4jq\" (UID: \"abedeecc-9cc3-4f1a-8344-001a5378e936\") " pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:31.508949 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:33:31.508896 2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 15 06:33:31.508990 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:33:31.508967 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abedeecc-9cc3-4f1a-8344-001a5378e936-tls-certs podName:abedeecc-9cc3-4f1a-8344-001a5378e936 nodeName:}" failed. No retries permitted until 2026-06-15 06:33:32.008949008 +0000 UTC m=+464.304476268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/abedeecc-9cc3-4f1a-8344-001a5378e936-tls-certs") pod "kube-auth-proxy-78f945c984-kf4jq" (UID: "abedeecc-9cc3-4f1a-8344-001a5378e936") : secret "kube-auth-proxy-tls" not found Jun 15 06:33:31.510953 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.510922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abedeecc-9cc3-4f1a-8344-001a5378e936-tmp\") pod \"kube-auth-proxy-78f945c984-kf4jq\" (UID: \"abedeecc-9cc3-4f1a-8344-001a5378e936\") " pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:31.526779 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.526748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkkz6\" (UniqueName: \"kubernetes.io/projected/abedeecc-9cc3-4f1a-8344-001a5378e936-kube-api-access-dkkz6\") pod \"kube-auth-proxy-78f945c984-kf4jq\" (UID: \"abedeecc-9cc3-4f1a-8344-001a5378e936\") " pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:31.852539 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.852503 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-wtknj"] Jun 15 06:33:31.856056 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.856012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:31.858335 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.858311 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 15 06:33:31.858451 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.858380 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-78lfz\"" Jun 15 06:33:31.869655 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.869631 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-wtknj"] Jun 15 06:33:31.912779 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.912741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3da1fc8-6a5f-4a9e-8610-a4346beb562e-cert\") pod \"odh-model-controller-6dc94f689f-wtknj\" (UID: \"f3da1fc8-6a5f-4a9e-8610-a4346beb562e\") " pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:31.912779 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:31.912774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-469pc\" (UniqueName: \"kubernetes.io/projected/f3da1fc8-6a5f-4a9e-8610-a4346beb562e-kube-api-access-469pc\") pod \"odh-model-controller-6dc94f689f-wtknj\" (UID: \"f3da1fc8-6a5f-4a9e-8610-a4346beb562e\") " pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:32.013345 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.013310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3da1fc8-6a5f-4a9e-8610-a4346beb562e-cert\") pod \"odh-model-controller-6dc94f689f-wtknj\" (UID: \"f3da1fc8-6a5f-4a9e-8610-a4346beb562e\") " pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:32.013345 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.013350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-469pc\" (UniqueName: \"kubernetes.io/projected/f3da1fc8-6a5f-4a9e-8610-a4346beb562e-kube-api-access-469pc\") pod \"odh-model-controller-6dc94f689f-wtknj\" (UID: \"f3da1fc8-6a5f-4a9e-8610-a4346beb562e\") " pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:32.013586 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.013429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abedeecc-9cc3-4f1a-8344-001a5378e936-tls-certs\") pod \"kube-auth-proxy-78f945c984-kf4jq\" (UID: \"abedeecc-9cc3-4f1a-8344-001a5378e936\") " pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:32.013636 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:33:32.013602 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 15 06:33:32.013682 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:33:32.013663 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3da1fc8-6a5f-4a9e-8610-a4346beb562e-cert podName:f3da1fc8-6a5f-4a9e-8610-a4346beb562e nodeName:}" failed. No retries permitted until 2026-06-15 06:33:32.513644692 +0000 UTC m=+464.809171953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3da1fc8-6a5f-4a9e-8610-a4346beb562e-cert") pod "odh-model-controller-6dc94f689f-wtknj" (UID: "f3da1fc8-6a5f-4a9e-8610-a4346beb562e") : secret "odh-model-controller-webhook-cert" not found Jun 15 06:33:32.016150 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.016122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abedeecc-9cc3-4f1a-8344-001a5378e936-tls-certs\") pod \"kube-auth-proxy-78f945c984-kf4jq\" (UID: \"abedeecc-9cc3-4f1a-8344-001a5378e936\") " pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:32.022469 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.022442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-469pc\" (UniqueName: \"kubernetes.io/projected/f3da1fc8-6a5f-4a9e-8610-a4346beb562e-kube-api-access-469pc\") pod \"odh-model-controller-6dc94f689f-wtknj\" (UID: \"f3da1fc8-6a5f-4a9e-8610-a4346beb562e\") " pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:32.240106 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.239997 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" Jun 15 06:33:32.385235 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.385208 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78f945c984-kf4jq"] Jun 15 06:33:32.387541 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:33:32.387508 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabedeecc_9cc3_4f1a_8344_001a5378e936.slice/crio-fa4b309329e46d6f116743cb3ab50cfa4dc4a294d98a8f5287add8d569f5f9be WatchSource:0}: Error finding container fa4b309329e46d6f116743cb3ab50cfa4dc4a294d98a8f5287add8d569f5f9be: Status 404 returned error can't find the container with id fa4b309329e46d6f116743cb3ab50cfa4dc4a294d98a8f5287add8d569f5f9be Jun 15 06:33:32.519111 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.519026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3da1fc8-6a5f-4a9e-8610-a4346beb562e-cert\") pod \"odh-model-controller-6dc94f689f-wtknj\" (UID: \"f3da1fc8-6a5f-4a9e-8610-a4346beb562e\") " pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:32.521416 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.521383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3da1fc8-6a5f-4a9e-8610-a4346beb562e-cert\") pod \"odh-model-controller-6dc94f689f-wtknj\" (UID: \"f3da1fc8-6a5f-4a9e-8610-a4346beb562e\") " pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:32.617242 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.617203 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-m8ksl"] Jun 15 06:33:32.619976 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.619958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" Jun 15 06:33:32.621684 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.621663 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 15 06:33:32.637602 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.637570 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-m8ksl"] Jun 15 06:33:32.720390 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.720348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ptg4\" (UniqueName: \"kubernetes.io/projected/53f2d478-c056-4d13-85cc-36daa2e0360f-kube-api-access-9ptg4\") pod \"model-serving-api-5dd488fc48-m8ksl\" (UID: \"53f2d478-c056-4d13-85cc-36daa2e0360f\") " pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" Jun 15 06:33:32.720575 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.720401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53f2d478-c056-4d13-85cc-36daa2e0360f-tls-certs\") pod \"model-serving-api-5dd488fc48-m8ksl\" (UID: \"53f2d478-c056-4d13-85cc-36daa2e0360f\") " pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" Jun 15 06:33:32.767413 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.767311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:32.822453 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.821638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptg4\" (UniqueName: \"kubernetes.io/projected/53f2d478-c056-4d13-85cc-36daa2e0360f-kube-api-access-9ptg4\") pod \"model-serving-api-5dd488fc48-m8ksl\" (UID: \"53f2d478-c056-4d13-85cc-36daa2e0360f\") " pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" Jun 15 06:33:32.822453 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.821706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53f2d478-c056-4d13-85cc-36daa2e0360f-tls-certs\") pod \"model-serving-api-5dd488fc48-m8ksl\" (UID: \"53f2d478-c056-4d13-85cc-36daa2e0360f\") " pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" Jun 15 06:33:32.830360 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.830082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ptg4\" (UniqueName: \"kubernetes.io/projected/53f2d478-c056-4d13-85cc-36daa2e0360f-kube-api-access-9ptg4\") pod \"model-serving-api-5dd488fc48-m8ksl\" (UID: \"53f2d478-c056-4d13-85cc-36daa2e0360f\") " pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" Jun 15 06:33:32.830836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.830807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53f2d478-c056-4d13-85cc-36daa2e0360f-tls-certs\") pod \"model-serving-api-5dd488fc48-m8ksl\" (UID: \"53f2d478-c056-4d13-85cc-36daa2e0360f\") " pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" Jun 15 06:33:32.932742 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.932664 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" Jun 15 06:33:32.939986 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:32.939941 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-wtknj"] Jun 15 06:33:32.945688 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:33:32.945643 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3da1fc8_6a5f_4a9e_8610_a4346beb562e.slice/crio-4f948f5e415df0aee47abab4264dd8d1028d00f62d86ec2f2b654bffe9dd4031 WatchSource:0}: Error finding container 4f948f5e415df0aee47abab4264dd8d1028d00f62d86ec2f2b654bffe9dd4031: Status 404 returned error can't find the container with id 4f948f5e415df0aee47abab4264dd8d1028d00f62d86ec2f2b654bffe9dd4031 Jun 15 06:33:33.081478 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.081380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" event={"ID":"f3da1fc8-6a5f-4a9e-8610-a4346beb562e","Type":"ContainerStarted","Data":"4f948f5e415df0aee47abab4264dd8d1028d00f62d86ec2f2b654bffe9dd4031"} Jun 15 06:33:33.083776 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.083738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" event={"ID":"abedeecc-9cc3-4f1a-8344-001a5378e936","Type":"ContainerStarted","Data":"fa4b309329e46d6f116743cb3ab50cfa4dc4a294d98a8f5287add8d569f5f9be"} Jun 15 06:33:33.109196 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.109042 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-m8ksl"] Jun 15 06:33:33.115786 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:33:33.115752 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f2d478_c056_4d13_85cc_36daa2e0360f.slice/crio-bcbf4cc18a4cd67d2d64e3e8e43db46a082b373deb710ab0da5c2b96fabafdd5 WatchSource:0}: Error finding container bcbf4cc18a4cd67d2d64e3e8e43db46a082b373deb710ab0da5c2b96fabafdd5: Status 404 returned error can't find the container with id bcbf4cc18a4cd67d2d64e3e8e43db46a082b373deb710ab0da5c2b96fabafdd5 Jun 15 06:33:33.158100 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.158062 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw"] Jun 15 06:33:33.163405 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.163377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.165884 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.165780 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw8gs\"" Jun 15 06:33:33.166507 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.166312 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 06:33:33.166507 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.166312 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 06:33:33.169331 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.169300 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw"] Jun 15 06:33:33.225755 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.225715 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.225985 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.225782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rh5w\" (UniqueName: \"kubernetes.io/projected/cbaec853-4905-415d-8139-c551233904c0-kube-api-access-2rh5w\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.225985 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.225811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.327053 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.326973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.327053 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.327045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rh5w\" (UniqueName: \"kubernetes.io/projected/cbaec853-4905-415d-8139-c551233904c0-kube-api-access-2rh5w\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.327410 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.327373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.327490 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.327433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.327710 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.327685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.335325 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.335290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rh5w\" (UniqueName: \"kubernetes.io/projected/cbaec853-4905-415d-8139-c551233904c0-kube-api-access-2rh5w\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.479757 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.479716 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:33.638050 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:33.637969 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw"] Jun 15 06:33:34.091901 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:34.091827 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" event={"ID":"53f2d478-c056-4d13-85cc-36daa2e0360f","Type":"ContainerStarted","Data":"bcbf4cc18a4cd67d2d64e3e8e43db46a082b373deb710ab0da5c2b96fabafdd5"} Jun 15 06:33:34.475592 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:33:34.475506 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbaec853_4905_415d_8139_c551233904c0.slice/crio-6d968b55669ccb00b40b35d7e8e622e4d6661ea30dffc3ca16872702cc11ac44 WatchSource:0}: Error finding container 6d968b55669ccb00b40b35d7e8e622e4d6661ea30dffc3ca16872702cc11ac44: Status 404 returned error can't find the container with id 6d968b55669ccb00b40b35d7e8e622e4d6661ea30dffc3ca16872702cc11ac44 Jun 15 06:33:35.099706 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:35.099667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" event={"ID":"cbaec853-4905-415d-8139-c551233904c0","Type":"ContainerStarted","Data":"6d968b55669ccb00b40b35d7e8e622e4d6661ea30dffc3ca16872702cc11ac44"} Jun 15 06:33:37.113166 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:37.113127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" event={"ID":"f3da1fc8-6a5f-4a9e-8610-a4346beb562e","Type":"ContainerStarted","Data":"cd85a01c93f5f9a2a3fa017d48f584749e43ee2f279358d421ff1c9eef102170"} Jun 15 06:33:37.113644 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:37.113251 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:37.114999 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:37.114968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" event={"ID":"abedeecc-9cc3-4f1a-8344-001a5378e936","Type":"ContainerStarted","Data":"81ccf0d1216e13ae2b6ff47bdbbf1ec9015ead11680ebf55ac3436c98b2f3d6b"} Jun 15 06:33:37.116826 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:37.116799 2576 generic.go:356] "Generic (PLEG): container finished" podID="cbaec853-4905-415d-8139-c551233904c0" containerID="957d414c6cf0e1fe6f0c32e782110f4a110936290dec79b63099f436c4ec8397" exitCode=0 Jun 15 06:33:37.116935 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:37.116842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" event={"ID":"cbaec853-4905-415d-8139-c551233904c0","Type":"ContainerDied","Data":"957d414c6cf0e1fe6f0c32e782110f4a110936290dec79b63099f436c4ec8397"} Jun 15 06:33:37.128991 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:37.128932 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" podStartSLOduration=2.617854378 podStartE2EDuration="6.128910382s" totalImagesPullingTime="3.511056004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:33:37.126908752 +0000 UTC m=+469.422436041" watchObservedRunningTime="2026-06-15 06:33:37.128910382 +0000 UTC m=+469.424437653" Jun 15 06:33:37.158640 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:37.158579 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78f945c984-kf4jq" podStartSLOduration=2.100782258 podStartE2EDuration="6.15855635s" totalImagesPullingTime="4.057774092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:33:37.156179211 +0000 UTC m=+469.451706488" watchObservedRunningTime="2026-06-15 06:33:37.15855635 +0000 UTC m=+469.454083628" Jun 15 06:33:39.130043 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:39.130009 2576 generic.go:356] "Generic (PLEG): container finished" podID="cbaec853-4905-415d-8139-c551233904c0" containerID="a0ef731e3f65313e5f9f4b8cf7cdbb4140e68a5693c70a10433053870ed515da" exitCode=0 Jun 15 06:33:39.130529 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:39.130072 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" event={"ID":"cbaec853-4905-415d-8139-c551233904c0","Type":"ContainerDied","Data":"a0ef731e3f65313e5f9f4b8cf7cdbb4140e68a5693c70a10433053870ed515da"} Jun 15 06:33:39.131590 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:39.131559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" event={"ID":"53f2d478-c056-4d13-85cc-36daa2e0360f","Type":"ContainerStarted","Data":"ff9d26eadf88e1881fa3bdae2819c98f3d06bcb75405a0a7b8a27c91ef9cf031"} Jun 15 06:33:39.131721 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:39.131636 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" Jun 15 06:33:39.182173 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:39.182123 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" podStartSLOduration=1.938530595 podStartE2EDuration="7.182106813s" totalImagesPullingTime="5.243576218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:33:39.180274075 +0000 UTC m=+471.475801350" watchObservedRunningTime="2026-06-15 06:33:39.182106813 +0000 UTC m=+471.477634141" Jun 15 06:33:40.139480 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:40.139446 2576 generic.go:356] "Generic (PLEG): container finished" podID="cbaec853-4905-415d-8139-c551233904c0" containerID="423aa75243f73e199c671013c7830f0b973467a51fbced2af1a9ba2b0b4630db" exitCode=0 Jun 15 06:33:40.141006 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:40.140983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" event={"ID":"cbaec853-4905-415d-8139-c551233904c0","Type":"ContainerDied","Data":"423aa75243f73e199c671013c7830f0b973467a51fbced2af1a9ba2b0b4630db"} Jun 15 06:33:41.278283 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:41.278259 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:41.404678 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:41.404572 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-bundle\") pod \"cbaec853-4905-415d-8139-c551233904c0\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " Jun 15 06:33:41.404919 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:41.404709 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-util\") pod \"cbaec853-4905-415d-8139-c551233904c0\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " Jun 15 06:33:41.404919 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:41.404734 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rh5w\" (UniqueName: \"kubernetes.io/projected/cbaec853-4905-415d-8139-c551233904c0-kube-api-access-2rh5w\") pod \"cbaec853-4905-415d-8139-c551233904c0\" (UID: \"cbaec853-4905-415d-8139-c551233904c0\") " Jun 15 06:33:41.405622 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:41.405593 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-bundle" (OuterVolumeSpecName: "bundle") pod "cbaec853-4905-415d-8139-c551233904c0" (UID: "cbaec853-4905-415d-8139-c551233904c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:33:41.412988 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:41.412954 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-util" (OuterVolumeSpecName: "util") pod "cbaec853-4905-415d-8139-c551233904c0" (UID: "cbaec853-4905-415d-8139-c551233904c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:33:41.416420 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:41.416391 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbaec853-4905-415d-8139-c551233904c0-kube-api-access-2rh5w" (OuterVolumeSpecName: "kube-api-access-2rh5w") pod "cbaec853-4905-415d-8139-c551233904c0" (UID: "cbaec853-4905-415d-8139-c551233904c0"). InnerVolumeSpecName "kube-api-access-2rh5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:33:41.505495 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:41.505459 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-util\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:33:41.505495 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:41.505492 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rh5w\" (UniqueName: \"kubernetes.io/projected/cbaec853-4905-415d-8139-c551233904c0-kube-api-access-2rh5w\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:33:41.505495 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:41.505502 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbaec853-4905-415d-8139-c551233904c0-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:33:42.051057 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.051020 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lw5hr"] Jun 15 06:33:42.051365 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.051353 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbaec853-4905-415d-8139-c551233904c0" containerName="extract" Jun 15 06:33:42.051410 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.051367 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbaec853-4905-415d-8139-c551233904c0" containerName="extract" Jun 15 06:33:42.051410 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.051383 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbaec853-4905-415d-8139-c551233904c0" containerName="util" Jun 15 06:33:42.051410 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.051389 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbaec853-4905-415d-8139-c551233904c0" containerName="util" Jun 15 06:33:42.051410 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.051404 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbaec853-4905-415d-8139-c551233904c0" containerName="pull" Jun 15 06:33:42.051410 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.051410 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbaec853-4905-415d-8139-c551233904c0" containerName="pull" Jun 15 06:33:42.051561 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.051467 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbaec853-4905-415d-8139-c551233904c0" containerName="extract" Jun 15 06:33:42.054634 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.054617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:33:42.058303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.058277 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-54jtn\"" Jun 15 06:33:42.059098 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.059081 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 15 06:33:42.070709 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.070680 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx"] Jun 15 06:33:42.074491 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.074473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:33:42.079060 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.079038 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 15 06:33:42.079239 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.079209 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bffbh\"" Jun 15 06:33:42.082934 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.082910 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lw5hr"] Jun 15 06:33:42.109349 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.109303 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx"] Jun 15 06:33:42.110406 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.110340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m82kx\" (UniqueName: \"kubernetes.io/projected/e3cb71a0-5121-4d97-a75a-4ad878de0132-kube-api-access-m82kx\") pod \"kserve-controller-manager-69fc866d76-lw5hr\" (UID: \"e3cb71a0-5121-4d97-a75a-4ad878de0132\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:33:42.110551 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.110491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3cb71a0-5121-4d97-a75a-4ad878de0132-cert\") pod \"kserve-controller-manager-69fc866d76-lw5hr\" (UID: \"e3cb71a0-5121-4d97-a75a-4ad878de0132\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:33:42.152631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.152607 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" Jun 15 06:33:42.152631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.152615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mjlgw" event={"ID":"cbaec853-4905-415d-8139-c551233904c0","Type":"ContainerDied","Data":"6d968b55669ccb00b40b35d7e8e622e4d6661ea30dffc3ca16872702cc11ac44"} Jun 15 06:33:42.152789 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.152661 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d968b55669ccb00b40b35d7e8e622e4d6661ea30dffc3ca16872702cc11ac44" Jun 15 06:33:42.211446 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.211374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/404df091-72ac-4ce9-99d8-9b79a65052be-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxndx\" (UID: \"404df091-72ac-4ce9-99d8-9b79a65052be\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:33:42.211446 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.211450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m82kx\" (UniqueName: \"kubernetes.io/projected/e3cb71a0-5121-4d97-a75a-4ad878de0132-kube-api-access-m82kx\") pod \"kserve-controller-manager-69fc866d76-lw5hr\" (UID: \"e3cb71a0-5121-4d97-a75a-4ad878de0132\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:33:42.211729 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.211597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3cb71a0-5121-4d97-a75a-4ad878de0132-cert\") pod \"kserve-controller-manager-69fc866d76-lw5hr\" (UID: \"e3cb71a0-5121-4d97-a75a-4ad878de0132\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:33:42.211729 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.211625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55wzj\" (UniqueName: \"kubernetes.io/projected/404df091-72ac-4ce9-99d8-9b79a65052be-kube-api-access-55wzj\") pod \"llmisvc-controller-manager-864bfd7bc9-kxndx\" (UID: \"404df091-72ac-4ce9-99d8-9b79a65052be\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:33:42.211840 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:33:42.211752 2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 15 06:33:42.211840 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:33:42.211839 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cb71a0-5121-4d97-a75a-4ad878de0132-cert podName:e3cb71a0-5121-4d97-a75a-4ad878de0132 nodeName:}" failed. No retries permitted until 2026-06-15 06:33:42.711815896 +0000 UTC m=+475.007343157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e3cb71a0-5121-4d97-a75a-4ad878de0132-cert") pod "kserve-controller-manager-69fc866d76-lw5hr" (UID: "e3cb71a0-5121-4d97-a75a-4ad878de0132") : secret "kserve-webhook-server-cert" not found Jun 15 06:33:42.224217 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.224185 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m82kx\" (UniqueName: \"kubernetes.io/projected/e3cb71a0-5121-4d97-a75a-4ad878de0132-kube-api-access-m82kx\") pod \"kserve-controller-manager-69fc866d76-lw5hr\" (UID: \"e3cb71a0-5121-4d97-a75a-4ad878de0132\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:33:42.312492 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.312457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/404df091-72ac-4ce9-99d8-9b79a65052be-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxndx\" (UID: \"404df091-72ac-4ce9-99d8-9b79a65052be\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:33:42.312949 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:33:42.312618 2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 15 06:33:42.312949 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:33:42.312679 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/404df091-72ac-4ce9-99d8-9b79a65052be-cert podName:404df091-72ac-4ce9-99d8-9b79a65052be nodeName:}" failed. No retries permitted until 2026-06-15 06:33:42.812664472 +0000 UTC m=+475.108191726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/404df091-72ac-4ce9-99d8-9b79a65052be-cert") pod "llmisvc-controller-manager-864bfd7bc9-kxndx" (UID: "404df091-72ac-4ce9-99d8-9b79a65052be") : secret "llmisvc-webhook-server-cert" not found Jun 15 06:33:42.312949 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.312673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55wzj\" (UniqueName: \"kubernetes.io/projected/404df091-72ac-4ce9-99d8-9b79a65052be-kube-api-access-55wzj\") pod \"llmisvc-controller-manager-864bfd7bc9-kxndx\" (UID: \"404df091-72ac-4ce9-99d8-9b79a65052be\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:33:42.324450 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.324415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55wzj\" (UniqueName: \"kubernetes.io/projected/404df091-72ac-4ce9-99d8-9b79a65052be-kube-api-access-55wzj\") pod \"llmisvc-controller-manager-864bfd7bc9-kxndx\" (UID: \"404df091-72ac-4ce9-99d8-9b79a65052be\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:33:42.716649 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.716548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3cb71a0-5121-4d97-a75a-4ad878de0132-cert\") pod \"kserve-controller-manager-69fc866d76-lw5hr\" (UID: \"e3cb71a0-5121-4d97-a75a-4ad878de0132\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:33:42.719088 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.719063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3cb71a0-5121-4d97-a75a-4ad878de0132-cert\") pod \"kserve-controller-manager-69fc866d76-lw5hr\" (UID: \"e3cb71a0-5121-4d97-a75a-4ad878de0132\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:33:42.817455 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.817414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/404df091-72ac-4ce9-99d8-9b79a65052be-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxndx\" (UID: \"404df091-72ac-4ce9-99d8-9b79a65052be\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:33:42.819883 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.819843 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/404df091-72ac-4ce9-99d8-9b79a65052be-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxndx\" (UID: \"404df091-72ac-4ce9-99d8-9b79a65052be\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:33:42.965205 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.965156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:33:42.985249 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:42.985220 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:33:43.127361 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:43.127311 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lw5hr"] Jun 15 06:33:43.130794 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:33:43.130768 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3cb71a0_5121_4d97_a75a_4ad878de0132.slice/crio-fbd07cd59c5c5c0f7cb51bd8d7af2e4273a1dd0c1fb8c5cc7305b632918bf02f WatchSource:0}: Error finding container fbd07cd59c5c5c0f7cb51bd8d7af2e4273a1dd0c1fb8c5cc7305b632918bf02f: Status 404 returned error can't find the container with id fbd07cd59c5c5c0f7cb51bd8d7af2e4273a1dd0c1fb8c5cc7305b632918bf02f Jun 15 06:33:43.147274 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:43.147245 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx"] Jun 15 06:33:43.149270 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:33:43.149237 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod404df091_72ac_4ce9_99d8_9b79a65052be.slice/crio-2f1016dece17aa5d6c8f21ce61c1c48c07b355b64d30f364b2d6fc8c82b0385a WatchSource:0}: Error finding container 2f1016dece17aa5d6c8f21ce61c1c48c07b355b64d30f364b2d6fc8c82b0385a: Status 404 returned error can't find the container with id 2f1016dece17aa5d6c8f21ce61c1c48c07b355b64d30f364b2d6fc8c82b0385a Jun 15 06:33:43.159201 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:43.159169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" event={"ID":"e3cb71a0-5121-4d97-a75a-4ad878de0132","Type":"ContainerStarted","Data":"fbd07cd59c5c5c0f7cb51bd8d7af2e4273a1dd0c1fb8c5cc7305b632918bf02f"} Jun 15 06:33:43.160338 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:43.160310 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" event={"ID":"404df091-72ac-4ce9-99d8-9b79a65052be","Type":"ContainerStarted","Data":"2f1016dece17aa5d6c8f21ce61c1c48c07b355b64d30f364b2d6fc8c82b0385a"} Jun 15 06:33:47.184620 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:47.184582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" event={"ID":"404df091-72ac-4ce9-99d8-9b79a65052be","Type":"ContainerStarted","Data":"be128c81363827c33f89a087d5f4424722348625ded425e6ef305f10eb21a26f"} Jun 15 06:33:47.185121 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:47.184648 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:33:47.186275 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:47.186247 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" event={"ID":"e3cb71a0-5121-4d97-a75a-4ad878de0132","Type":"ContainerStarted","Data":"7c3f76822bb154179d11b55d14fa87bd65da6a1536c10514c16a3635c0488c2a"} Jun 15 06:33:47.186401 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:47.186337 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:33:47.201855 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:47.201795 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" podStartSLOduration=1.857306877 podStartE2EDuration="5.201780405s" totalImagesPullingTime="3.344473528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:33:47.200079889 +0000 UTC m=+479.495607166" watchObservedRunningTime="2026-06-15 06:33:47.201780405 +0000 UTC m=+479.497307680" Jun 15 06:33:47.216979 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:47.216929 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" podStartSLOduration=1.851757891 podStartE2EDuration="5.216911607s" totalImagesPullingTime="3.365153716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:33:47.216037894 +0000 UTC m=+479.511565169" watchObservedRunningTime="2026-06-15 06:33:47.216911607 +0000 UTC m=+479.512438883" Jun 15 06:33:48.125509 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:48.125478 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-wtknj" Jun 15 06:33:50.145194 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:50.145166 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-m8ksl" Jun 15 06:33:52.065170 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.065128 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h"] Jun 15 06:33:52.075628 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.075599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.078775 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.078752 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 06:33:52.078924 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.078857 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw8gs\"" Jun 15 06:33:52.079138 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.079124 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 06:33:52.102692 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.102654 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h"] Jun 15 06:33:52.202709 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.202673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g77nr\" (UniqueName: \"kubernetes.io/projected/f1c757e3-d74b-4611-a66f-fd22f181b16c-kube-api-access-g77nr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.202852 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.202729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.202852 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.202829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.304264 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.304227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.304440 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.304296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.304440 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.304350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g77nr\" (UniqueName: \"kubernetes.io/projected/f1c757e3-d74b-4611-a66f-fd22f181b16c-kube-api-access-g77nr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.304631 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.304609 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.304747 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.304727 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.314797 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.314769 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g77nr\" (UniqueName: \"kubernetes.io/projected/f1c757e3-d74b-4611-a66f-fd22f181b16c-kube-api-access-g77nr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.385103 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.385009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:52.539451 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:52.539418 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h"] Jun 15 06:33:52.542208 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:33:52.542162 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c757e3_d74b_4611_a66f_fd22f181b16c.slice/crio-c5a33efa66ac458d1b52ef59f39acaac11d7c78ccc4d7ce986e4b25a808f7403 WatchSource:0}: Error finding container c5a33efa66ac458d1b52ef59f39acaac11d7c78ccc4d7ce986e4b25a808f7403: Status 404 returned error can't find the container with id c5a33efa66ac458d1b52ef59f39acaac11d7c78ccc4d7ce986e4b25a808f7403 Jun 15 06:33:53.218670 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.218630 2576 generic.go:356] "Generic (PLEG): container finished" podID="f1c757e3-d74b-4611-a66f-fd22f181b16c" containerID="13bbbbd6ab9b76377015b9ed00961b033cd0d5226704ac1d81292dfc86f663ae" exitCode=0 Jun 15 06:33:53.219097 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.218710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" event={"ID":"f1c757e3-d74b-4611-a66f-fd22f181b16c","Type":"ContainerDied","Data":"13bbbbd6ab9b76377015b9ed00961b033cd0d5226704ac1d81292dfc86f663ae"} Jun 15 06:33:53.219097 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.218753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" event={"ID":"f1c757e3-d74b-4611-a66f-fd22f181b16c","Type":"ContainerStarted","Data":"c5a33efa66ac458d1b52ef59f39acaac11d7c78ccc4d7ce986e4b25a808f7403"} Jun 15 06:33:53.310525 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.310483 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w"] Jun 15 06:33:53.313067 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.313052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" Jun 15 06:33:53.317519 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.317491 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-2ktsv\"" Jun 15 06:33:53.317882 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.317856 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 15 06:33:53.317982 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.317963 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 15 06:33:53.332657 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.332627 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w"] Jun 15 06:33:53.414197 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.414155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj29v\" (UniqueName: \"kubernetes.io/projected/e9a347f4-7186-438a-af34-3cb3ea44ffb7-kube-api-access-gj29v\") pod \"servicemesh-operator3-57f65f65fb-mgr4w\" (UID: \"e9a347f4-7186-438a-af34-3cb3ea44ffb7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" Jun 15 06:33:53.414375 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.414236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e9a347f4-7186-438a-af34-3cb3ea44ffb7-operator-config\") pod \"servicemesh-operator3-57f65f65fb-mgr4w\" (UID: \"e9a347f4-7186-438a-af34-3cb3ea44ffb7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" Jun 15 06:33:53.515635 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.515542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e9a347f4-7186-438a-af34-3cb3ea44ffb7-operator-config\") pod \"servicemesh-operator3-57f65f65fb-mgr4w\" (UID: \"e9a347f4-7186-438a-af34-3cb3ea44ffb7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" Jun 15 06:33:53.515635 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.515607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj29v\" (UniqueName: \"kubernetes.io/projected/e9a347f4-7186-438a-af34-3cb3ea44ffb7-kube-api-access-gj29v\") pod \"servicemesh-operator3-57f65f65fb-mgr4w\" (UID: \"e9a347f4-7186-438a-af34-3cb3ea44ffb7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" Jun 15 06:33:53.518250 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.518222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e9a347f4-7186-438a-af34-3cb3ea44ffb7-operator-config\") pod \"servicemesh-operator3-57f65f65fb-mgr4w\" (UID: \"e9a347f4-7186-438a-af34-3cb3ea44ffb7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" Jun 15 06:33:53.523200 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.523177 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj29v\" (UniqueName: \"kubernetes.io/projected/e9a347f4-7186-438a-af34-3cb3ea44ffb7-kube-api-access-gj29v\") pod \"servicemesh-operator3-57f65f65fb-mgr4w\" (UID: \"e9a347f4-7186-438a-af34-3cb3ea44ffb7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" Jun 15 06:33:53.629637 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.629593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" Jun 15 06:33:53.804541 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:53.804442 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w"] Jun 15 06:33:53.809393 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:33:53.809370 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a347f4_7186_438a_af34_3cb3ea44ffb7.slice/crio-a9dd500b5191a0dff7def77e96bcc272f11cd2d44d4ce5f2c08df0864741b5ca WatchSource:0}: Error finding container a9dd500b5191a0dff7def77e96bcc272f11cd2d44d4ce5f2c08df0864741b5ca: Status 404 returned error can't find the container with id a9dd500b5191a0dff7def77e96bcc272f11cd2d44d4ce5f2c08df0864741b5ca Jun 15 06:33:54.226168 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:54.226134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" event={"ID":"e9a347f4-7186-438a-af34-3cb3ea44ffb7","Type":"ContainerStarted","Data":"a9dd500b5191a0dff7def77e96bcc272f11cd2d44d4ce5f2c08df0864741b5ca"} Jun 15 06:33:55.233323 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:55.233253 2576 generic.go:356] "Generic (PLEG): container finished" podID="f1c757e3-d74b-4611-a66f-fd22f181b16c" containerID="9f794118b6ee39ae855d20f9a9bcb94cf2f57c1e93388ea68ae1a5c60f8b89f1" exitCode=0 Jun 15 06:33:55.233323 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:55.233303 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" event={"ID":"f1c757e3-d74b-4611-a66f-fd22f181b16c","Type":"ContainerDied","Data":"9f794118b6ee39ae855d20f9a9bcb94cf2f57c1e93388ea68ae1a5c60f8b89f1"} Jun 15 06:33:56.241358 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:56.241321 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" event={"ID":"f1c757e3-d74b-4611-a66f-fd22f181b16c","Type":"ContainerStarted","Data":"9daad1498e113685efcec6b4e9edb3c5a7240768ce2c3aea4e5cb29b6230d096"} Jun 15 06:33:56.243726 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:56.243682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" event={"ID":"e9a347f4-7186-438a-af34-3cb3ea44ffb7","Type":"ContainerStarted","Data":"a813bfcda4cb4fa8eb515570c77f44eacb89f6113984fcf190039ae92f0e50d8"} Jun 15 06:33:56.243858 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:56.243781 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" Jun 15 06:33:56.269279 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:56.269029 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" podStartSLOduration=3.094387076 podStartE2EDuration="4.268998714s" totalImagesPullingTime="1.174611638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:33:56.264277411 +0000 UTC m=+488.559804685" watchObservedRunningTime="2026-06-15 06:33:56.268998714 +0000 UTC m=+488.564525986" Jun 15 06:33:56.284436 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:56.284374 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" podStartSLOduration=0.940810916 podStartE2EDuration="3.284353588s" totalImagesPullingTime="2.343542672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:33:56.282011758 +0000 UTC m=+488.577539035" watchObservedRunningTime="2026-06-15 06:33:56.284353588 +0000 UTC m=+488.579880864" Jun 15 06:33:57.251120 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:57.251076 2576 generic.go:356] "Generic (PLEG): container finished" podID="f1c757e3-d74b-4611-a66f-fd22f181b16c" containerID="9daad1498e113685efcec6b4e9edb3c5a7240768ce2c3aea4e5cb29b6230d096" exitCode=0 Jun 15 06:33:57.251479 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:57.251152 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" event={"ID":"f1c757e3-d74b-4611-a66f-fd22f181b16c","Type":"ContainerDied","Data":"9daad1498e113685efcec6b4e9edb3c5a7240768ce2c3aea4e5cb29b6230d096"} Jun 15 06:33:58.397027 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:58.396999 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:33:58.566959 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:58.566925 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-bundle\") pod \"f1c757e3-d74b-4611-a66f-fd22f181b16c\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " Jun 15 06:33:58.567150 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:58.566987 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g77nr\" (UniqueName: \"kubernetes.io/projected/f1c757e3-d74b-4611-a66f-fd22f181b16c-kube-api-access-g77nr\") pod \"f1c757e3-d74b-4611-a66f-fd22f181b16c\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " Jun 15 06:33:58.567150 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:58.567008 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-util\") pod \"f1c757e3-d74b-4611-a66f-fd22f181b16c\" (UID: \"f1c757e3-d74b-4611-a66f-fd22f181b16c\") " Jun 15 06:33:58.567797 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:58.567770 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-bundle" (OuterVolumeSpecName: "bundle") pod "f1c757e3-d74b-4611-a66f-fd22f181b16c" (UID: "f1c757e3-d74b-4611-a66f-fd22f181b16c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:33:58.569142 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:58.569117 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1c757e3-d74b-4611-a66f-fd22f181b16c-kube-api-access-g77nr" (OuterVolumeSpecName: "kube-api-access-g77nr") pod "f1c757e3-d74b-4611-a66f-fd22f181b16c" (UID: "f1c757e3-d74b-4611-a66f-fd22f181b16c"). InnerVolumeSpecName "kube-api-access-g77nr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:33:58.572482 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:58.572442 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-util" (OuterVolumeSpecName: "util") pod "f1c757e3-d74b-4611-a66f-fd22f181b16c" (UID: "f1c757e3-d74b-4611-a66f-fd22f181b16c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:33:58.668323 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:58.668279 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:33:58.668323 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:58.668315 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g77nr\" (UniqueName: \"kubernetes.io/projected/f1c757e3-d74b-4611-a66f-fd22f181b16c-kube-api-access-g77nr\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:33:58.668323 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:58.668329 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1c757e3-d74b-4611-a66f-fd22f181b16c-util\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:33:59.263756 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:59.263713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" event={"ID":"f1c757e3-d74b-4611-a66f-fd22f181b16c","Type":"ContainerDied","Data":"c5a33efa66ac458d1b52ef59f39acaac11d7c78ccc4d7ce986e4b25a808f7403"} Jun 15 06:33:59.263943 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:59.263776 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5a33efa66ac458d1b52ef59f39acaac11d7c78ccc4d7ce986e4b25a808f7403" Jun 15 06:33:59.263943 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:33:59.263731 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8pz8h" Jun 15 06:34:01.636929 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.636893 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v"] Jun 15 06:34:01.637480 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.637401 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c757e3-d74b-4611-a66f-fd22f181b16c" containerName="util" Jun 15 06:34:01.637480 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.637419 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c757e3-d74b-4611-a66f-fd22f181b16c" containerName="util" Jun 15 06:34:01.637480 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.637438 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c757e3-d74b-4611-a66f-fd22f181b16c" containerName="pull" Jun 15 06:34:01.637480 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.637444 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c757e3-d74b-4611-a66f-fd22f181b16c" containerName="pull" Jun 15 06:34:01.637480 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.637467 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c757e3-d74b-4611-a66f-fd22f181b16c" containerName="extract" Jun 15 06:34:01.637480 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.637476 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c757e3-d74b-4611-a66f-fd22f181b16c" containerName="extract" Jun 15 06:34:01.637731 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.637538 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c757e3-d74b-4611-a66f-fd22f181b16c" containerName="extract" Jun 15 06:34:01.642136 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.642114 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" Jun 15 06:34:01.644247 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.644231 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-v588s\"" Jun 15 06:34:01.644490 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.644476 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 15 06:34:01.650326 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.650293 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v"] Jun 15 06:34:01.794835 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.794791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/168d2a05-1f4e-46f1-88d0-a0bc021605bb-redirect-config\") pod \"dashboard-redirect-5c65f9d4c5-t6g5v\" (UID: \"168d2a05-1f4e-46f1-88d0-a0bc021605bb\") " pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" Jun 15 06:34:01.795031 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.794842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxblh\" (UniqueName: \"kubernetes.io/projected/168d2a05-1f4e-46f1-88d0-a0bc021605bb-kube-api-access-kxblh\") pod \"dashboard-redirect-5c65f9d4c5-t6g5v\" (UID: \"168d2a05-1f4e-46f1-88d0-a0bc021605bb\") " pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" Jun 15 06:34:01.895629 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.895541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxblh\" (UniqueName: \"kubernetes.io/projected/168d2a05-1f4e-46f1-88d0-a0bc021605bb-kube-api-access-kxblh\") pod \"dashboard-redirect-5c65f9d4c5-t6g5v\" (UID: \"168d2a05-1f4e-46f1-88d0-a0bc021605bb\") " pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" Jun 15 06:34:01.895783 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.895638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/168d2a05-1f4e-46f1-88d0-a0bc021605bb-redirect-config\") pod \"dashboard-redirect-5c65f9d4c5-t6g5v\" (UID: \"168d2a05-1f4e-46f1-88d0-a0bc021605bb\") " pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" Jun 15 06:34:01.896311 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.896292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/168d2a05-1f4e-46f1-88d0-a0bc021605bb-redirect-config\") pod \"dashboard-redirect-5c65f9d4c5-t6g5v\" (UID: \"168d2a05-1f4e-46f1-88d0-a0bc021605bb\") " pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" Jun 15 06:34:01.902822 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.902793 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxblh\" (UniqueName: \"kubernetes.io/projected/168d2a05-1f4e-46f1-88d0-a0bc021605bb-kube-api-access-kxblh\") pod \"dashboard-redirect-5c65f9d4c5-t6g5v\" (UID: \"168d2a05-1f4e-46f1-88d0-a0bc021605bb\") " pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" Jun 15 06:34:01.954590 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:01.954556 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" Jun 15 06:34:02.089758 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:02.089732 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v"] Jun 15 06:34:02.091659 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:34:02.091631 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168d2a05_1f4e_46f1_88d0_a0bc021605bb.slice/crio-525945ae9b1f1f62e67723807c577a2da99e137df0078600732efe89315ae0c5 WatchSource:0}: Error finding container 525945ae9b1f1f62e67723807c577a2da99e137df0078600732efe89315ae0c5: Status 404 returned error can't find the container with id 525945ae9b1f1f62e67723807c577a2da99e137df0078600732efe89315ae0c5 Jun 15 06:34:02.280472 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:02.280381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" event={"ID":"168d2a05-1f4e-46f1-88d0-a0bc021605bb","Type":"ContainerStarted","Data":"525945ae9b1f1f62e67723807c577a2da99e137df0078600732efe89315ae0c5"} Jun 15 06:34:04.293086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:04.292993 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" event={"ID":"168d2a05-1f4e-46f1-88d0-a0bc021605bb","Type":"ContainerStarted","Data":"a74730233f3dcc2bbf8e0808b8735f42d8037d8ec3793eca1a0e0f79ec7d1c7b"} Jun 15 06:34:07.253898 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:07.253842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mgr4w" Jun 15 06:34:07.273707 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:07.273656 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5c65f9d4c5-t6g5v" podStartSLOduration=4.447537983 podStartE2EDuration="6.273641118s" totalImagesPullingTime="1.826103135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:34:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:34:04.323815708 +0000 UTC m=+496.619342984" watchObservedRunningTime="2026-06-15 06:34:07.273641118 +0000 UTC m=+499.569168433" Jun 15 06:34:17.462551 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.462503 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn"] Jun 15 06:34:17.473166 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.473139 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.476444 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.476416 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 06:34:17.476592 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.476416 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 15 06:34:17.476592 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.476416 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 15 06:34:17.476727 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.476712 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 15 06:34:17.476787 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.476750 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nqtb7\"" Jun 15 06:34:17.477559 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.477531 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn"] Jun 15 06:34:17.532923 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.532891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.533114 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.532934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d024c8-d2ae-433e-91ab-f99ebe5f915e-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.533114 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.532971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84d024c8-d2ae-433e-91ab-f99ebe5f915e-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.533114 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.532990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.533114 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.533012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.533114 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.533026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkscc\" (UniqueName: \"kubernetes.io/projected/84d024c8-d2ae-433e-91ab-f99ebe5f915e-kube-api-access-nkscc\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.533114 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.533045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.634225 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.634183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.634225 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.634230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.634494 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.634325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkscc\" (UniqueName: \"kubernetes.io/projected/84d024c8-d2ae-433e-91ab-f99ebe5f915e-kube-api-access-nkscc\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.634494 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.634350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.634494 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.634393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.634494 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.634420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d024c8-d2ae-433e-91ab-f99ebe5f915e-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.634494 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.634475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84d024c8-d2ae-433e-91ab-f99ebe5f915e-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.635463 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.635429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.636838 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.636807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.636972 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.636850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84d024c8-d2ae-433e-91ab-f99ebe5f915e-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.637086 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.637062 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d024c8-d2ae-433e-91ab-f99ebe5f915e-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.637189 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.637174 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.641840 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.641805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d024c8-d2ae-433e-91ab-f99ebe5f915e-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.642077 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.642060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkscc\" (UniqueName: \"kubernetes.io/projected/84d024c8-d2ae-433e-91ab-f99ebe5f915e-kube-api-access-nkscc\") pod \"istiod-openshift-gateway-75c67f8887-bqlmn\" (UID: \"84d024c8-d2ae-433e-91ab-f99ebe5f915e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.785075 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.784982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:17.928352 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:17.928315 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn"] Jun 15 06:34:17.930368 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:34:17.930339 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d024c8_d2ae_433e_91ab_f99ebe5f915e.slice/crio-ce0deb3e34f1056b6da4b58d1fdaa51295ff5c2272de32542b6def9711b1ad23 WatchSource:0}: Error finding container ce0deb3e34f1056b6da4b58d1fdaa51295ff5c2272de32542b6def9711b1ad23: Status 404 returned error can't find the container with id ce0deb3e34f1056b6da4b58d1fdaa51295ff5c2272de32542b6def9711b1ad23 Jun 15 06:34:18.194072 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:18.194044 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxndx" Jun 15 06:34:18.196983 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:18.196960 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lw5hr" Jun 15 06:34:18.373885 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:18.373840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" event={"ID":"84d024c8-d2ae-433e-91ab-f99ebe5f915e","Type":"ContainerStarted","Data":"ce0deb3e34f1056b6da4b58d1fdaa51295ff5c2272de32542b6def9711b1ad23"} Jun 15 06:34:24.939057 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:24.939012 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 06:34:24.939367 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:24.939087 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 06:34:25.416656 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:25.416612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" event={"ID":"84d024c8-d2ae-433e-91ab-f99ebe5f915e","Type":"ContainerStarted","Data":"ef06edae747e941ce734d69ecf09877e06a70300261dde6b4dbe347cb235e61e"} Jun 15 06:34:25.416899 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:25.416757 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:25.436881 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:25.436802 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" podStartSLOduration=1.43814705 podStartE2EDuration="8.436783691s" totalImagesPullingTime="6.998636641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:34:25.435347248 +0000 UTC m=+517.730874526" watchObservedRunningTime="2026-06-15 06:34:25.436783691 +0000 UTC m=+517.732310976" Jun 15 06:34:26.424676 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:26.424643 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bqlmn" Jun 15 06:34:48.417528 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.417441 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228"] Jun 15 06:34:48.428951 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.428922 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228"] Jun 15 06:34:48.429113 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.429002 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.431118 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.431090 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 06:34:48.431397 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.431119 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 06:34:48.431548 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.431133 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lmqjd\"" Jun 15 06:34:48.508506 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.508465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.508686 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.508513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prv97\" (UniqueName: \"kubernetes.io/projected/7bcb6314-aec9-4e7b-aaac-d2f74001074c-kube-api-access-prv97\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.508686 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.508639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.609646 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.609594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.609826 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.609679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.609826 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.609711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prv97\" (UniqueName: \"kubernetes.io/projected/7bcb6314-aec9-4e7b-aaac-d2f74001074c-kube-api-access-prv97\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.610022 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.610001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.610062 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.610048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.617427 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.617398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prv97\" (UniqueName: \"kubernetes.io/projected/7bcb6314-aec9-4e7b-aaac-d2f74001074c-kube-api-access-prv97\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.739462 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.739367 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:48.874407 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:48.874375 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228"] Jun 15 06:34:48.875828 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:34:48.875799 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bcb6314_aec9_4e7b_aaac_d2f74001074c.slice/crio-86d7220757a14b4cdcf8e5779ddda67c1356144835fe9e3d8ff667dbdc70f21d WatchSource:0}: Error finding container 86d7220757a14b4cdcf8e5779ddda67c1356144835fe9e3d8ff667dbdc70f21d: Status 404 returned error can't find the container with id 86d7220757a14b4cdcf8e5779ddda67c1356144835fe9e3d8ff667dbdc70f21d Jun 15 06:34:49.213163 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.213120 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr"] Jun 15 06:34:49.216815 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.216790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.224290 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.224258 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr"] Jun 15 06:34:49.315985 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.315951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.316170 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.316054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-922ht\" (UniqueName: \"kubernetes.io/projected/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-kube-api-access-922ht\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.316170 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.316086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.416928 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.416894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-922ht\" (UniqueName: \"kubernetes.io/projected/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-kube-api-access-922ht\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.417110 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.416943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.417153 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.417120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.417357 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.417341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.417443 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.417424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.424704 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.424681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-922ht\" (UniqueName: \"kubernetes.io/projected/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-kube-api-access-922ht\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.528078 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.527988 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:49.553246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.553209 2576 generic.go:356] "Generic (PLEG): container finished" podID="7bcb6314-aec9-4e7b-aaac-d2f74001074c" containerID="465502bad6adf2946053ab5846bf4214650012fd560eb0d5aba2add15e59cccd" exitCode=0 Jun 15 06:34:49.553398 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.553290 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" event={"ID":"7bcb6314-aec9-4e7b-aaac-d2f74001074c","Type":"ContainerDied","Data":"465502bad6adf2946053ab5846bf4214650012fd560eb0d5aba2add15e59cccd"} Jun 15 06:34:49.553398 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.553343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" event={"ID":"7bcb6314-aec9-4e7b-aaac-d2f74001074c","Type":"ContainerStarted","Data":"86d7220757a14b4cdcf8e5779ddda67c1356144835fe9e3d8ff667dbdc70f21d"} Jun 15 06:34:49.670466 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.670437 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr"] Jun 15 06:34:49.672096 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:34:49.672070 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d8a9c8_6eb8_4e02_9023_35a3b1072cd3.slice/crio-2f8dec9c6768ea1f8d86f0be7ae853ad92243b86646eaa4f91ef3119809d4ef1 WatchSource:0}: Error finding container 2f8dec9c6768ea1f8d86f0be7ae853ad92243b86646eaa4f91ef3119809d4ef1: Status 404 returned error can't find the container with id 2f8dec9c6768ea1f8d86f0be7ae853ad92243b86646eaa4f91ef3119809d4ef1 Jun 15 06:34:49.824687 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.824649 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh"] Jun 15 06:34:49.828422 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.828402 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:49.836595 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.836565 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh"] Jun 15 06:34:49.923673 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.923628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:49.923911 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.923740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:49.923911 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:49.923792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jslp\" (UniqueName: \"kubernetes.io/projected/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-kube-api-access-4jslp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:50.024737 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.024702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jslp\" (UniqueName: \"kubernetes.io/projected/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-kube-api-access-4jslp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:50.024942 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.024761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:50.024942 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.024818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:50.025165 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.025142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:50.025214 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.025175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:50.032890 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.032841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jslp\" (UniqueName: \"kubernetes.io/projected/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-kube-api-access-4jslp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:50.138965 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.138931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:50.216604 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.216566 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs"] Jun 15 06:34:50.221429 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.221403 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.246204 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.246173 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs"] Jun 15 06:34:50.322224 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.322198 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh"] Jun 15 06:34:50.327361 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.327330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.327492 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.327376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8fvl\" (UniqueName: \"kubernetes.io/projected/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-kube-api-access-d8fvl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.327588 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.327556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.359886 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:34:50.359841 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6fe78a5_c28a_489a_b67f_b3c1c40140f1.slice/crio-fbb1b7b51ee90e204766600102cfff739262861e541cabad40d9c871cc09c6c4 WatchSource:0}: Error finding container fbb1b7b51ee90e204766600102cfff739262861e541cabad40d9c871cc09c6c4: Status 404 returned error can't find the container with id fbb1b7b51ee90e204766600102cfff739262861e541cabad40d9c871cc09c6c4 Jun 15 06:34:50.428599 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.428570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.429084 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.428654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.429084 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.428687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8fvl\" (UniqueName: \"kubernetes.io/projected/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-kube-api-access-d8fvl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.429084 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.428989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.429084 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.429019 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.436268 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.436242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8fvl\" (UniqueName: \"kubernetes.io/projected/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-kube-api-access-d8fvl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.548063 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.548025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:50.560905 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.560858 2576 generic.go:356] "Generic (PLEG): container finished" podID="7bcb6314-aec9-4e7b-aaac-d2f74001074c" containerID="7761cca8b06e2f59cb5a1965748db6e3d6c8f9cacc304c13511f7ea32e896608" exitCode=0 Jun 15 06:34:50.561018 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.560914 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" event={"ID":"7bcb6314-aec9-4e7b-aaac-d2f74001074c","Type":"ContainerDied","Data":"7761cca8b06e2f59cb5a1965748db6e3d6c8f9cacc304c13511f7ea32e896608"} Jun 15 06:34:50.562463 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.562437 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6fe78a5-c28a-489a-b67f-b3c1c40140f1" containerID="aab0087c7bc668b75e266556a44fa422aa42f8594ed93ea5b36667e02cf214d5" exitCode=0 Jun 15 06:34:50.562601 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.562500 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" event={"ID":"f6fe78a5-c28a-489a-b67f-b3c1c40140f1","Type":"ContainerDied","Data":"aab0087c7bc668b75e266556a44fa422aa42f8594ed93ea5b36667e02cf214d5"} Jun 15 06:34:50.562601 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.562563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" event={"ID":"f6fe78a5-c28a-489a-b67f-b3c1c40140f1","Type":"ContainerStarted","Data":"fbb1b7b51ee90e204766600102cfff739262861e541cabad40d9c871cc09c6c4"} Jun 15 06:34:50.564452 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.564427 2576 generic.go:356] "Generic (PLEG): container finished" podID="e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" containerID="98a86056db0b6f6333750f3372c95308de6ecebb2914510ddcce30d65db232d6" exitCode=0 Jun 15 06:34:50.564572 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.564460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" event={"ID":"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3","Type":"ContainerDied","Data":"98a86056db0b6f6333750f3372c95308de6ecebb2914510ddcce30d65db232d6"} Jun 15 06:34:50.564572 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.564490 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" event={"ID":"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3","Type":"ContainerStarted","Data":"2f8dec9c6768ea1f8d86f0be7ae853ad92243b86646eaa4f91ef3119809d4ef1"} Jun 15 06:34:50.696949 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:50.696921 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs"] Jun 15 06:34:50.698361 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:34:50.698330 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed92e11_723f_4e13_9f0a_e1d04d6da27d.slice/crio-5aa7864a6a9c0e8c7e193456d8de4918409e358f98061112e06110c3aace5950 WatchSource:0}: Error finding container 5aa7864a6a9c0e8c7e193456d8de4918409e358f98061112e06110c3aace5950: Status 404 returned error can't find the container with id 5aa7864a6a9c0e8c7e193456d8de4918409e358f98061112e06110c3aace5950 Jun 15 06:34:51.571733 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:51.571694 2576 generic.go:356] "Generic (PLEG): container finished" podID="7ed92e11-723f-4e13-9f0a-e1d04d6da27d" containerID="fa057dad8075106bf170c77e2fe59b825dc8b15721e5ce9fae5cf23648497d0a" exitCode=0 Jun 15 06:34:51.572144 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:51.571778 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" event={"ID":"7ed92e11-723f-4e13-9f0a-e1d04d6da27d","Type":"ContainerDied","Data":"fa057dad8075106bf170c77e2fe59b825dc8b15721e5ce9fae5cf23648497d0a"} Jun 15 06:34:51.572144 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:51.571839 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" event={"ID":"7ed92e11-723f-4e13-9f0a-e1d04d6da27d","Type":"ContainerStarted","Data":"5aa7864a6a9c0e8c7e193456d8de4918409e358f98061112e06110c3aace5950"} Jun 15 06:34:51.574262 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:51.574234 2576 generic.go:356] "Generic (PLEG): container finished" podID="7bcb6314-aec9-4e7b-aaac-d2f74001074c" containerID="81bc2d666b86367e5a6e926a1100e12ba58de653cff62af628ff466fb43c59e4" exitCode=0 Jun 15 06:34:51.574389 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:51.574297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" event={"ID":"7bcb6314-aec9-4e7b-aaac-d2f74001074c","Type":"ContainerDied","Data":"81bc2d666b86367e5a6e926a1100e12ba58de653cff62af628ff466fb43c59e4"} Jun 15 06:34:51.576334 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:51.576310 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6fe78a5-c28a-489a-b67f-b3c1c40140f1" containerID="15288624d469c1a8aa208b8299255fcaf4f14b77e77cf92c0cf0d39355ffb1a1" exitCode=0 Jun 15 06:34:51.576442 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:51.576373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" event={"ID":"f6fe78a5-c28a-489a-b67f-b3c1c40140f1","Type":"ContainerDied","Data":"15288624d469c1a8aa208b8299255fcaf4f14b77e77cf92c0cf0d39355ffb1a1"} Jun 15 06:34:51.578327 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:51.578305 2576 generic.go:356] "Generic (PLEG): container finished" podID="e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" containerID="eee824429be1a09bebbbdd23386799e0fe41bf6fa7da3fd76b87d499273ce727" exitCode=0 Jun 15 06:34:51.578416 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:51.578383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" event={"ID":"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3","Type":"ContainerDied","Data":"eee824429be1a09bebbbdd23386799e0fe41bf6fa7da3fd76b87d499273ce727"} Jun 15 06:34:52.593820 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.593783 2576 generic.go:356] "Generic (PLEG): container finished" podID="7ed92e11-723f-4e13-9f0a-e1d04d6da27d" containerID="6a94f75cf1a3d50f51dbbe20fe4349dc9eaefe12302dedf47efea44a24a0e034" exitCode=0 Jun 15 06:34:52.594285 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.593882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" event={"ID":"7ed92e11-723f-4e13-9f0a-e1d04d6da27d","Type":"ContainerDied","Data":"6a94f75cf1a3d50f51dbbe20fe4349dc9eaefe12302dedf47efea44a24a0e034"} Jun 15 06:34:52.596263 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.596239 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6fe78a5-c28a-489a-b67f-b3c1c40140f1" containerID="2cd44e3ca8bc9c8691ca29ccb9cea989efa8136394a518893ba3feb4a299998a" exitCode=0 Jun 15 06:34:52.596364 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.596308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" event={"ID":"f6fe78a5-c28a-489a-b67f-b3c1c40140f1","Type":"ContainerDied","Data":"2cd44e3ca8bc9c8691ca29ccb9cea989efa8136394a518893ba3feb4a299998a"} Jun 15 06:34:52.598468 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.598444 2576 generic.go:356] "Generic (PLEG): container finished" podID="e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" containerID="02df3aa04bbf28ec3dd883c53719696c76cd172c6f0df796d1ac79018a3d9730" exitCode=0 Jun 15 06:34:52.598568 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.598529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" event={"ID":"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3","Type":"ContainerDied","Data":"02df3aa04bbf28ec3dd883c53719696c76cd172c6f0df796d1ac79018a3d9730"} Jun 15 06:34:52.814473 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.814445 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:52.954470 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.954381 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-bundle\") pod \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " Jun 15 06:34:52.954677 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.954498 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prv97\" (UniqueName: \"kubernetes.io/projected/7bcb6314-aec9-4e7b-aaac-d2f74001074c-kube-api-access-prv97\") pod \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " Jun 15 06:34:52.954677 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.954539 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-util\") pod \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\" (UID: \"7bcb6314-aec9-4e7b-aaac-d2f74001074c\") " Jun 15 06:34:52.954977 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.954951 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-bundle" (OuterVolumeSpecName: "bundle") pod "7bcb6314-aec9-4e7b-aaac-d2f74001074c" (UID: "7bcb6314-aec9-4e7b-aaac-d2f74001074c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:34:52.956803 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.956776 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bcb6314-aec9-4e7b-aaac-d2f74001074c-kube-api-access-prv97" (OuterVolumeSpecName: "kube-api-access-prv97") pod "7bcb6314-aec9-4e7b-aaac-d2f74001074c" (UID: "7bcb6314-aec9-4e7b-aaac-d2f74001074c"). InnerVolumeSpecName "kube-api-access-prv97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:34:52.959747 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:52.959702 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-util" (OuterVolumeSpecName: "util") pod "7bcb6314-aec9-4e7b-aaac-d2f74001074c" (UID: "7bcb6314-aec9-4e7b-aaac-d2f74001074c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:34:53.055681 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.055634 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prv97\" (UniqueName: \"kubernetes.io/projected/7bcb6314-aec9-4e7b-aaac-d2f74001074c-kube-api-access-prv97\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:53.055681 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.055674 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-util\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:53.055681 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.055686 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bcb6314-aec9-4e7b-aaac-d2f74001074c-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:53.607333 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.607294 2576 generic.go:356] "Generic (PLEG): container finished" podID="7ed92e11-723f-4e13-9f0a-e1d04d6da27d" containerID="3e55a3fbddce7a111605c5494702ae6a9db09369f96da7e6057567498a71469a" exitCode=0 Jun 15 06:34:53.607724 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.607380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" event={"ID":"7ed92e11-723f-4e13-9f0a-e1d04d6da27d","Type":"ContainerDied","Data":"3e55a3fbddce7a111605c5494702ae6a9db09369f96da7e6057567498a71469a"} Jun 15 06:34:53.609157 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.609135 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" Jun 15 06:34:53.609266 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.609164 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228" event={"ID":"7bcb6314-aec9-4e7b-aaac-d2f74001074c","Type":"ContainerDied","Data":"86d7220757a14b4cdcf8e5779ddda67c1356144835fe9e3d8ff667dbdc70f21d"} Jun 15 06:34:53.609266 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.609199 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86d7220757a14b4cdcf8e5779ddda67c1356144835fe9e3d8ff667dbdc70f21d" Jun 15 06:34:53.748742 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.748716 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:53.783457 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.783429 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:53.863407 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.863319 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-bundle\") pod \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " Jun 15 06:34:53.863407 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.863384 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-util\") pod \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " Jun 15 06:34:53.863695 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.863458 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-922ht\" (UniqueName: \"kubernetes.io/projected/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-kube-api-access-922ht\") pod \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\" (UID: \"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3\") " Jun 15 06:34:53.864004 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.863961 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-bundle" (OuterVolumeSpecName: "bundle") pod "e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" (UID: "e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:34:53.865517 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.865493 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-kube-api-access-922ht" (OuterVolumeSpecName: "kube-api-access-922ht") pod "e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" (UID: "e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3"). InnerVolumeSpecName "kube-api-access-922ht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:34:53.869139 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.869102 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-util" (OuterVolumeSpecName: "util") pod "e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" (UID: "e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:34:53.964054 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.964014 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jslp\" (UniqueName: \"kubernetes.io/projected/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-kube-api-access-4jslp\") pod \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " Jun 15 06:34:53.964235 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.964093 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-util\") pod \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " Jun 15 06:34:53.964235 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.964210 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-bundle\") pod \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\" (UID: \"f6fe78a5-c28a-489a-b67f-b3c1c40140f1\") " Jun 15 06:34:53.964474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.964457 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-922ht\" (UniqueName: \"kubernetes.io/projected/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-kube-api-access-922ht\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:53.964540 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.964481 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:53.964540 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.964491 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3-util\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:53.964735 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.964699 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-bundle" (OuterVolumeSpecName: "bundle") pod "f6fe78a5-c28a-489a-b67f-b3c1c40140f1" (UID: "f6fe78a5-c28a-489a-b67f-b3c1c40140f1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:34:53.966269 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.966246 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-kube-api-access-4jslp" (OuterVolumeSpecName: "kube-api-access-4jslp") pod "f6fe78a5-c28a-489a-b67f-b3c1c40140f1" (UID: "f6fe78a5-c28a-489a-b67f-b3c1c40140f1"). InnerVolumeSpecName "kube-api-access-4jslp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:34:53.969410 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:53.969374 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-util" (OuterVolumeSpecName: "util") pod "f6fe78a5-c28a-489a-b67f-b3c1c40140f1" (UID: "f6fe78a5-c28a-489a-b67f-b3c1c40140f1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:34:54.065103 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.065073 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:54.065103 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.065099 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jslp\" (UniqueName: \"kubernetes.io/projected/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-kube-api-access-4jslp\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:54.065103 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.065109 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6fe78a5-c28a-489a-b67f-b3c1c40140f1-util\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:54.616168 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.616133 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" Jun 15 06:34:54.616596 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.616133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh" event={"ID":"f6fe78a5-c28a-489a-b67f-b3c1c40140f1","Type":"ContainerDied","Data":"fbb1b7b51ee90e204766600102cfff739262861e541cabad40d9c871cc09c6c4"} Jun 15 06:34:54.616596 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.616256 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbb1b7b51ee90e204766600102cfff739262861e541cabad40d9c871cc09c6c4" Jun 15 06:34:54.618073 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.618033 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" Jun 15 06:34:54.618209 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.618105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr" event={"ID":"e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3","Type":"ContainerDied","Data":"2f8dec9c6768ea1f8d86f0be7ae853ad92243b86646eaa4f91ef3119809d4ef1"} Jun 15 06:34:54.618209 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.618147 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f8dec9c6768ea1f8d86f0be7ae853ad92243b86646eaa4f91ef3119809d4ef1" Jun 15 06:34:54.755432 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.755407 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:34:54.871123 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.871023 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8fvl\" (UniqueName: \"kubernetes.io/projected/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-kube-api-access-d8fvl\") pod \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " Jun 15 06:34:54.871285 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.871205 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-bundle\") pod \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " Jun 15 06:34:54.871285 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.871228 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-util\") pod \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\" (UID: \"7ed92e11-723f-4e13-9f0a-e1d04d6da27d\") " Jun 15 06:34:54.871658 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.871633 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-bundle" (OuterVolumeSpecName: "bundle") pod "7ed92e11-723f-4e13-9f0a-e1d04d6da27d" (UID: "7ed92e11-723f-4e13-9f0a-e1d04d6da27d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:34:54.873186 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.873162 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-kube-api-access-d8fvl" (OuterVolumeSpecName: "kube-api-access-d8fvl") pod "7ed92e11-723f-4e13-9f0a-e1d04d6da27d" (UID: "7ed92e11-723f-4e13-9f0a-e1d04d6da27d"). InnerVolumeSpecName "kube-api-access-d8fvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:34:54.876796 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.876770 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-util" (OuterVolumeSpecName: "util") pod "7ed92e11-723f-4e13-9f0a-e1d04d6da27d" (UID: "7ed92e11-723f-4e13-9f0a-e1d04d6da27d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:34:54.972352 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.972310 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8fvl\" (UniqueName: \"kubernetes.io/projected/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-kube-api-access-d8fvl\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:54.972352 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.972345 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:54.972352 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:54.972355 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ed92e11-723f-4e13-9f0a-e1d04d6da27d-util\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:34:55.625280 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:55.625241 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" event={"ID":"7ed92e11-723f-4e13-9f0a-e1d04d6da27d","Type":"ContainerDied","Data":"5aa7864a6a9c0e8c7e193456d8de4918409e358f98061112e06110c3aace5950"} Jun 15 06:34:55.625663 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:55.625294 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5aa7864a6a9c0e8c7e193456d8de4918409e358f98061112e06110c3aace5950" Jun 15 06:34:55.625663 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:34:55.625254 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs" Jun 15 06:35:14.460409 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460370 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t"] Jun 15 06:35:14.460790 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460739 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ed92e11-723f-4e13-9f0a-e1d04d6da27d" containerName="util" Jun 15 06:35:14.460790 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460750 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ed92e11-723f-4e13-9f0a-e1d04d6da27d" containerName="util" Jun 15 06:35:14.460790 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460761 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" containerName="extract" Jun 15 06:35:14.460790 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460767 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" containerName="extract" Jun 15 06:35:14.460790 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460779 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fe78a5-c28a-489a-b67f-b3c1c40140f1" containerName="util" Jun 15 06:35:14.460790 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460785 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fe78a5-c28a-489a-b67f-b3c1c40140f1" containerName="util" Jun 15 06:35:14.460790 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460791 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bcb6314-aec9-4e7b-aaac-d2f74001074c" containerName="util" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460796 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcb6314-aec9-4e7b-aaac-d2f74001074c" containerName="util" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460803 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bcb6314-aec9-4e7b-aaac-d2f74001074c" containerName="extract" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460808 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcb6314-aec9-4e7b-aaac-d2f74001074c" containerName="extract" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460818 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" containerName="pull" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460823 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" containerName="pull" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460836 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fe78a5-c28a-489a-b67f-b3c1c40140f1" containerName="extract" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460841 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fe78a5-c28a-489a-b67f-b3c1c40140f1" containerName="extract" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460848 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ed92e11-723f-4e13-9f0a-e1d04d6da27d" containerName="extract" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460853 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ed92e11-723f-4e13-9f0a-e1d04d6da27d" containerName="extract" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460859 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bcb6314-aec9-4e7b-aaac-d2f74001074c" containerName="pull" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460863 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcb6314-aec9-4e7b-aaac-d2f74001074c" containerName="pull" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460883 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fe78a5-c28a-489a-b67f-b3c1c40140f1" containerName="pull" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460888 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fe78a5-c28a-489a-b67f-b3c1c40140f1" containerName="pull" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460894 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" containerName="util" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460900 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" containerName="util" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460907 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ed92e11-723f-4e13-9f0a-e1d04d6da27d" containerName="pull" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460912 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ed92e11-723f-4e13-9f0a-e1d04d6da27d" containerName="pull" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460973 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bcb6314-aec9-4e7b-aaac-d2f74001074c" containerName="extract" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460981 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3" containerName="extract" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460988 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ed92e11-723f-4e13-9f0a-e1d04d6da27d" containerName="extract" Jun 15 06:35:14.461044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.460996 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6fe78a5-c28a-489a-b67f-b3c1c40140f1" containerName="extract" Jun 15 06:35:14.463143 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.463127 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:14.465413 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.465386 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qd5kq\"" Jun 15 06:35:14.465413 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.465387 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 06:35:14.465676 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.465661 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 06:35:14.472972 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.472953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t"] Jun 15 06:35:14.546700 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.546657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crsth\" (UniqueName: \"kubernetes.io/projected/89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed-kube-api-access-crsth\") pod \"limitador-operator-controller-manager-859d7b78bd-dqw9t\" (UID: \"89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:14.648120 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.648080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crsth\" (UniqueName: \"kubernetes.io/projected/89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed-kube-api-access-crsth\") pod \"limitador-operator-controller-manager-859d7b78bd-dqw9t\" (UID: \"89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:14.658610 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.658575 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crsth\" (UniqueName: \"kubernetes.io/projected/89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed-kube-api-access-crsth\") pod \"limitador-operator-controller-manager-859d7b78bd-dqw9t\" (UID: \"89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:14.775915 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.775809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:14.914678 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:14.914652 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t"] Jun 15 06:35:14.916385 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:35:14.916360 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d29a4a_a8e7_4e3b_8b67_c99d1bc266ed.slice/crio-71c197a646c2e8a1e8b3d78db531878d70422f308162e86dbac4d6fea3952305 WatchSource:0}: Error finding container 71c197a646c2e8a1e8b3d78db531878d70422f308162e86dbac4d6fea3952305: Status 404 returned error can't find the container with id 71c197a646c2e8a1e8b3d78db531878d70422f308162e86dbac4d6fea3952305 Jun 15 06:35:15.749137 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:15.749098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" event={"ID":"89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed","Type":"ContainerStarted","Data":"71c197a646c2e8a1e8b3d78db531878d70422f308162e86dbac4d6fea3952305"} Jun 15 06:35:17.526761 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:17.526424 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55d9864dfc-nw9k4"] Jun 15 06:35:17.762296 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:17.762262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" event={"ID":"89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed","Type":"ContainerStarted","Data":"f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce"} Jun 15 06:35:17.762473 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:17.762353 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:17.778979 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:17.778855 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" podStartSLOduration=1.866273524 podStartE2EDuration="3.778838546s" totalImagesPullingTime="1.912565022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:35:17.776124824 +0000 UTC m=+570.071652100" watchObservedRunningTime="2026-06-15 06:35:17.778838546 +0000 UTC m=+570.074365822" Jun 15 06:35:28.770684 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:28.770649 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:33.344313 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.344279 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t"] Jun 15 06:35:33.344828 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.344527 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" podUID="89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" containerName="manager" containerID="cri-o://f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce" gracePeriod=2 Jun 15 06:35:33.354538 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.354509 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t"] Jun 15 06:35:33.370315 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.370285 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58"] Jun 15 06:35:33.370692 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.370679 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" containerName="manager" Jun 15 06:35:33.370735 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.370695 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" containerName="manager" Jun 15 06:35:33.370770 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.370759 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" containerName="manager" Jun 15 06:35:33.376780 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.376497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58" Jun 15 06:35:33.396520 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.396484 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58"] Jun 15 06:35:33.409325 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:35:33.409286 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dqw9t\" is forbidden: User \"system:node:ip-10-0-140-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-165.ec2.internal' and this object" podUID="89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:33.518998 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.518856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvbng\" (UniqueName: \"kubernetes.io/projected/1e00db1d-83c0-465e-b145-6800508a9d18-kube-api-access-rvbng\") pod \"limitador-operator-controller-manager-859d7b78bd-q6r58\" (UID: \"1e00db1d-83c0-465e-b145-6800508a9d18\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58" Jun 15 06:35:33.590899 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.590854 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:33.595352 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:35:33.595298 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dqw9t\" is forbidden: User \"system:node:ip-10-0-140-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-165.ec2.internal' and this object" podUID="89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:33.619587 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.619557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvbng\" (UniqueName: \"kubernetes.io/projected/1e00db1d-83c0-465e-b145-6800508a9d18-kube-api-access-rvbng\") pod \"limitador-operator-controller-manager-859d7b78bd-q6r58\" (UID: \"1e00db1d-83c0-465e-b145-6800508a9d18\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58" Jun 15 06:35:33.633154 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.633119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvbng\" (UniqueName: \"kubernetes.io/projected/1e00db1d-83c0-465e-b145-6800508a9d18-kube-api-access-rvbng\") pod \"limitador-operator-controller-manager-859d7b78bd-q6r58\" (UID: \"1e00db1d-83c0-465e-b145-6800508a9d18\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58" Jun 15 06:35:33.720080 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.720046 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crsth\" (UniqueName: \"kubernetes.io/projected/89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed-kube-api-access-crsth\") pod \"89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed\" (UID: \"89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed\") " Jun 15 06:35:33.722130 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.722098 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed-kube-api-access-crsth" (OuterVolumeSpecName: "kube-api-access-crsth") pod "89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" (UID: "89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed"). InnerVolumeSpecName "kube-api-access-crsth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:35:33.723212 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.723194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58" Jun 15 06:35:33.821119 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.821078 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crsth\" (UniqueName: \"kubernetes.io/projected/89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed-kube-api-access-crsth\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:35:33.858937 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.858827 2576 generic.go:356] "Generic (PLEG): container finished" podID="89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" containerID="f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce" exitCode=0 Jun 15 06:35:33.858937 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.858904 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:33.859168 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.858957 2576 scope.go:117] "RemoveContainer" containerID="f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce" Jun 15 06:35:33.862028 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:35:33.861990 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dqw9t\" is forbidden: User \"system:node:ip-10-0-140-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-165.ec2.internal' and this object" podUID="89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:33.871536 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:35:33.871491 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dqw9t\" is forbidden: User \"system:node:ip-10-0-140-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-165.ec2.internal' and this object" podUID="89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dqw9t" Jun 15 06:35:33.871607 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.871573 2576 scope.go:117] "RemoveContainer" containerID="f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce" Jun 15 06:35:33.871860 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:35:33.871842 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce\": container with ID starting with f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce not found: ID does not exist" containerID="f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce" Jun 15 06:35:33.871949 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.871891 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce"} err="failed to get container status \"f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce\": rpc error: code = NotFound desc = could not find container \"f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce\": container with ID starting with f0659b9c4a96ce566ac82cf46d66c92763d8d4f76c3e486173207395aeac65ce not found: ID does not exist" Jun 15 06:35:33.915028 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:33.915001 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58"] Jun 15 06:35:33.917518 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:35:33.917491 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e00db1d_83c0_465e_b145_6800508a9d18.slice/crio-d86d31ea6de2826f051db225985961aaf08d1c2e90c57e60229e23fcddfc3f4b WatchSource:0}: Error finding container d86d31ea6de2826f051db225985961aaf08d1c2e90c57e60229e23fcddfc3f4b: Status 404 returned error can't find the container with id d86d31ea6de2826f051db225985961aaf08d1c2e90c57e60229e23fcddfc3f4b Jun 15 06:35:34.142468 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:34.142392 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed" path="/var/lib/kubelet/pods/89d29a4a-a8e7-4e3b-8b67-c99d1bc266ed/volumes" Jun 15 06:35:34.867288 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:34.867259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58" event={"ID":"1e00db1d-83c0-465e-b145-6800508a9d18","Type":"ContainerStarted","Data":"335577cf03925aa6a5b53348958f35e125c137e6ef43cb2aeed94182837edbfd"} Jun 15 06:35:34.867674 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:34.867306 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58" event={"ID":"1e00db1d-83c0-465e-b145-6800508a9d18","Type":"ContainerStarted","Data":"d86d31ea6de2826f051db225985961aaf08d1c2e90c57e60229e23fcddfc3f4b"} Jun 15 06:35:34.867674 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:34.867439 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58" Jun 15 06:35:34.886134 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:34.886084 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58" podStartSLOduration=1.886067101 podStartE2EDuration="1.886067101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:35:34.883742172 +0000 UTC m=+587.179269467" watchObservedRunningTime="2026-06-15 06:35:34.886067101 +0000 UTC m=+587.181594452" Jun 15 06:35:42.548816 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.548766 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55d9864dfc-nw9k4" podUID="f8ced15f-607a-4188-b07c-0a1bdf1fdce5" containerName="console" containerID="cri-o://492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59" gracePeriod=15 Jun 15 06:35:42.805587 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.805520 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:35:42.902102 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902068 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-trusted-ca-bundle\") pod \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " Jun 15 06:35:42.902285 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902111 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kfnx\" (UniqueName: \"kubernetes.io/projected/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-kube-api-access-2kfnx\") pod \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " Jun 15 06:35:42.902285 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902154 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-oauth-serving-cert\") pod \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " Jun 15 06:35:42.902378 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902278 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-service-ca\") pod \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " Jun 15 06:35:42.902378 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902312 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-serving-cert\") pod \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " Jun 15 06:35:42.902490 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902377 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-oauth-config\") pod \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " Jun 15 06:35:42.902490 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902408 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-config\") pod \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\" (UID: \"f8ced15f-607a-4188-b07c-0a1bdf1fdce5\") " Jun 15 06:35:42.902672 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902641 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f8ced15f-607a-4188-b07c-0a1bdf1fdce5" (UID: "f8ced15f-607a-4188-b07c-0a1bdf1fdce5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:35:42.902811 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902745 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-trusted-ca-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:35:42.902968 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902832 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-service-ca" (OuterVolumeSpecName: "service-ca") pod "f8ced15f-607a-4188-b07c-0a1bdf1fdce5" (UID: "f8ced15f-607a-4188-b07c-0a1bdf1fdce5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:35:42.902968 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902933 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f8ced15f-607a-4188-b07c-0a1bdf1fdce5" (UID: "f8ced15f-607a-4188-b07c-0a1bdf1fdce5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:35:42.903088 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.902959 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-config" (OuterVolumeSpecName: "console-config") pod "f8ced15f-607a-4188-b07c-0a1bdf1fdce5" (UID: "f8ced15f-607a-4188-b07c-0a1bdf1fdce5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 06:35:42.904521 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.904498 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-kube-api-access-2kfnx" (OuterVolumeSpecName: "kube-api-access-2kfnx") pod "f8ced15f-607a-4188-b07c-0a1bdf1fdce5" (UID: "f8ced15f-607a-4188-b07c-0a1bdf1fdce5"). InnerVolumeSpecName "kube-api-access-2kfnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:35:42.904949 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.904923 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f8ced15f-607a-4188-b07c-0a1bdf1fdce5" (UID: "f8ced15f-607a-4188-b07c-0a1bdf1fdce5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:35:42.905017 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.904942 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f8ced15f-607a-4188-b07c-0a1bdf1fdce5" (UID: "f8ced15f-607a-4188-b07c-0a1bdf1fdce5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:35:42.915928 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.915901 2576 generic.go:356] "Generic (PLEG): container finished" podID="f8ced15f-607a-4188-b07c-0a1bdf1fdce5" containerID="492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59" exitCode=0 Jun 15 06:35:42.916044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.915945 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d9864dfc-nw9k4" event={"ID":"f8ced15f-607a-4188-b07c-0a1bdf1fdce5","Type":"ContainerDied","Data":"492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59"} Jun 15 06:35:42.916044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.915986 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d9864dfc-nw9k4" event={"ID":"f8ced15f-607a-4188-b07c-0a1bdf1fdce5","Type":"ContainerDied","Data":"d21f760322d4f70a8a3b08eeefe3f7271f8f415523bd20a310587f53e0a807f8"} Jun 15 06:35:42.916044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.916006 2576 scope.go:117] "RemoveContainer" containerID="492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59" Jun 15 06:35:42.916044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.915948 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d9864dfc-nw9k4" Jun 15 06:35:42.926736 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.926718 2576 scope.go:117] "RemoveContainer" containerID="492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59" Jun 15 06:35:42.927089 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:35:42.927069 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59\": container with ID starting with 492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59 not found: ID does not exist" containerID="492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59" Jun 15 06:35:42.927177 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.927097 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59"} err="failed to get container status \"492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59\": rpc error: code = NotFound desc = could not find container \"492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59\": container with ID starting with 492e6a9090a7505673ec64d2edc3976f53de260632f14b99517aae03d7cb8f59 not found: ID does not exist" Jun 15 06:35:42.939929 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.939896 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55d9864dfc-nw9k4"] Jun 15 06:35:42.943711 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:42.943678 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55d9864dfc-nw9k4"] Jun 15 06:35:43.004048 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:43.004014 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-oauth-config\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:35:43.004048 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:43.004044 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-config\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:35:43.004048 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:43.004055 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kfnx\" (UniqueName: \"kubernetes.io/projected/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-kube-api-access-2kfnx\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:35:43.004048 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:43.004063 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-oauth-serving-cert\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:35:43.004326 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:43.004074 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-service-ca\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:35:43.004326 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:43.004084 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8ced15f-607a-4188-b07c-0a1bdf1fdce5-console-serving-cert\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:35:44.142658 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:44.142612 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8ced15f-607a-4188-b07c-0a1bdf1fdce5" path="/var/lib/kubelet/pods/f8ced15f-607a-4188-b07c-0a1bdf1fdce5/volumes" Jun 15 06:35:45.875533 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:45.875501 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6r58" Jun 15 06:35:48.133186 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:48.133159 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:35:48.134304 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:35:48.134274 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:36:04.626115 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.626031 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dsv9z"] Jun 15 06:36:04.626578 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.626450 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ced15f-607a-4188-b07c-0a1bdf1fdce5" containerName="console" Jun 15 06:36:04.626578 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.626461 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ced15f-607a-4188-b07c-0a1bdf1fdce5" containerName="console" Jun 15 06:36:04.626578 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.626516 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8ced15f-607a-4188-b07c-0a1bdf1fdce5" containerName="console" Jun 15 06:36:04.629359 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.629342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dsv9z" Jun 15 06:36:04.631405 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.631383 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jbzsr\"" Jun 15 06:36:04.638463 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.638439 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dsv9z"] Jun 15 06:36:04.689599 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.689561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77tg2\" (UniqueName: \"kubernetes.io/projected/c76070a8-85d1-470b-9d24-f344f9a4f56b-kube-api-access-77tg2\") pod \"authorino-75d556bd77-dsv9z\" (UID: \"c76070a8-85d1-470b-9d24-f344f9a4f56b\") " pod="kuadrant-system/authorino-75d556bd77-dsv9z" Jun 15 06:36:04.791002 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.790962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77tg2\" (UniqueName: \"kubernetes.io/projected/c76070a8-85d1-470b-9d24-f344f9a4f56b-kube-api-access-77tg2\") pod \"authorino-75d556bd77-dsv9z\" (UID: \"c76070a8-85d1-470b-9d24-f344f9a4f56b\") " pod="kuadrant-system/authorino-75d556bd77-dsv9z" Jun 15 06:36:04.798282 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.798250 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77tg2\" (UniqueName: \"kubernetes.io/projected/c76070a8-85d1-470b-9d24-f344f9a4f56b-kube-api-access-77tg2\") pod \"authorino-75d556bd77-dsv9z\" (UID: \"c76070a8-85d1-470b-9d24-f344f9a4f56b\") " pod="kuadrant-system/authorino-75d556bd77-dsv9z" Jun 15 06:36:04.939725 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:04.939631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dsv9z" Jun 15 06:36:05.074927 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:05.074899 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dsv9z"] Jun 15 06:36:05.077003 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:36:05.076971 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc76070a8_85d1_470b_9d24_f344f9a4f56b.slice/crio-ab7d3aebe1a31a6dff53d110ec66d78204b75a579e9d8f203e987f452e7278bb WatchSource:0}: Error finding container ab7d3aebe1a31a6dff53d110ec66d78204b75a579e9d8f203e987f452e7278bb: Status 404 returned error can't find the container with id ab7d3aebe1a31a6dff53d110ec66d78204b75a579e9d8f203e987f452e7278bb Jun 15 06:36:06.057634 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:06.057563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dsv9z" event={"ID":"c76070a8-85d1-470b-9d24-f344f9a4f56b","Type":"ContainerStarted","Data":"ab7d3aebe1a31a6dff53d110ec66d78204b75a579e9d8f203e987f452e7278bb"} Jun 15 06:36:09.078381 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:09.078341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dsv9z" event={"ID":"c76070a8-85d1-470b-9d24-f344f9a4f56b","Type":"ContainerStarted","Data":"31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737"} Jun 15 06:36:09.093837 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:09.093785 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dsv9z" podStartSLOduration=1.7381346789999998 podStartE2EDuration="5.09376892s" totalImagesPullingTime="3.355634241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:36:09.092473798 +0000 UTC m=+621.388001074" watchObservedRunningTime="2026-06-15 06:36:09.09376892 +0000 UTC m=+621.389296195" Jun 15 06:36:36.425304 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.425265 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr"] Jun 15 06:36:36.429122 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.429100 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.431643 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.431614 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 06:36:36.431754 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.431723 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw8gs\"" Jun 15 06:36:36.432037 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.432023 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 06:36:36.437706 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.437683 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr"] Jun 15 06:36:36.581247 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.581208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.581247 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.581251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.581490 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.581374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g29qj\" (UniqueName: \"kubernetes.io/projected/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-kube-api-access-g29qj\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.682806 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.682714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29qj\" (UniqueName: \"kubernetes.io/projected/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-kube-api-access-g29qj\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.682806 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.682802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.683028 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.682836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.683247 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.683227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.683285 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.683249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.699512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.699475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g29qj\" (UniqueName: \"kubernetes.io/projected/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-kube-api-access-g29qj\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.740307 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.740268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:36.876831 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:36.876794 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr"] Jun 15 06:36:36.878082 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:36:36.878057 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2157159_0aaa_4cfa_ad5b_a9f3043ac61c.slice/crio-ed0067f5734b205f1cd340604c100b4bb110b1cf11b6c371a88a6115e66679cf WatchSource:0}: Error finding container ed0067f5734b205f1cd340604c100b4bb110b1cf11b6c371a88a6115e66679cf: Status 404 returned error can't find the container with id ed0067f5734b205f1cd340604c100b4bb110b1cf11b6c371a88a6115e66679cf Jun 15 06:36:37.239102 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:37.239016 2576 generic.go:356] "Generic (PLEG): container finished" podID="b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" containerID="f962af22bfefe5fb4f30f22f1b8fffde7ae9b5e2daef2869a38ab00a1ed33e2d" exitCode=0 Jun 15 06:36:37.239245 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:37.239108 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" event={"ID":"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c","Type":"ContainerDied","Data":"f962af22bfefe5fb4f30f22f1b8fffde7ae9b5e2daef2869a38ab00a1ed33e2d"} Jun 15 06:36:37.239245 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:37.239162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" event={"ID":"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c","Type":"ContainerStarted","Data":"ed0067f5734b205f1cd340604c100b4bb110b1cf11b6c371a88a6115e66679cf"} Jun 15 06:36:38.246752 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:38.246714 2576 generic.go:356] "Generic (PLEG): container finished" podID="b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" containerID="832a55cc192a5ea19e8784664b79510e57ac49fa5e7456944912535c1304a55a" exitCode=0 Jun 15 06:36:38.246752 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:38.246751 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" event={"ID":"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c","Type":"ContainerDied","Data":"832a55cc192a5ea19e8784664b79510e57ac49fa5e7456944912535c1304a55a"} Jun 15 06:36:39.254620 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:39.254574 2576 generic.go:356] "Generic (PLEG): container finished" podID="b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" containerID="50963c33f2673d501cd73c30b703586763d85557b472a20bba2e3be5eaea0e65" exitCode=0 Jun 15 06:36:39.255062 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:39.254661 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" event={"ID":"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c","Type":"ContainerDied","Data":"50963c33f2673d501cd73c30b703586763d85557b472a20bba2e3be5eaea0e65"} Jun 15 06:36:40.407537 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:40.407514 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:40.515822 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:40.515715 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-bundle\") pod \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " Jun 15 06:36:40.515822 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:40.515818 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g29qj\" (UniqueName: \"kubernetes.io/projected/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-kube-api-access-g29qj\") pod \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " Jun 15 06:36:40.516104 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:40.515903 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-util\") pod \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\" (UID: \"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c\") " Jun 15 06:36:40.516215 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:40.516188 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-bundle" (OuterVolumeSpecName: "bundle") pod "b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" (UID: "b2157159-0aaa-4cfa-ad5b-a9f3043ac61c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:36:40.517951 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:40.517927 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-kube-api-access-g29qj" (OuterVolumeSpecName: "kube-api-access-g29qj") pod "b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" (UID: "b2157159-0aaa-4cfa-ad5b-a9f3043ac61c"). InnerVolumeSpecName "kube-api-access-g29qj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:36:40.521577 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:40.521554 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-util" (OuterVolumeSpecName: "util") pod "b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" (UID: "b2157159-0aaa-4cfa-ad5b-a9f3043ac61c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 06:36:40.617284 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:40.617230 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-util\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:36:40.617284 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:40.617279 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-bundle\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:36:40.617284 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:40.617290 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g29qj\" (UniqueName: \"kubernetes.io/projected/b2157159-0aaa-4cfa-ad5b-a9f3043ac61c-kube-api-access-g29qj\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:36:41.267737 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:41.267701 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" event={"ID":"b2157159-0aaa-4cfa-ad5b-a9f3043ac61c","Type":"ContainerDied","Data":"ed0067f5734b205f1cd340604c100b4bb110b1cf11b6c371a88a6115e66679cf"} Jun 15 06:36:41.267914 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:41.267745 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74856rrr" Jun 15 06:36:41.267914 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:36:41.267753 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed0067f5734b205f1cd340604c100b4bb110b1cf11b6c371a88a6115e66679cf" Jun 15 06:37:28.294395 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.294357 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jxj5g"] Jun 15 06:37:28.294813 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.294755 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" containerName="extract" Jun 15 06:37:28.294813 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.294768 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" containerName="extract" Jun 15 06:37:28.294813 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.294783 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" containerName="pull" Jun 15 06:37:28.294813 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.294788 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" containerName="pull" Jun 15 06:37:28.294813 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.294796 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" containerName="util" Jun 15 06:37:28.294813 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.294802 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" containerName="util" Jun 15 06:37:28.295028 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.294880 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2157159-0aaa-4cfa-ad5b-a9f3043ac61c" containerName="extract" Jun 15 06:37:28.298192 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.298174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jxj5g" Jun 15 06:37:28.306339 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.306309 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jxj5g"] Jun 15 06:37:28.442307 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.442269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56qbd\" (UniqueName: \"kubernetes.io/projected/f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3-kube-api-access-56qbd\") pod \"authorino-5d4b67c446-jxj5g\" (UID: \"f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3\") " pod="kuadrant-system/authorino-5d4b67c446-jxj5g" Jun 15 06:37:28.523093 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.523056 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jxj5g"] Jun 15 06:37:28.523366 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:37:28.523343 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-56qbd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-jxj5g" podUID="f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3" Jun 15 06:37:28.543466 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.543424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56qbd\" (UniqueName: \"kubernetes.io/projected/f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3-kube-api-access-56qbd\") pod \"authorino-5d4b67c446-jxj5g\" (UID: \"f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3\") " pod="kuadrant-system/authorino-5d4b67c446-jxj5g" Jun 15 06:37:28.546193 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.546122 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f898bdc55-mzhnr"] Jun 15 06:37:28.549751 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.549730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f898bdc55-mzhnr" Jun 15 06:37:28.551512 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.551486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jxj5g" Jun 15 06:37:28.555634 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.555604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56qbd\" (UniqueName: \"kubernetes.io/projected/f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3-kube-api-access-56qbd\") pod \"authorino-5d4b67c446-jxj5g\" (UID: \"f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3\") " pod="kuadrant-system/authorino-5d4b67c446-jxj5g" Jun 15 06:37:28.562089 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.562057 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f898bdc55-mzhnr"] Jun 15 06:37:28.575814 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.575781 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jxj5g" Jun 15 06:37:28.640735 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.640698 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f898bdc55-mzhnr"] Jun 15 06:37:28.641016 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:37:28.640990 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xmg49], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7f898bdc55-mzhnr" podUID="ec55fb23-1006-4273-bb14-3c86df72dcce" Jun 15 06:37:28.651018 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.650979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmg49\" (UniqueName: \"kubernetes.io/projected/ec55fb23-1006-4273-bb14-3c86df72dcce-kube-api-access-xmg49\") pod \"authorino-7f898bdc55-mzhnr\" (UID: \"ec55fb23-1006-4273-bb14-3c86df72dcce\") " pod="kuadrant-system/authorino-7f898bdc55-mzhnr" Jun 15 06:37:28.752059 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.752021 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56qbd\" (UniqueName: \"kubernetes.io/projected/f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3-kube-api-access-56qbd\") pod \"f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3\" (UID: \"f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3\") " Jun 15 06:37:28.752246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.752160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmg49\" (UniqueName: \"kubernetes.io/projected/ec55fb23-1006-4273-bb14-3c86df72dcce-kube-api-access-xmg49\") pod \"authorino-7f898bdc55-mzhnr\" (UID: \"ec55fb23-1006-4273-bb14-3c86df72dcce\") " pod="kuadrant-system/authorino-7f898bdc55-mzhnr" Jun 15 06:37:28.754500 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.754472 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3-kube-api-access-56qbd" (OuterVolumeSpecName: "kube-api-access-56qbd") pod "f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3" (UID: "f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3"). InnerVolumeSpecName "kube-api-access-56qbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:37:28.760165 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.760139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmg49\" (UniqueName: \"kubernetes.io/projected/ec55fb23-1006-4273-bb14-3c86df72dcce-kube-api-access-xmg49\") pod \"authorino-7f898bdc55-mzhnr\" (UID: \"ec55fb23-1006-4273-bb14-3c86df72dcce\") " pod="kuadrant-system/authorino-7f898bdc55-mzhnr" Jun 15 06:37:28.853244 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:28.853210 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56qbd\" (UniqueName: \"kubernetes.io/projected/f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3-kube-api-access-56qbd\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:37:29.558313 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.558281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jxj5g" Jun 15 06:37:29.558820 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.558281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f898bdc55-mzhnr" Jun 15 06:37:29.566335 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.566314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f898bdc55-mzhnr" Jun 15 06:37:29.600081 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.600045 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jxj5g"] Jun 15 06:37:29.603826 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.603795 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jxj5g"] Jun 15 06:37:29.660432 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.660398 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmg49\" (UniqueName: \"kubernetes.io/projected/ec55fb23-1006-4273-bb14-3c86df72dcce-kube-api-access-xmg49\") pod \"ec55fb23-1006-4273-bb14-3c86df72dcce\" (UID: \"ec55fb23-1006-4273-bb14-3c86df72dcce\") " Jun 15 06:37:29.662506 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.662482 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec55fb23-1006-4273-bb14-3c86df72dcce-kube-api-access-xmg49" (OuterVolumeSpecName: "kube-api-access-xmg49") pod "ec55fb23-1006-4273-bb14-3c86df72dcce" (UID: "ec55fb23-1006-4273-bb14-3c86df72dcce"). InnerVolumeSpecName "kube-api-access-xmg49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:37:29.707038 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.706999 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dsv9z"] Jun 15 06:37:29.707320 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.707203 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dsv9z" podUID="c76070a8-85d1-470b-9d24-f344f9a4f56b" containerName="authorino" containerID="cri-o://31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737" gracePeriod=30 Jun 15 06:37:29.761165 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.761130 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmg49\" (UniqueName: \"kubernetes.io/projected/ec55fb23-1006-4273-bb14-3c86df72dcce-kube-api-access-xmg49\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:37:29.980882 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:29.980840 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dsv9z" Jun 15 06:37:30.064209 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.064173 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77tg2\" (UniqueName: \"kubernetes.io/projected/c76070a8-85d1-470b-9d24-f344f9a4f56b-kube-api-access-77tg2\") pod \"c76070a8-85d1-470b-9d24-f344f9a4f56b\" (UID: \"c76070a8-85d1-470b-9d24-f344f9a4f56b\") " Jun 15 06:37:30.066212 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.066182 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76070a8-85d1-470b-9d24-f344f9a4f56b-kube-api-access-77tg2" (OuterVolumeSpecName: "kube-api-access-77tg2") pod "c76070a8-85d1-470b-9d24-f344f9a4f56b" (UID: "c76070a8-85d1-470b-9d24-f344f9a4f56b"). InnerVolumeSpecName "kube-api-access-77tg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:37:30.142825 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.142730 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3" path="/var/lib/kubelet/pods/f569fd8c-c9e4-4aee-af08-0f95ee0c5ea3/volumes" Jun 15 06:37:30.165148 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.165116 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77tg2\" (UniqueName: \"kubernetes.io/projected/c76070a8-85d1-470b-9d24-f344f9a4f56b-kube-api-access-77tg2\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:37:30.569922 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.569887 2576 generic.go:356] "Generic (PLEG): container finished" podID="c76070a8-85d1-470b-9d24-f344f9a4f56b" containerID="31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737" exitCode=0 Jun 15 06:37:30.569922 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.569931 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dsv9z" Jun 15 06:37:30.570452 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.569962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dsv9z" event={"ID":"c76070a8-85d1-470b-9d24-f344f9a4f56b","Type":"ContainerDied","Data":"31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737"} Jun 15 06:37:30.570452 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.570009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dsv9z" event={"ID":"c76070a8-85d1-470b-9d24-f344f9a4f56b","Type":"ContainerDied","Data":"ab7d3aebe1a31a6dff53d110ec66d78204b75a579e9d8f203e987f452e7278bb"} Jun 15 06:37:30.570452 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.570031 2576 scope.go:117] "RemoveContainer" containerID="31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737" Jun 15 06:37:30.570452 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.570115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f898bdc55-mzhnr" Jun 15 06:37:30.579596 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.579575 2576 scope.go:117] "RemoveContainer" containerID="31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737" Jun 15 06:37:30.579894 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:37:30.579856 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737\": container with ID starting with 31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737 not found: ID does not exist" containerID="31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737" Jun 15 06:37:30.579965 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.579907 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737"} err="failed to get container status \"31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737\": rpc error: code = NotFound desc = could not find container \"31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737\": container with ID starting with 31443d69ceb80bc4b47dbdf100c595dadaa37826ba7b45066b641d4189864737 not found: ID does not exist" Jun 15 06:37:30.590214 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.590189 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dsv9z"] Jun 15 06:37:30.592600 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.592579 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dsv9z"] Jun 15 06:37:30.614860 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.614830 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f898bdc55-mzhnr"] Jun 15 06:37:30.618793 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:30.618763 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f898bdc55-mzhnr"] Jun 15 06:37:32.142613 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:32.142539 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c76070a8-85d1-470b-9d24-f344f9a4f56b" path="/var/lib/kubelet/pods/c76070a8-85d1-470b-9d24-f344f9a4f56b/volumes" Jun 15 06:37:32.142989 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:32.142891 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec55fb23-1006-4273-bb14-3c86df72dcce" path="/var/lib/kubelet/pods/ec55fb23-1006-4273-bb14-3c86df72dcce/volumes" Jun 15 06:37:33.243316 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.243278 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69d6649979-x5c5l"] Jun 15 06:37:33.243832 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.243668 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76070a8-85d1-470b-9d24-f344f9a4f56b" containerName="authorino" Jun 15 06:37:33.243832 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.243679 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76070a8-85d1-470b-9d24-f344f9a4f56b" containerName="authorino" Jun 15 06:37:33.243832 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.243750 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76070a8-85d1-470b-9d24-f344f9a4f56b" containerName="authorino" Jun 15 06:37:33.248544 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.248516 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:33.250527 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.250493 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 06:37:33.250682 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.250593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rgq27\"" Jun 15 06:37:33.250682 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.250634 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 06:37:33.255681 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.255648 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69d6649979-x5c5l"] Jun 15 06:37:33.396562 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.396517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppp45\" (UniqueName: \"kubernetes.io/projected/f5251222-f75d-4c50-b9c4-082809f8a07a-kube-api-access-ppp45\") pod \"maas-controller-69d6649979-x5c5l\" (UID: \"f5251222-f75d-4c50-b9c4-082809f8a07a\") " pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:33.396727 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.396570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5251222-f75d-4c50-b9c4-082809f8a07a-webhook-cert\") pod \"maas-controller-69d6649979-x5c5l\" (UID: \"f5251222-f75d-4c50-b9c4-082809f8a07a\") " pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:33.402318 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.402284 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cfc8854f8-stmmf"] Jun 15 06:37:33.406043 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.406020 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cfc8854f8-stmmf" Jun 15 06:37:33.414274 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.414244 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cfc8854f8-stmmf"] Jun 15 06:37:33.498106 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.498002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppp45\" (UniqueName: \"kubernetes.io/projected/f5251222-f75d-4c50-b9c4-082809f8a07a-kube-api-access-ppp45\") pod \"maas-controller-69d6649979-x5c5l\" (UID: \"f5251222-f75d-4c50-b9c4-082809f8a07a\") " pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:33.498106 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.498053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5251222-f75d-4c50-b9c4-082809f8a07a-webhook-cert\") pod \"maas-controller-69d6649979-x5c5l\" (UID: \"f5251222-f75d-4c50-b9c4-082809f8a07a\") " pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:33.498106 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.498105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmdj7\" (UniqueName: \"kubernetes.io/projected/3060c62e-5826-4d2f-93ef-6aab80aa753a-kube-api-access-tmdj7\") pod \"maas-controller-6cfc8854f8-stmmf\" (UID: \"3060c62e-5826-4d2f-93ef-6aab80aa753a\") " pod="opendatahub/maas-controller-6cfc8854f8-stmmf" Jun 15 06:37:33.498404 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.498149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3060c62e-5826-4d2f-93ef-6aab80aa753a-webhook-cert\") pod \"maas-controller-6cfc8854f8-stmmf\" (UID: \"3060c62e-5826-4d2f-93ef-6aab80aa753a\") " pod="opendatahub/maas-controller-6cfc8854f8-stmmf" Jun 15 06:37:33.500655 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.500635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5251222-f75d-4c50-b9c4-082809f8a07a-webhook-cert\") pod \"maas-controller-69d6649979-x5c5l\" (UID: \"f5251222-f75d-4c50-b9c4-082809f8a07a\") " pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:33.505329 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.505306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppp45\" (UniqueName: \"kubernetes.io/projected/f5251222-f75d-4c50-b9c4-082809f8a07a-kube-api-access-ppp45\") pod \"maas-controller-69d6649979-x5c5l\" (UID: \"f5251222-f75d-4c50-b9c4-082809f8a07a\") " pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:33.563452 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.563398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:33.598930 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.598892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmdj7\" (UniqueName: \"kubernetes.io/projected/3060c62e-5826-4d2f-93ef-6aab80aa753a-kube-api-access-tmdj7\") pod \"maas-controller-6cfc8854f8-stmmf\" (UID: \"3060c62e-5826-4d2f-93ef-6aab80aa753a\") " pod="opendatahub/maas-controller-6cfc8854f8-stmmf" Jun 15 06:37:33.599095 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.598959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3060c62e-5826-4d2f-93ef-6aab80aa753a-webhook-cert\") pod \"maas-controller-6cfc8854f8-stmmf\" (UID: \"3060c62e-5826-4d2f-93ef-6aab80aa753a\") " pod="opendatahub/maas-controller-6cfc8854f8-stmmf" Jun 15 06:37:33.601504 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.601478 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3060c62e-5826-4d2f-93ef-6aab80aa753a-webhook-cert\") pod \"maas-controller-6cfc8854f8-stmmf\" (UID: \"3060c62e-5826-4d2f-93ef-6aab80aa753a\") " pod="opendatahub/maas-controller-6cfc8854f8-stmmf" Jun 15 06:37:33.607009 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.606977 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmdj7\" (UniqueName: \"kubernetes.io/projected/3060c62e-5826-4d2f-93ef-6aab80aa753a-kube-api-access-tmdj7\") pod \"maas-controller-6cfc8854f8-stmmf\" (UID: \"3060c62e-5826-4d2f-93ef-6aab80aa753a\") " pod="opendatahub/maas-controller-6cfc8854f8-stmmf" Jun 15 06:37:33.701994 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.701968 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69d6649979-x5c5l"] Jun 15 06:37:33.703314 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:37:33.703286 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5251222_f75d_4c50_b9c4_082809f8a07a.slice/crio-7befba095c7464b935fa6304c9b6b0a3458ca68e19617cdd18a945ef2f3d48e7 WatchSource:0}: Error finding container 7befba095c7464b935fa6304c9b6b0a3458ca68e19617cdd18a945ef2f3d48e7: Status 404 returned error can't find the container with id 7befba095c7464b935fa6304c9b6b0a3458ca68e19617cdd18a945ef2f3d48e7 Jun 15 06:37:33.704696 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.704680 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 06:37:33.716954 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.716923 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cfc8854f8-stmmf" Jun 15 06:37:33.860201 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:33.860168 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cfc8854f8-stmmf"] Jun 15 06:37:33.862454 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:37:33.862424 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3060c62e_5826_4d2f_93ef_6aab80aa753a.slice/crio-c1a9ed27097d8a28bba00125b579d8c10d4e0eea1edc79569924c4717a3dc979 WatchSource:0}: Error finding container c1a9ed27097d8a28bba00125b579d8c10d4e0eea1edc79569924c4717a3dc979: Status 404 returned error can't find the container with id c1a9ed27097d8a28bba00125b579d8c10d4e0eea1edc79569924c4717a3dc979 Jun 15 06:37:34.600343 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:34.600279 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69d6649979-x5c5l" event={"ID":"f5251222-f75d-4c50-b9c4-082809f8a07a","Type":"ContainerStarted","Data":"7befba095c7464b935fa6304c9b6b0a3458ca68e19617cdd18a945ef2f3d48e7"} Jun 15 06:37:34.601941 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:34.601848 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cfc8854f8-stmmf" event={"ID":"3060c62e-5826-4d2f-93ef-6aab80aa753a","Type":"ContainerStarted","Data":"c1a9ed27097d8a28bba00125b579d8c10d4e0eea1edc79569924c4717a3dc979"} Jun 15 06:37:36.615826 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:36.615784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69d6649979-x5c5l" event={"ID":"f5251222-f75d-4c50-b9c4-082809f8a07a","Type":"ContainerStarted","Data":"348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999"} Jun 15 06:37:36.616319 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:36.615854 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:36.617331 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:36.617309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cfc8854f8-stmmf" event={"ID":"3060c62e-5826-4d2f-93ef-6aab80aa753a","Type":"ContainerStarted","Data":"0aa85fa3ad69a015049fce43b0d9c2160f2a077e0e30cb80b11630fa00fbc56d"} Jun 15 06:37:36.617448 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:36.617436 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cfc8854f8-stmmf" Jun 15 06:37:36.637430 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:36.637364 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69d6649979-x5c5l" podStartSLOduration=1.6990343449999998 podStartE2EDuration="3.637343467s" totalImagesPullingTime="1.938309122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:37:36.635208739 +0000 UTC m=+708.930736026" watchObservedRunningTime="2026-06-15 06:37:36.637343467 +0000 UTC m=+708.932870744" Jun 15 06:37:47.635079 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:47.635043 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cfc8854f8-stmmf" Jun 15 06:37:47.635552 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:47.635255 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:47.672626 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:47.672567 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cfc8854f8-stmmf" podStartSLOduration=12.896885537 podStartE2EDuration="14.672547458s" totalImagesPullingTime="1.775661921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:37:36.651501196 +0000 UTC m=+708.947028472" watchObservedRunningTime="2026-06-15 06:37:47.672547458 +0000 UTC m=+719.968074733" Jun 15 06:37:47.724798 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:47.724766 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69d6649979-x5c5l"] Jun 15 06:37:47.724978 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:47.724956 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-69d6649979-x5c5l" podUID="f5251222-f75d-4c50-b9c4-082809f8a07a" containerName="manager" containerID="cri-o://348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999" gracePeriod=30 Jun 15 06:37:47.982327 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:47.982301 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:48.026384 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.026349 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5251222-f75d-4c50-b9c4-082809f8a07a-webhook-cert\") pod \"f5251222-f75d-4c50-b9c4-082809f8a07a\" (UID: \"f5251222-f75d-4c50-b9c4-082809f8a07a\") " Jun 15 06:37:48.026575 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.026413 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppp45\" (UniqueName: \"kubernetes.io/projected/f5251222-f75d-4c50-b9c4-082809f8a07a-kube-api-access-ppp45\") pod \"f5251222-f75d-4c50-b9c4-082809f8a07a\" (UID: \"f5251222-f75d-4c50-b9c4-082809f8a07a\") " Jun 15 06:37:48.028641 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.028611 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5251222-f75d-4c50-b9c4-082809f8a07a-kube-api-access-ppp45" (OuterVolumeSpecName: "kube-api-access-ppp45") pod "f5251222-f75d-4c50-b9c4-082809f8a07a" (UID: "f5251222-f75d-4c50-b9c4-082809f8a07a"). InnerVolumeSpecName "kube-api-access-ppp45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 06:37:48.028641 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.028633 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5251222-f75d-4c50-b9c4-082809f8a07a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f5251222-f75d-4c50-b9c4-082809f8a07a" (UID: "f5251222-f75d-4c50-b9c4-082809f8a07a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 06:37:48.127998 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.127960 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppp45\" (UniqueName: \"kubernetes.io/projected/f5251222-f75d-4c50-b9c4-082809f8a07a-kube-api-access-ppp45\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:37:48.127998 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.127995 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5251222-f75d-4c50-b9c4-082809f8a07a-webhook-cert\") on node \"ip-10-0-140-165.ec2.internal\" DevicePath \"\"" Jun 15 06:37:48.687777 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.687734 2576 generic.go:356] "Generic (PLEG): container finished" podID="f5251222-f75d-4c50-b9c4-082809f8a07a" containerID="348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999" exitCode=0 Jun 15 06:37:48.688222 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.687785 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69d6649979-x5c5l" Jun 15 06:37:48.688222 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.687808 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69d6649979-x5c5l" event={"ID":"f5251222-f75d-4c50-b9c4-082809f8a07a","Type":"ContainerDied","Data":"348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999"} Jun 15 06:37:48.688222 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.687906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69d6649979-x5c5l" event={"ID":"f5251222-f75d-4c50-b9c4-082809f8a07a","Type":"ContainerDied","Data":"7befba095c7464b935fa6304c9b6b0a3458ca68e19617cdd18a945ef2f3d48e7"} Jun 15 06:37:48.688222 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.687936 2576 scope.go:117] "RemoveContainer" containerID="348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999" Jun 15 06:37:48.697303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.697283 2576 scope.go:117] "RemoveContainer" containerID="348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999" Jun 15 06:37:48.697575 ip-10-0-140-165 kubenswrapper[2576]: E0615 06:37:48.697553 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999\": container with ID starting with 348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999 not found: ID does not exist" containerID="348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999" Jun 15 06:37:48.697646 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.697582 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999"} err="failed to get container status \"348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999\": rpc error: code = NotFound desc = could not find container \"348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999\": container with ID starting with 348caff289cd211573574d7c0071af81ea9b47dd5941bc04b86bc255f3c92999 not found: ID does not exist" Jun 15 06:37:48.703374 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.703346 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69d6649979-x5c5l"] Jun 15 06:37:48.706981 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:48.706959 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69d6649979-x5c5l"] Jun 15 06:37:50.142813 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:37:50.142779 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5251222-f75d-4c50-b9c4-082809f8a07a" path="/var/lib/kubelet/pods/f5251222-f75d-4c50-b9c4-082809f8a07a/volumes" Jun 15 06:38:06.841600 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.841565 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-979766d59-2gpcn"] Jun 15 06:38:06.842102 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.841979 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5251222-f75d-4c50-b9c4-082809f8a07a" containerName="manager" Jun 15 06:38:06.842102 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.841992 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5251222-f75d-4c50-b9c4-082809f8a07a" containerName="manager" Jun 15 06:38:06.842102 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.842073 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5251222-f75d-4c50-b9c4-082809f8a07a" containerName="manager" Jun 15 06:38:06.847824 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.847803 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:06.850131 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.850107 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 15 06:38:06.850261 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.850216 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-g4lzk\"" Jun 15 06:38:06.857161 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.857138 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-979766d59-2gpcn"] Jun 15 06:38:06.898330 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.898293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac3c4b6a-7e37-4ee3-b411-460d38c4462a-maas-api-tls\") pod \"maas-api-979766d59-2gpcn\" (UID: \"ac3c4b6a-7e37-4ee3-b411-460d38c4462a\") " pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:06.898519 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.898337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsv5w\" (UniqueName: \"kubernetes.io/projected/ac3c4b6a-7e37-4ee3-b411-460d38c4462a-kube-api-access-zsv5w\") pod \"maas-api-979766d59-2gpcn\" (UID: \"ac3c4b6a-7e37-4ee3-b411-460d38c4462a\") " pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:06.898519 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.898393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac3c4b6a-7e37-4ee3-b411-460d38c4462a-openshift-service-ca\") pod \"maas-api-979766d59-2gpcn\" (UID: \"ac3c4b6a-7e37-4ee3-b411-460d38c4462a\") " pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:06.999453 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.999416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac3c4b6a-7e37-4ee3-b411-460d38c4462a-openshift-service-ca\") pod \"maas-api-979766d59-2gpcn\" (UID: \"ac3c4b6a-7e37-4ee3-b411-460d38c4462a\") " pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:06.999673 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.999530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac3c4b6a-7e37-4ee3-b411-460d38c4462a-maas-api-tls\") pod \"maas-api-979766d59-2gpcn\" (UID: \"ac3c4b6a-7e37-4ee3-b411-460d38c4462a\") " pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:06.999673 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:06.999558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsv5w\" (UniqueName: \"kubernetes.io/projected/ac3c4b6a-7e37-4ee3-b411-460d38c4462a-kube-api-access-zsv5w\") pod \"maas-api-979766d59-2gpcn\" (UID: \"ac3c4b6a-7e37-4ee3-b411-460d38c4462a\") " pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:07.000242 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.000215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac3c4b6a-7e37-4ee3-b411-460d38c4462a-openshift-service-ca\") pod \"maas-api-979766d59-2gpcn\" (UID: \"ac3c4b6a-7e37-4ee3-b411-460d38c4462a\") " pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:07.002095 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.002076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac3c4b6a-7e37-4ee3-b411-460d38c4462a-maas-api-tls\") pod \"maas-api-979766d59-2gpcn\" (UID: \"ac3c4b6a-7e37-4ee3-b411-460d38c4462a\") " pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:07.007951 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.007924 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsv5w\" (UniqueName: \"kubernetes.io/projected/ac3c4b6a-7e37-4ee3-b411-460d38c4462a-kube-api-access-zsv5w\") pod \"maas-api-979766d59-2gpcn\" (UID: \"ac3c4b6a-7e37-4ee3-b411-460d38c4462a\") " pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:07.160632 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.160537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:07.311207 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.311176 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-979766d59-2gpcn"] Jun 15 06:38:07.312696 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:38:07.312664 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3c4b6a_7e37_4ee3_b411_460d38c4462a.slice/crio-775b27dc0ddcc07a3f2b8fa6f6e31dfea1c207cb2523d5401fe0aecbdc11c532 WatchSource:0}: Error finding container 775b27dc0ddcc07a3f2b8fa6f6e31dfea1c207cb2523d5401fe0aecbdc11c532: Status 404 returned error can't find the container with id 775b27dc0ddcc07a3f2b8fa6f6e31dfea1c207cb2523d5401fe0aecbdc11c532 Jun 15 06:38:07.454280 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.454195 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-26qqf"] Jun 15 06:38:07.460154 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.460135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-26qqf" Jun 15 06:38:07.462335 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.462313 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qww2m\"" Jun 15 06:38:07.462499 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.462483 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 15 06:38:07.469274 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.469244 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-26qqf"] Jun 15 06:38:07.506469 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.506429 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-zhldz"] Jun 15 06:38:07.510788 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.510769 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-zhldz" Jun 15 06:38:07.518706 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.518568 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-zhldz"] Jun 15 06:38:07.603736 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.603699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgm4l\" (UniqueName: \"kubernetes.io/projected/66349a91-2e10-4976-a5d6-63cb0bcc5b1c-kube-api-access-xgm4l\") pod \"payload-pre-processing-579785bc64-zhldz\" (UID: \"66349a91-2e10-4976-a5d6-63cb0bcc5b1c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-zhldz" Jun 15 06:38:07.603736 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.603742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvcph\" (UniqueName: \"kubernetes.io/projected/1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e-kube-api-access-fvcph\") pod \"payload-processing-699b6cd6c-26qqf\" (UID: \"1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e\") " pod="openshift-ingress/payload-processing-699b6cd6c-26qqf" Jun 15 06:38:07.704807 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.704715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgm4l\" (UniqueName: \"kubernetes.io/projected/66349a91-2e10-4976-a5d6-63cb0bcc5b1c-kube-api-access-xgm4l\") pod \"payload-pre-processing-579785bc64-zhldz\" (UID: \"66349a91-2e10-4976-a5d6-63cb0bcc5b1c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-zhldz" Jun 15 06:38:07.704807 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.704759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvcph\" (UniqueName: \"kubernetes.io/projected/1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e-kube-api-access-fvcph\") pod \"payload-processing-699b6cd6c-26qqf\" (UID: \"1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e\") " pod="openshift-ingress/payload-processing-699b6cd6c-26qqf" Jun 15 06:38:07.712125 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.712099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvcph\" (UniqueName: \"kubernetes.io/projected/1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e-kube-api-access-fvcph\") pod \"payload-processing-699b6cd6c-26qqf\" (UID: \"1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e\") " pod="openshift-ingress/payload-processing-699b6cd6c-26qqf" Jun 15 06:38:07.712253 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.712158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgm4l\" (UniqueName: \"kubernetes.io/projected/66349a91-2e10-4976-a5d6-63cb0bcc5b1c-kube-api-access-xgm4l\") pod \"payload-pre-processing-579785bc64-zhldz\" (UID: \"66349a91-2e10-4976-a5d6-63cb0bcc5b1c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-zhldz" Jun 15 06:38:07.774515 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.774477 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-26qqf" Jun 15 06:38:07.796375 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.796345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-979766d59-2gpcn" event={"ID":"ac3c4b6a-7e37-4ee3-b411-460d38c4462a","Type":"ContainerStarted","Data":"775b27dc0ddcc07a3f2b8fa6f6e31dfea1c207cb2523d5401fe0aecbdc11c532"} Jun 15 06:38:07.822781 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.822741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-zhldz" Jun 15 06:38:07.944016 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:07.943981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-26qqf"] Jun 15 06:38:08.001168 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:08.001136 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-zhldz"] Jun 15 06:38:08.002443 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:38:08.002411 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66349a91_2e10_4976_a5d6_63cb0bcc5b1c.slice/crio-d28ab8bcf63e5e11dc0a716dc4758de3754177284c86d6b60b801ac2cba6e273 WatchSource:0}: Error finding container d28ab8bcf63e5e11dc0a716dc4758de3754177284c86d6b60b801ac2cba6e273: Status 404 returned error can't find the container with id d28ab8bcf63e5e11dc0a716dc4758de3754177284c86d6b60b801ac2cba6e273 Jun 15 06:38:08.809399 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:08.809357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-zhldz" event={"ID":"66349a91-2e10-4976-a5d6-63cb0bcc5b1c","Type":"ContainerStarted","Data":"d28ab8bcf63e5e11dc0a716dc4758de3754177284c86d6b60b801ac2cba6e273"} Jun 15 06:38:08.812346 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:08.811961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-979766d59-2gpcn" event={"ID":"ac3c4b6a-7e37-4ee3-b411-460d38c4462a","Type":"ContainerStarted","Data":"0bf1c15d166f4ca60a96e90bf87d26c064ca69709818552d412586a776398126"} Jun 15 06:38:08.812346 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:08.812054 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:08.814686 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:08.814649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-26qqf" event={"ID":"1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e","Type":"ContainerStarted","Data":"66764d207aaca3e60d6ae39504b6abc3a02d62f829b43ef21456153ff8225160"} Jun 15 06:38:08.829669 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:08.829561 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-979766d59-2gpcn" podStartSLOduration=1.564824148 podStartE2EDuration="2.829540084s" totalImagesPullingTime="1.264715936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:38:08.827022504 +0000 UTC m=+741.122549782" watchObservedRunningTime="2026-06-15 06:38:08.829540084 +0000 UTC m=+741.125067360" Jun 15 06:38:10.833196 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:10.833170 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-zhldz" Jun 15 06:38:10.849746 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:10.849691 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-zhldz" podStartSLOduration=1.103384303 podStartE2EDuration="3.849674564s" totalImagesPullingTime="2.746290261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:38:10.848065517 +0000 UTC m=+743.143592792" watchObservedRunningTime="2026-06-15 06:38:10.849674564 +0000 UTC m=+743.145201839" Jun 15 06:38:11.840633 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:11.840593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-26qqf" event={"ID":"1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e","Type":"ContainerStarted","Data":"1917380c3a7476ecc6bf3c46eea9c5c24ec355f80a4cc316d1b3ac11cd885518"} Jun 15 06:38:11.841130 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:11.840666 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-26qqf" Jun 15 06:38:11.842354 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:11.842326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-zhldz" event={"ID":"66349a91-2e10-4976-a5d6-63cb0bcc5b1c","Type":"ContainerStarted","Data":"af5feef41d1c4a102b58d5e8ab11967e4b66eed8c6bd1d5c9c2bf8b81a6c0166"} Jun 15 06:38:11.855930 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:11.855861 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-26qqf" podStartSLOduration=2.058736938 podStartE2EDuration="4.855845031s" totalImagesPullingTime="2.797108093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:38:11.854310822 +0000 UTC m=+744.149838100" watchObservedRunningTime="2026-06-15 06:38:11.855845031 +0000 UTC m=+744.151372307" Jun 15 06:38:14.828282 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:14.828249 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-979766d59-2gpcn" Jun 15 06:38:22.853078 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:22.853046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-26qqf" Jun 15 06:38:22.853487 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:22.853125 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-zhldz" Jun 15 06:38:52.087103 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.087064 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-657b84d575-tng79"] Jun 15 06:38:52.091841 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.091823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.096584 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.096558 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 15 06:38:52.096775 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.096749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 15 06:38:52.096927 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.096701 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jbzsr\"" Jun 15 06:38:52.100613 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.100587 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-657b84d575-tng79"] Jun 15 06:38:52.221715 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.221680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c53c6b21-7a82-4831-b126-dea7cb808090-tls-cert\") pod \"authorino-657b84d575-tng79\" (UID: \"c53c6b21-7a82-4831-b126-dea7cb808090\") " pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.221939 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.221730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c53c6b21-7a82-4831-b126-dea7cb808090-oidc-ca\") pod \"authorino-657b84d575-tng79\" (UID: \"c53c6b21-7a82-4831-b126-dea7cb808090\") " pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.221939 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.221751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfksx\" (UniqueName: \"kubernetes.io/projected/c53c6b21-7a82-4831-b126-dea7cb808090-kube-api-access-qfksx\") pod \"authorino-657b84d575-tng79\" (UID: \"c53c6b21-7a82-4831-b126-dea7cb808090\") " pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.322474 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.322434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c53c6b21-7a82-4831-b126-dea7cb808090-tls-cert\") pod \"authorino-657b84d575-tng79\" (UID: \"c53c6b21-7a82-4831-b126-dea7cb808090\") " pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.322673 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.322486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c53c6b21-7a82-4831-b126-dea7cb808090-oidc-ca\") pod \"authorino-657b84d575-tng79\" (UID: \"c53c6b21-7a82-4831-b126-dea7cb808090\") " pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.322673 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.322654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfksx\" (UniqueName: \"kubernetes.io/projected/c53c6b21-7a82-4831-b126-dea7cb808090-kube-api-access-qfksx\") pod \"authorino-657b84d575-tng79\" (UID: \"c53c6b21-7a82-4831-b126-dea7cb808090\") " pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.323138 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.323119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c53c6b21-7a82-4831-b126-dea7cb808090-oidc-ca\") pod \"authorino-657b84d575-tng79\" (UID: \"c53c6b21-7a82-4831-b126-dea7cb808090\") " pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.324982 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.324961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c53c6b21-7a82-4831-b126-dea7cb808090-tls-cert\") pod \"authorino-657b84d575-tng79\" (UID: \"c53c6b21-7a82-4831-b126-dea7cb808090\") " pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.331772 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.331745 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfksx\" (UniqueName: \"kubernetes.io/projected/c53c6b21-7a82-4831-b126-dea7cb808090-kube-api-access-qfksx\") pod \"authorino-657b84d575-tng79\" (UID: \"c53c6b21-7a82-4831-b126-dea7cb808090\") " pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.403525 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.403435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-657b84d575-tng79" Jun 15 06:38:52.540528 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:52.540497 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-657b84d575-tng79"] Jun 15 06:38:52.541465 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:38:52.541440 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc53c6b21_7a82_4831_b126_dea7cb808090.slice/crio-81b4ea4c199cf0129eb99fd782cdfd8a02a2f3d4832bfb0db826531671f49218 WatchSource:0}: Error finding container 81b4ea4c199cf0129eb99fd782cdfd8a02a2f3d4832bfb0db826531671f49218: Status 404 returned error can't find the container with id 81b4ea4c199cf0129eb99fd782cdfd8a02a2f3d4832bfb0db826531671f49218 Jun 15 06:38:53.086752 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:53.086715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-657b84d575-tng79" event={"ID":"c53c6b21-7a82-4831-b126-dea7cb808090","Type":"ContainerStarted","Data":"70d4dd6fcfb8a8fcb891993cd8603628a29f9111bcd3fc9698bd37708ad0ba71"} Jun 15 06:38:53.086945 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:53.086761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-657b84d575-tng79" event={"ID":"c53c6b21-7a82-4831-b126-dea7cb808090","Type":"ContainerStarted","Data":"81b4ea4c199cf0129eb99fd782cdfd8a02a2f3d4832bfb0db826531671f49218"} Jun 15 06:38:53.102648 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:38:53.102599 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-657b84d575-tng79" podStartSLOduration=0.718261521 podStartE2EDuration="1.102582584s" totalImagesPullingTime="384.321063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:38:53.100003749 +0000 UTC m=+785.395531023" watchObservedRunningTime="2026-06-15 06:38:53.102582584 +0000 UTC m=+785.398109860" Jun 15 06:39:05.189149 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.189071 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn"] Jun 15 06:39:05.193459 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.193439 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.196411 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.196388 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 06:39:05.196542 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.196391 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fqz6k\"" Jun 15 06:39:05.196594 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.196538 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 06:39:05.197246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.197226 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 15 06:39:05.200402 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.200376 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn"] Jun 15 06:39:05.337604 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.337572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh7nx\" (UniqueName: \"kubernetes.io/projected/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-kube-api-access-nh7nx\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.337768 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.337626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.337768 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.337650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.337768 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.337722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.337768 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.337754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.337937 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.337779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.439240 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.439145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.439240 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.439199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.439481 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.439259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh7nx\" (UniqueName: \"kubernetes.io/projected/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-kube-api-access-nh7nx\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.439481 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.439320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.439481 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.439349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.439481 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.439401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.439765 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.439723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.439921 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.439834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.439921 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.439856 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.441606 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.441582 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.441768 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.441754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.448190 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.448169 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh7nx\" (UniqueName: \"kubernetes.io/projected/5d8e310b-20a9-459c-b06c-884a3c6a4a2f-kube-api-access-nh7nx\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn\" (UID: \"5d8e310b-20a9-459c-b06c-884a3c6a4a2f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.505733 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.505679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:39:05.665573 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:05.665540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn"] Jun 15 06:39:05.667961 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:39:05.667926 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8e310b_20a9_459c_b06c_884a3c6a4a2f.slice/crio-5a999b6c8bfa34c551c7a8c5d81593c71ce1f56988b298bfd4754f78a3e5e906 WatchSource:0}: Error finding container 5a999b6c8bfa34c551c7a8c5d81593c71ce1f56988b298bfd4754f78a3e5e906: Status 404 returned error can't find the container with id 5a999b6c8bfa34c551c7a8c5d81593c71ce1f56988b298bfd4754f78a3e5e906 Jun 15 06:39:06.167039 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:06.167000 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" event={"ID":"5d8e310b-20a9-459c-b06c-884a3c6a4a2f","Type":"ContainerStarted","Data":"5a999b6c8bfa34c551c7a8c5d81593c71ce1f56988b298bfd4754f78a3e5e906"} Jun 15 06:39:10.196288 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:10.196246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" event={"ID":"5d8e310b-20a9-459c-b06c-884a3c6a4a2f","Type":"ContainerStarted","Data":"b2285b20b7b9bc87f8a8121d3e1c80cf3b7ac61a91f82908c8e0a30bb3f957cd"} Jun 15 06:39:14.591246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.591206 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz"] Jun 15 06:39:14.596418 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.596391 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.598199 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.598179 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 15 06:39:14.603044 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.603015 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz"] Jun 15 06:39:14.725990 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.725954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.726186 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.726026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.726186 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.726097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4qcf\" (UniqueName: \"kubernetes.io/projected/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-kube-api-access-q4qcf\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.726186 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.726118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.726186 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.726162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.726351 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.726196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.826804 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.826763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.827042 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.826853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4qcf\" (UniqueName: \"kubernetes.io/projected/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-kube-api-access-q4qcf\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.827042 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.826915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.827042 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.826958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.827042 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.827020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.827305 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.827069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.827305 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.827177 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.827511 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.827477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.827700 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.827529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.829677 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.829654 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.830118 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.830097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.834356 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.834334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4qcf\" (UniqueName: \"kubernetes.io/projected/96424e94-aa69-4a59-8d4c-d2f78fb6b9b7-kube-api-access-q4qcf\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6hqz\" (UID: \"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:14.909402 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:14.909318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:39:15.059806 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:15.059770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz"] Jun 15 06:39:15.060676 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:39:15.060643 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96424e94_aa69_4a59_8d4c_d2f78fb6b9b7.slice/crio-9305cea2ab7d332f358be107f19d0fc7678d87ab8d8917eb6a92d107655eae3f WatchSource:0}: Error finding container 9305cea2ab7d332f358be107f19d0fc7678d87ab8d8917eb6a92d107655eae3f: Status 404 returned error can't find the container with id 9305cea2ab7d332f358be107f19d0fc7678d87ab8d8917eb6a92d107655eae3f Jun 15 06:39:15.231970 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:15.231849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" event={"ID":"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7","Type":"ContainerStarted","Data":"27f077957c880023bb85dcdf4176d4b97fa99225ce1b650e9f478a3c09d2d375"} Jun 15 06:39:15.231970 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:15.231948 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" event={"ID":"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7","Type":"ContainerStarted","Data":"9305cea2ab7d332f358be107f19d0fc7678d87ab8d8917eb6a92d107655eae3f"} Jun 15 06:39:37.892923 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:37.892889 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g"] Jun 15 06:39:37.896982 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:37.896956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:37.898948 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:37.898928 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 15 06:39:37.907720 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:37.907698 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g"] Jun 15 06:39:37.941210 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:37.941174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:37.941390 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:37.941227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e3f7500-4850-4551-9820-d5a1c0d06318-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:37.941390 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:37.941249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:37.941390 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:37.941273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:37.941390 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:37.941293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcnlp\" (UniqueName: \"kubernetes.io/projected/0e3f7500-4850-4551-9820-d5a1c0d06318-kube-api-access-bcnlp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:37.941390 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:37.941325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.042730 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.042678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.042950 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.042775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.042950 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.042828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e3f7500-4850-4551-9820-d5a1c0d06318-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.042950 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.042853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.042950 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.042906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.042950 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.042930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcnlp\" (UniqueName: \"kubernetes.io/projected/0e3f7500-4850-4551-9820-d5a1c0d06318-kube-api-access-bcnlp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.043245 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.043115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.043303 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.043254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.043366 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.043342 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.045242 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.045211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e3f7500-4850-4551-9820-d5a1c0d06318-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.045391 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.045373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e3f7500-4850-4551-9820-d5a1c0d06318-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.050569 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.050543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcnlp\" (UniqueName: \"kubernetes.io/projected/0e3f7500-4850-4551-9820-d5a1c0d06318-kube-api-access-bcnlp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g\" (UID: \"0e3f7500-4850-4551-9820-d5a1c0d06318\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.208330 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.208230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" Jun 15 06:39:38.360006 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.359981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g"] Jun 15 06:39:38.361061 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:39:38.361035 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e3f7500_4850_4551_9820_d5a1c0d06318.slice/crio-8fb188c8d7d00a2c5ba5332e0dcc5f29bde027671a0c8f873c2e6f31be59d309 WatchSource:0}: Error finding container 8fb188c8d7d00a2c5ba5332e0dcc5f29bde027671a0c8f873c2e6f31be59d309: Status 404 returned error can't find the container with id 8fb188c8d7d00a2c5ba5332e0dcc5f29bde027671a0c8f873c2e6f31be59d309 Jun 15 06:39:38.380661 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:38.380559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" event={"ID":"0e3f7500-4850-4551-9820-d5a1c0d06318","Type":"ContainerStarted","Data":"8fb188c8d7d00a2c5ba5332e0dcc5f29bde027671a0c8f873c2e6f31be59d309"} Jun 15 06:39:39.388606 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:39.388567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g" event={"ID":"0e3f7500-4850-4551-9820-d5a1c0d06318","Type":"ContainerStarted","Data":"549c9f27ca89b14e1590226ed82c67c9aea7a5fb2e689d676dfb8e43c76af833"} Jun 15 06:39:47.314047 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.314010 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq"] Jun 15 06:39:47.319271 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.319242 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.320984 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.320960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 15 06:39:47.333787 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.333764 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq"] Jun 15 06:39:47.432422 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.432388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.432630 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.432453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9rbc\" (UniqueName: \"kubernetes.io/projected/861cd29f-e863-48db-b19a-0b23b9498e37-kube-api-access-d9rbc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.432630 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.432563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.432630 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.432609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/861cd29f-e863-48db-b19a-0b23b9498e37-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.432807 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.432649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.432807 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.432689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.534246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.534207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9rbc\" (UniqueName: \"kubernetes.io/projected/861cd29f-e863-48db-b19a-0b23b9498e37-kube-api-access-d9rbc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.534425 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.534313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.534425 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.534337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/861cd29f-e863-48db-b19a-0b23b9498e37-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.534425 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.534359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.534425 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.534397 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.534576 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.534450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.534898 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.534838 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.534992 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.534863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.534992 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.534923 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.536750 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.536721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/861cd29f-e863-48db-b19a-0b23b9498e37-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.536930 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.536912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/861cd29f-e863-48db-b19a-0b23b9498e37-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.540694 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.540672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9rbc\" (UniqueName: \"kubernetes.io/projected/861cd29f-e863-48db-b19a-0b23b9498e37-kube-api-access-d9rbc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-m86rq\" (UID: \"861cd29f-e863-48db-b19a-0b23b9498e37\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.632053 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.631965 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:47.776988 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:39:47.776954 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861cd29f_e863_48db_b19a_0b23b9498e37.slice/crio-429e9b5b5684ec54dc11700d0d0dd65571b960580a0f3851b6dd257c91f8f667 WatchSource:0}: Error finding container 429e9b5b5684ec54dc11700d0d0dd65571b960580a0f3851b6dd257c91f8f667: Status 404 returned error can't find the container with id 429e9b5b5684ec54dc11700d0d0dd65571b960580a0f3851b6dd257c91f8f667 Jun 15 06:39:47.777162 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:47.777006 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq"] Jun 15 06:39:48.447685 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:48.447646 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" event={"ID":"861cd29f-e863-48db-b19a-0b23b9498e37","Type":"ContainerStarted","Data":"843fc4b4f060484ac893c336faa318d8b9297871e2f2390437902b007ba3d899"} Jun 15 06:39:48.448173 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:48.447715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" event={"ID":"861cd29f-e863-48db-b19a-0b23b9498e37","Type":"ContainerStarted","Data":"429e9b5b5684ec54dc11700d0d0dd65571b960580a0f3851b6dd257c91f8f667"} Jun 15 06:39:55.505506 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:55.505417 2576 generic.go:356] "Generic (PLEG): container finished" podID="861cd29f-e863-48db-b19a-0b23b9498e37" containerID="843fc4b4f060484ac893c336faa318d8b9297871e2f2390437902b007ba3d899" exitCode=0 Jun 15 06:39:55.505897 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:55.505498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" event={"ID":"861cd29f-e863-48db-b19a-0b23b9498e37","Type":"ContainerDied","Data":"843fc4b4f060484ac893c336faa318d8b9297871e2f2390437902b007ba3d899"} Jun 15 06:39:57.520687 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:57.520648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" event={"ID":"861cd29f-e863-48db-b19a-0b23b9498e37","Type":"ContainerStarted","Data":"99b6b697d8033adb1f40749d75fb7c119039c4d70bf86293453376510f91372b"} Jun 15 06:39:57.538572 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:57.538518 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" podStartSLOduration=2.143157873 podStartE2EDuration="10.538502724s" totalImagesPullingTime="1.061068484s" totalInitContainerRuntime="7.334276367s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:39:57.537072109 +0000 UTC m=+849.832599395" watchObservedRunningTime="2026-06-15 06:39:57.538502724 +0000 UTC m=+849.834029999" Jun 15 06:39:57.632550 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:57.632518 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:57.632715 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:57.632594 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:57.645352 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:57.645321 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:39:58.538803 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:39:58.538773 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-m86rq" Jun 15 06:40:18.653032 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:40:18.652991 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d8e310b-20a9-459c-b06c-884a3c6a4a2f" containerID="b2285b20b7b9bc87f8a8121d3e1c80cf3b7ac61a91f82908c8e0a30bb3f957cd" exitCode=0 Jun 15 06:40:18.653539 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:40:18.653062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" event={"ID":"5d8e310b-20a9-459c-b06c-884a3c6a4a2f","Type":"ContainerDied","Data":"b2285b20b7b9bc87f8a8121d3e1c80cf3b7ac61a91f82908c8e0a30bb3f957cd"} Jun 15 06:40:19.661112 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:40:19.661078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" event={"ID":"5d8e310b-20a9-459c-b06c-884a3c6a4a2f","Type":"ContainerStarted","Data":"80996e7ab742ecd596ed4a6b6974cafc71412edc05137f03aa7b887e4374820c"} Jun 15 06:40:19.681675 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:40:19.681614 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" podStartSLOduration=2.257357153 podStartE2EDuration="1m14.68159829s" totalImagesPullingTime="4.166082284s" totalInitContainerRuntime="1m8.258158853s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:39:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:40:19.677770302 +0000 UTC m=+871.973297578" watchObservedRunningTime="2026-06-15 06:40:19.68159829 +0000 UTC m=+871.977125565" Jun 15 06:40:25.505838 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:40:25.505792 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:40:25.506351 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:40:25.505863 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:40:25.518328 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:40:25.518301 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:40:25.712364 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:40:25.712331 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn" Jun 15 06:40:48.182902 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:40:48.182811 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:40:48.182902 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:40:48.182822 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:41:05.960276 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:41:05.960223 2576 generic.go:356] "Generic (PLEG): container finished" podID="96424e94-aa69-4a59-8d4c-d2f78fb6b9b7" containerID="27f077957c880023bb85dcdf4176d4b97fa99225ce1b650e9f478a3c09d2d375" exitCode=0 Jun 15 06:41:05.960798 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:41:05.960502 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" event={"ID":"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7","Type":"ContainerDied","Data":"27f077957c880023bb85dcdf4176d4b97fa99225ce1b650e9f478a3c09d2d375"} Jun 15 06:41:06.968368 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:41:06.968331 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" event={"ID":"96424e94-aa69-4a59-8d4c-d2f78fb6b9b7","Type":"ContainerStarted","Data":"39a58f5b8ade36d446a913335d22e27f4f7a59d5c13f372e2bf472ee5d6d1281"} Jun 15 06:41:14.909717 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:41:14.909678 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:41:14.910232 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:41:14.909761 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:41:14.922460 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:41:14.922427 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:41:14.941265 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:41:14.941210 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" podStartSLOduration=10.863002534 podStartE2EDuration="2m0.941191427s" totalImagesPullingTime="177.916605ms" totalInitContainerRuntime="1m49.900272288s" isStatefulPod=false podCreationTimestamp="2026-06-15 06:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:41:06.986059232 +0000 UTC m=+919.281586508" watchObservedRunningTime="2026-06-15 06:41:14.941191427 +0000 UTC m=+927.236718704" Jun 15 06:41:15.032849 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:41:15.032818 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6hqz" Jun 15 06:45:48.224691 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:48.224650 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:45:48.226602 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:48.226579 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fgsvg_fde4e3a8-977a-4ea3-ae0c-5cbd4f2d5ddc/ovn-acl-logging/0.log" Jun 15 06:45:52.410315 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:52.410281 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g_0e3f7500-4850-4551-9820-d5a1c0d06318/storage-initializer/0.log" Jun 15 06:45:53.369785 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:53.369755 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-657b84d575-tng79_c53c6b21-7a82-4831-b126-dea7cb808090/authorino/0.log" Jun 15 06:45:58.023601 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:58.023570 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c65f9d4c5-t6g5v_168d2a05-1f4e-46f1-88d0-a0bc021605bb/nginx/0.log" Jun 15 06:45:58.133246 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:58.133215 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lw5hr_e3cb71a0-5121-4d97-a75a-4ad878de0132/manager/0.log" Jun 15 06:45:58.257156 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:58.257119 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-kxndx_404df091-72ac-4ce9-99d8-9b79a65052be/manager/0.log" Jun 15 06:45:58.371302 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:58.371275 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-979766d59-2gpcn_ac3c4b6a-7e37-4ee3-b411-460d38c4462a/maas-api/0.log" Jun 15 06:45:58.487706 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:58.487642 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cfc8854f8-stmmf_3060c62e-5826-4d2f-93ef-6aab80aa753a/manager/0.log" Jun 15 06:45:58.599602 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:58.599572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-m8ksl_53f2d478-c056-4d13-85cc-36daa2e0360f/server/0.log" Jun 15 06:45:58.716180 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:58.716092 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-wtknj_f3da1fc8-6a5f-4a9e-8610-a4346beb562e/manager/0.log" Jun 15 06:45:59.106469 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:59.106442 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6944f646d8-5pk4k_250dde14-4122-488f-b850-7a43f56547f5/copy-manifests/0.log" Jun 15 06:45:59.113118 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:59.113097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6944f646d8-5pk4k_250dde14-4122-488f-b850-7a43f56547f5/manager/0.log" Jun 15 06:45:59.997736 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:45:59.997705 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228_7bcb6314-aec9-4e7b-aaac-d2f74001074c/util/0.log" Jun 15 06:46:00.004127 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.004099 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228_7bcb6314-aec9-4e7b-aaac-d2f74001074c/pull/0.log" Jun 15 06:46:00.010058 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.010040 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228_7bcb6314-aec9-4e7b-aaac-d2f74001074c/extract/0.log" Jun 15 06:46:00.125676 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.125651 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs_7ed92e11-723f-4e13-9f0a-e1d04d6da27d/util/0.log" Jun 15 06:46:00.132377 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.132350 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs_7ed92e11-723f-4e13-9f0a-e1d04d6da27d/pull/0.log" Jun 15 06:46:00.139135 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.139102 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs_7ed92e11-723f-4e13-9f0a-e1d04d6da27d/extract/0.log" Jun 15 06:46:00.248368 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.248284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr_e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3/util/0.log" Jun 15 06:46:00.255108 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.255086 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr_e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3/pull/0.log" Jun 15 06:46:00.261966 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.261950 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr_e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3/extract/0.log" Jun 15 06:46:00.371757 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.371732 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh_f6fe78a5-c28a-489a-b67f-b3c1c40140f1/util/0.log" Jun 15 06:46:00.377742 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.377722 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh_f6fe78a5-c28a-489a-b67f-b3c1c40140f1/pull/0.log" Jun 15 06:46:00.384321 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.384297 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh_f6fe78a5-c28a-489a-b67f-b3c1c40140f1/extract/0.log" Jun 15 06:46:00.497540 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:00.497510 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-657b84d575-tng79_c53c6b21-7a82-4831-b126-dea7cb808090/authorino/0.log" Jun 15 06:46:01.316182 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:01.316149 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-q6r58_1e00db1d-83c0-465e-b145-6800508a9d18/manager/0.log" Jun 15 06:46:01.789828 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:01.789736 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-bqlmn_84d024c8-d2ae-433e-91ab-f99ebe5f915e/discovery/0.log" Jun 15 06:46:02.010105 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:02.010079 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78f945c984-kf4jq_abedeecc-9cc3-4f1a-8344-001a5378e936/kube-auth-proxy/0.log" Jun 15 06:46:02.237835 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:02.237804 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zhldz_66349a91-2e10-4976-a5d6-63cb0bcc5b1c/payload-pre-processing/0.log" Jun 15 06:46:02.348290 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:02.348256 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-26qqf_1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e/payload-processing/0.log" Jun 15 06:46:02.464937 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:02.464907 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ffcd796f6-fff9z_e9504a48-d19f-4e36-bd5e-977e2e91be54/router/0.log" Jun 15 06:46:02.813253 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:02.813220 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn_5d8e310b-20a9-459c-b06c-884a3c6a4a2f/storage-initializer/0.log" Jun 15 06:46:02.821406 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:02.821377 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-zpjkn_5d8e310b-20a9-459c-b06c-884a3c6a4a2f/main/0.log" Jun 15 06:46:02.936923 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:02.936887 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-n6hqz_96424e94-aa69-4a59-8d4c-d2f78fb6b9b7/storage-initializer/0.log" Jun 15 06:46:02.944616 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:02.944587 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-n6hqz_96424e94-aa69-4a59-8d4c-d2f78fb6b9b7/main/0.log" Jun 15 06:46:03.182459 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:03.182377 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cp879g_0e3f7500-4850-4551-9820-d5a1c0d06318/storage-initializer/0.log" Jun 15 06:46:03.305667 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:03.305634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-m86rq_861cd29f-e863-48db-b19a-0b23b9498e37/storage-initializer/0.log" Jun 15 06:46:03.313263 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:03.313236 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-m86rq_861cd29f-e863-48db-b19a-0b23b9498e37/main/0.log" Jun 15 06:46:10.506426 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:10.506390 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jb6rn_d2462d75-6125-4066-a0d8-335ffe11dc4a/global-pull-secret-syncer/0.log" Jun 15 06:46:10.636677 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:10.636643 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rjjk5_3d30991d-9f2c-4702-a141-1d265a9c1970/konnectivity-agent/0.log" Jun 15 06:46:10.700072 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:10.700038 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-165.ec2.internal_247a42b425f1cc7470c3639b5a9704cf/haproxy/0.log" Jun 15 06:46:14.013478 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:14.013445 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-mgr4w_e9a347f4-7186-438a-af34-3cb3ea44ffb7/sail-operator/0.log" Jun 15 06:46:15.537226 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.537196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228_7bcb6314-aec9-4e7b-aaac-d2f74001074c/extract/0.log" Jun 15 06:46:15.553875 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.553846 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228_7bcb6314-aec9-4e7b-aaac-d2f74001074c/util/0.log" Jun 15 06:46:15.580774 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.580743 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jn228_7bcb6314-aec9-4e7b-aaac-d2f74001074c/pull/0.log" Jun 15 06:46:15.604969 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.604938 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs_7ed92e11-723f-4e13-9f0a-e1d04d6da27d/extract/0.log" Jun 15 06:46:15.623555 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.623523 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs_7ed92e11-723f-4e13-9f0a-e1d04d6da27d/util/0.log" Jun 15 06:46:15.644629 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.644593 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmcfs_7ed92e11-723f-4e13-9f0a-e1d04d6da27d/pull/0.log" Jun 15 06:46:15.672849 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.672813 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr_e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3/extract/0.log" Jun 15 06:46:15.695400 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.695371 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr_e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3/util/0.log" Jun 15 06:46:15.710255 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.710226 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mqtr_e1d8a9c8-6eb8-4e02-9023-35a3b1072cd3/pull/0.log" Jun 15 06:46:15.742339 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.742309 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh_f6fe78a5-c28a-489a-b67f-b3c1c40140f1/extract/0.log" Jun 15 06:46:15.761226 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.761196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh_f6fe78a5-c28a-489a-b67f-b3c1c40140f1/util/0.log" Jun 15 06:46:15.787293 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.787219 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19tjdh_f6fe78a5-c28a-489a-b67f-b3c1c40140f1/pull/0.log" Jun 15 06:46:15.817410 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:15.817379 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-657b84d575-tng79_c53c6b21-7a82-4831-b126-dea7cb808090/authorino/0.log" Jun 15 06:46:16.013302 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:16.013273 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-q6r58_1e00db1d-83c0-465e-b145-6800508a9d18/manager/0.log" Jun 15 06:46:18.153807 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.153770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-98t7p_bbc3078a-753e-4425-84ca-e7a4d38cffbe/node-exporter/0.log" Jun 15 06:46:18.170882 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.170843 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-98t7p_bbc3078a-753e-4425-84ca-e7a4d38cffbe/kube-rbac-proxy/0.log" Jun 15 06:46:18.192458 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.192429 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-98t7p_bbc3078a-753e-4425-84ca-e7a4d38cffbe/init-textfile/0.log" Jun 15 06:46:18.561393 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.561360 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-98wb5_4bf8377c-ffe4-4266-b6d6-de0083afcc12/prometheus-operator/0.log" Jun 15 06:46:18.577853 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.577824 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-98wb5_4bf8377c-ffe4-4266-b6d6-de0083afcc12/kube-rbac-proxy/0.log" Jun 15 06:46:18.597863 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.597826 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-jwxsf_11f66703-e868-4708-8b2a-09bce878ddc4/prometheus-operator-admission-webhook/0.log" Jun 15 06:46:18.698961 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.698929 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865464b684-mdg64_e3f774cc-855d-4724-80e6-2eb0c43f5a03/thanos-query/0.log" Jun 15 06:46:18.719240 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.719210 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865464b684-mdg64_e3f774cc-855d-4724-80e6-2eb0c43f5a03/kube-rbac-proxy-web/0.log" Jun 15 06:46:18.742338 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.742310 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865464b684-mdg64_e3f774cc-855d-4724-80e6-2eb0c43f5a03/kube-rbac-proxy/0.log" Jun 15 06:46:18.767836 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.767802 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865464b684-mdg64_e3f774cc-855d-4724-80e6-2eb0c43f5a03/prom-label-proxy/0.log" Jun 15 06:46:18.787476 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.787445 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865464b684-mdg64_e3f774cc-855d-4724-80e6-2eb0c43f5a03/kube-rbac-proxy-rules/0.log" Jun 15 06:46:18.809788 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:18.809761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865464b684-mdg64_e3f774cc-855d-4724-80e6-2eb0c43f5a03/kube-rbac-proxy-metrics/0.log" Jun 15 06:46:21.154790 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.154756 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd"] Jun 15 06:46:21.158978 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.158957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.160919 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.160898 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hgnlg\"/\"kube-root-ca.crt\"" Jun 15 06:46:21.161152 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.161134 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hgnlg\"/\"openshift-service-ca.crt\"" Jun 15 06:46:21.161234 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.161156 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hgnlg\"/\"default-dockercfg-7r2j8\"" Jun 15 06:46:21.167961 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.167938 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd"] Jun 15 06:46:21.277351 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.277305 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-945wd_5e9d1f40-9f29-4723-9fa7-98f7bc8e22b3/download-server/0.log" Jun 15 06:46:21.289574 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.289543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-proc\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.289699 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.289607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-podres\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.289699 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.289628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-sys\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.289699 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.289655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-lib-modules\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.289699 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.289674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vhbr\" (UniqueName: \"kubernetes.io/projected/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-kube-api-access-5vhbr\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.390694 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.390658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-proc\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.390912 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.390726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-podres\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.390912 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.390750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-sys\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.390912 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.390779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-lib-modules\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.390912 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.390785 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-proc\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.390912 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.390808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vhbr\" (UniqueName: \"kubernetes.io/projected/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-kube-api-access-5vhbr\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.390912 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.390899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-sys\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.391124 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.390926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-lib-modules\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.391124 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.390935 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-podres\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.398302 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.398284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vhbr\" (UniqueName: \"kubernetes.io/projected/1c32476e-a0e7-4c6b-b909-0d39f43da5c7-kube-api-access-5vhbr\") pod \"perf-node-gather-daemonset-hmqgd\" (UID: \"1c32476e-a0e7-4c6b-b909-0d39f43da5c7\") " pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.471018 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.470917 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.610662 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.610630 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd"] Jun 15 06:46:21.611904 ip-10-0-140-165 kubenswrapper[2576]: W0615 06:46:21.611853 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c32476e_a0e7_4c6b_b909_0d39f43da5c7.slice/crio-eb51b00ae8712510e6ac53f0e0c9a38edc1041b30bf9d6390a01b124f0c15002 WatchSource:0}: Error finding container eb51b00ae8712510e6ac53f0e0c9a38edc1041b30bf9d6390a01b124f0c15002: Status 404 returned error can't find the container with id eb51b00ae8712510e6ac53f0e0c9a38edc1041b30bf9d6390a01b124f0c15002 Jun 15 06:46:21.939100 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.939063 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" event={"ID":"1c32476e-a0e7-4c6b-b909-0d39f43da5c7","Type":"ContainerStarted","Data":"2400d01938490ae4216379f32200224da8ee22447f6c40ee3a6515c8b5f62c6c"} Jun 15 06:46:21.939310 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.939117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" event={"ID":"1c32476e-a0e7-4c6b-b909-0d39f43da5c7","Type":"ContainerStarted","Data":"eb51b00ae8712510e6ac53f0e0c9a38edc1041b30bf9d6390a01b124f0c15002"} Jun 15 06:46:21.939310 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.939280 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:21.956423 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:21.956368 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" podStartSLOduration=0.956350003 podStartE2EDuration="956.350003ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 06:46:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 06:46:21.955426715 +0000 UTC m=+1234.250954002" watchObservedRunningTime="2026-06-15 06:46:21.956350003 +0000 UTC m=+1234.251877289" Jun 15 06:46:23.064663 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:23.064636 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-grmt5_569583f2-a93b-4cfe-84b2-33896cfb27b2/dns/0.log" Jun 15 06:46:23.081161 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:23.081140 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-grmt5_569583f2-a93b-4cfe-84b2-33896cfb27b2/kube-rbac-proxy/0.log" Jun 15 06:46:23.215448 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:23.215421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rjxcq_1193db8a-f0f2-4f9f-8eef-fd4f79f8b088/dns-node-resolver/0.log" Jun 15 06:46:23.782627 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:23.782601 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qjd6k_be585863-e1e4-43d4-a260-c9409de3709e/node-ca/0.log" Jun 15 06:46:24.679578 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:24.679532 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-bqlmn_84d024c8-d2ae-433e-91ab-f99ebe5f915e/discovery/0.log" Jun 15 06:46:24.719657 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:24.719628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78f945c984-kf4jq_abedeecc-9cc3-4f1a-8344-001a5378e936/kube-auth-proxy/0.log" Jun 15 06:46:24.767122 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:24.767092 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zhldz_66349a91-2e10-4976-a5d6-63cb0bcc5b1c/payload-pre-processing/0.log" Jun 15 06:46:24.790485 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:24.790455 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-26qqf_1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e/payload-processing/0.log" Jun 15 06:46:24.814201 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:24.814176 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ffcd796f6-fff9z_e9504a48-d19f-4e36-bd5e-977e2e91be54/router/0.log" Jun 15 06:46:25.486024 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:25.485985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pgbtz_4d5138e6-62ab-4f06-a188-6bc66ed14d7f/serve-healthcheck-canary/0.log" Jun 15 06:46:25.995787 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:25.995750 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-bpkcx_f90f885d-a57e-4f6b-aad4-1c83c98d06ce/insights-operator/0.log" Jun 15 06:46:25.996193 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:25.995817 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-bpkcx_f90f885d-a57e-4f6b-aad4-1c83c98d06ce/insights-operator/1.log" Jun 15 06:46:26.117464 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:26.117436 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxm22_20af2241-970a-4103-863b-6ab58ee334ae/kube-rbac-proxy/0.log" Jun 15 06:46:26.133898 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:26.133842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxm22_20af2241-970a-4103-863b-6ab58ee334ae/exporter/0.log" Jun 15 06:46:26.152024 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:26.151995 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxm22_20af2241-970a-4103-863b-6ab58ee334ae/extractor/0.log" Jun 15 06:46:27.956287 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:27.956251 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hgnlg/perf-node-gather-daemonset-hmqgd" Jun 15 06:46:28.345559 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:28.345529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c65f9d4c5-t6g5v_168d2a05-1f4e-46f1-88d0-a0bc021605bb/nginx/0.log" Jun 15 06:46:28.367090 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:28.367043 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lw5hr_e3cb71a0-5121-4d97-a75a-4ad878de0132/manager/0.log" Jun 15 06:46:28.401077 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:28.401044 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-kxndx_404df091-72ac-4ce9-99d8-9b79a65052be/manager/0.log" Jun 15 06:46:28.418955 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:28.418913 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-979766d59-2gpcn_ac3c4b6a-7e37-4ee3-b411-460d38c4462a/maas-api/0.log" Jun 15 06:46:28.444598 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:28.444569 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cfc8854f8-stmmf_3060c62e-5826-4d2f-93ef-6aab80aa753a/manager/0.log" Jun 15 06:46:28.465280 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:28.465258 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-m8ksl_53f2d478-c056-4d13-85cc-36daa2e0360f/server/0.log" Jun 15 06:46:28.517243 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:28.517205 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-wtknj_f3da1fc8-6a5f-4a9e-8610-a4346beb562e/manager/0.log" Jun 15 06:46:28.671708 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:28.671601 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6944f646d8-5pk4k_250dde14-4122-488f-b850-7a43f56547f5/manager/0.log" Jun 15 06:46:28.687109 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:28.687080 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6944f646d8-5pk4k_250dde14-4122-488f-b850-7a43f56547f5/copy-manifests/0.log" Jun 15 06:46:30.511856 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:30.511780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-znxqn_5b8deba7-7202-4725-81a3-4d73f959b7e7/openshift-lws-operator/0.log" Jun 15 06:46:35.573473 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:35.573438 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-bqlmn_84d024c8-d2ae-433e-91ab-f99ebe5f915e/discovery/0.log" Jun 15 06:46:35.596454 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:35.596423 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78f945c984-kf4jq_abedeecc-9cc3-4f1a-8344-001a5378e936/kube-auth-proxy/0.log" Jun 15 06:46:35.624826 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:35.624795 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zhldz_66349a91-2e10-4976-a5d6-63cb0bcc5b1c/payload-pre-processing/0.log" Jun 15 06:46:35.641006 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:35.640980 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-26qqf_1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e/payload-processing/0.log" Jun 15 06:46:35.654912 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:35.654858 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ffcd796f6-fff9z_e9504a48-d19f-4e36-bd5e-977e2e91be54/router/0.log" Jun 15 06:46:35.917079 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:35.916999 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-4pvgp_171a15a6-9d97-4ff2-ba21-d81a93a93cdb/kube-storage-version-migrator-operator/1.log" Jun 15 06:46:35.917960 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:35.917940 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-4pvgp_171a15a6-9d97-4ff2-ba21-d81a93a93cdb/kube-storage-version-migrator-operator/0.log" Jun 15 06:46:36.727411 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:36.727379 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-bqlmn_84d024c8-d2ae-433e-91ab-f99ebe5f915e/discovery/0.log" Jun 15 06:46:36.751588 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:36.751559 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78f945c984-kf4jq_abedeecc-9cc3-4f1a-8344-001a5378e936/kube-auth-proxy/0.log" Jun 15 06:46:36.785480 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:36.785450 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zhldz_66349a91-2e10-4976-a5d6-63cb0bcc5b1c/payload-pre-processing/0.log" Jun 15 06:46:36.798892 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:36.798844 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-26qqf_1cfa1ac3-4974-4e8d-bb43-dd1c3958b36e/payload-processing/0.log" Jun 15 06:46:36.816165 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:36.816128 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ffcd796f6-fff9z_e9504a48-d19f-4e36-bd5e-977e2e91be54/router/0.log" Jun 15 06:46:37.424579 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:37.424554 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2d6t_de2eb6e4-34bf-4853-a6eb-0d4b9170c30b/kube-multus-additional-cni-plugins/0.log" Jun 15 06:46:37.445735 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:37.445705 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2d6t_de2eb6e4-34bf-4853-a6eb-0d4b9170c30b/egress-router-binary-copy/0.log" Jun 15 06:46:37.465011 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:37.464986 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2d6t_de2eb6e4-34bf-4853-a6eb-0d4b9170c30b/cni-plugins/0.log" Jun 15 06:46:37.482058 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:37.482033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2d6t_de2eb6e4-34bf-4853-a6eb-0d4b9170c30b/bond-cni-plugin/0.log" Jun 15 06:46:37.499054 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:37.499031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2d6t_de2eb6e4-34bf-4853-a6eb-0d4b9170c30b/routeoverride-cni/0.log" Jun 15 06:46:37.516661 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:37.516633 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2d6t_de2eb6e4-34bf-4853-a6eb-0d4b9170c30b/whereabouts-cni-bincopy/0.log" Jun 15 06:46:37.533222 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:37.533200 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2d6t_de2eb6e4-34bf-4853-a6eb-0d4b9170c30b/whereabouts-cni/0.log" Jun 15 06:46:37.593418 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:37.593389 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r6lk5_85f05280-f319-4538-a205-ad382136d787/kube-multus/0.log" Jun 15 06:46:37.609640 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:37.609613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-77v27_7a53739e-5156-4475-b741-e13c84564d26/network-metrics-daemon/0.log" Jun 15 06:46:37.623965 ip-10-0-140-165 kubenswrapper[2576]: I0615 06:46:37.623925 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-77v27_7a53739e-5156-4475-b741-e13c84564d26/kube-rbac-proxy/0.log"