Jun 09 12:38:16.775549 ip-10-0-141-159 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 12:38:16.775562 ip-10-0-141-159 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 12:38:16.775571 ip-10-0-141-159 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 12:38:16.775842 ip-10-0-141-159 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 12:38:26.919308 ip-10-0-141-159 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 12:38:26.919324 ip-10-0-141-159 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f4abfc414aa74bcf91adb243c1869a05 -- Jun 09 12:41:03.038186 ip-10-0-141-159 systemd[1]: Starting Kubernetes Kubelet... Jun 09 12:41:03.492141 ip-10-0-141-159 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:41:03.492141 ip-10-0-141-159 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 12:41:03.492141 ip-10-0-141-159 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:41:03.492141 ip-10-0-141-159 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 12:41:03.492141 ip-10-0-141-159 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:41:03.492803 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.492204 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 12:41:03.497127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497111 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:03.497127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497126 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497130 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497134 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497137 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497140 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497143 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497146 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497149 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497153 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497155 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497158 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497161 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497164 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497175 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497178 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497181 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497183 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497186 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497189 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497192 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:03.497192 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497195 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497197 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497200 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497203 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497206 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497209 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497211 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497213 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497216 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497218 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497221 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497223 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497226 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497228 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497231 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497233 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497237 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497241 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497244 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497246 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:03.497657 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497249 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497252 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497255 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497258 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497261 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497264 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497267 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497269 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497272 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497274 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497277 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497279 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497282 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497284 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497287 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497289 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497292 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497294 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497297 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497299 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:03.498216 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497302 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497304 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497307 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497309 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497312 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497314 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497317 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497319 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497322 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497325 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497328 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497330 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497333 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497335 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497340 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497344 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497346 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497349 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497351 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:03.498690 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497354 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497356 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497360 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497363 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497365 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497368 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497370 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497373 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497375 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497378 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497380 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497383 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497385 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497388 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497392 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497395 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497398 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497401 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.497404 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:03.499189 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498104 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498112 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498115 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498118 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498122 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498125 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498128 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498131 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498134 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498137 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498140 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498143 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498146 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498149 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498151 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498154 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498156 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498159 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498161 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:03.499642 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498164 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498166 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498169 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498172 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498174 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498177 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498179 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498182 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498184 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498187 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498190 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498192 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498195 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498198 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498200 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498203 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498206 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498208 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498211 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498214 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:03.500127 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498217 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498220 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498223 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498227 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498231 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498234 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498237 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498239 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498242 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498244 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498247 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498249 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498252 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498254 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498257 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498259 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498262 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498265 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498267 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498270 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:03.500640 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498272 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498275 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498277 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498280 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498282 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498285 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498287 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498290 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498293 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498295 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498298 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498300 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498310 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498313 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498316 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498318 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498321 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498325 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498328 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:03.501144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498331 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498333 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498336 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498339 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498342 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498344 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498347 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498349 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498352 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498354 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498357 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498359 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498362 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498364 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498367 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498369 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498372 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498374 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498378 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:03.501609 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498381 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498385 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498765 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498770 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498774 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498777 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498785 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498789 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498791 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498795 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498797 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498800 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498803 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498805 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498808 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498810 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498813 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498817 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498820 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498823 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:03.502088 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498825 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498828 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498831 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498834 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498836 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498839 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498842 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498844 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498847 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498850 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498852 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498855 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498857 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498860 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498862 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498864 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498867 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498869 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498872 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498880 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:03.502572 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498883 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498886 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498888 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498891 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498909 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498912 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498915 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498917 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498920 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498922 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498925 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498927 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498930 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498933 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498936 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498938 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498941 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498944 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498946 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498949 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:03.503073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498951 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498954 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498957 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498959 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498961 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498966 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498969 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498971 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498974 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498977 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498979 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498984 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498995 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.498998 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499000 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499003 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499005 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499008 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499010 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499013 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:03.503568 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499016 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499018 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499021 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499024 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499026 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499029 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499032 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499034 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499036 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499039 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499042 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499044 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499046 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499050 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499054 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499057 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499059 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499061 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499064 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:03.504099 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499066 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499069 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499140 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499151 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499159 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499163 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499168 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499171 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499175 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499179 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499183 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499186 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499189 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499192 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499196 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499199 2561 flags.go:64] FLAG: --cgroup-root="" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499205 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499208 2561 flags.go:64] FLAG: --client-ca-file="" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499211 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499214 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499217 2561 flags.go:64] FLAG: --cluster-domain="" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499221 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499224 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 12:41:03.504561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499227 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499230 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499233 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499236 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499239 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499243 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499245 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499248 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499251 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499254 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499257 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499261 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499264 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499268 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499270 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499273 2561 flags.go:64] FLAG: --enable-server="true" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499277 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499281 2561 flags.go:64] FLAG: --event-burst="100" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499284 2561 flags.go:64] FLAG: --event-qps="50" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499287 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499290 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499293 2561 flags.go:64] FLAG: --eviction-hard="" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499296 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499299 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499302 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 12:41:03.505126 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499306 2561 flags.go:64] FLAG: --eviction-soft="" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499309 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499312 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499315 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499318 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499321 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499323 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499326 2561 flags.go:64] FLAG: --feature-gates="" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499329 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499332 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499335 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499338 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499341 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499344 2561 flags.go:64] FLAG: --help="false" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499347 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499350 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499353 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499355 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499358 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499362 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499366 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499368 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499371 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 12:41:03.505720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499374 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499377 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499380 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499383 2561 flags.go:64] FLAG: --kube-reserved="" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499386 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499388 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499391 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499394 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499397 2561 flags.go:64] FLAG: --lock-file="" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499401 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499404 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499407 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499412 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499415 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499418 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499421 2561 flags.go:64] FLAG: --logging-format="text" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499423 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499426 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499429 2561 flags.go:64] FLAG: --manifest-url="" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499432 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499436 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499439 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499443 2561 flags.go:64] FLAG: --max-pods="110" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499446 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499449 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 12:41:03.506337 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499451 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499454 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499457 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499460 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499464 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499471 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499474 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499477 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499480 2561 flags.go:64] FLAG: --pod-cidr="" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499484 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499489 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499492 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499495 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499498 2561 flags.go:64] FLAG: --port="10250" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499501 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499503 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa9319ef16915b97" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499506 2561 flags.go:64] FLAG: --qos-reserved="" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499510 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499513 2561 flags.go:64] FLAG: --register-node="true" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499516 2561 flags.go:64] FLAG: --register-with-taints="" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499520 2561 flags.go:64] FLAG: --registry-burst="10" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499522 2561 flags.go:64] FLAG: --registry-qps="5" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499525 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499528 2561 flags.go:64] FLAG: --reserved-memory="" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499531 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 12:41:03.506964 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499534 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499537 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499540 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499542 2561 flags.go:64] FLAG: --runonce="false" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499545 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499548 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499551 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499553 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499556 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499559 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499562 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499566 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499568 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499571 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499574 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499577 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499580 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499583 2561 flags.go:64] FLAG: --system-cgroups="" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499585 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499590 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499593 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499596 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499599 2561 flags.go:64] FLAG: --tls-min-version="" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499602 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499606 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 12:41:03.507589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499609 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499612 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499615 2561 flags.go:64] FLAG: --v="2" Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499619 2561 flags.go:64] FLAG: --version="false" Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499623 2561 flags.go:64] FLAG: --vmodule="" Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499626 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.499630 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499760 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499764 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499767 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499769 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499772 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499775 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499777 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499780 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499783 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499785 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499789 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499794 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499797 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499799 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:03.508219 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499802 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499804 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499808 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499811 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499815 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499817 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499820 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499823 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499825 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499828 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499832 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499835 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499837 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499840 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499843 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499845 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499848 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499850 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499853 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499855 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:03.508817 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499858 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499860 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499863 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499865 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499868 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499870 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499874 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499877 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499880 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499884 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499887 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499890 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499907 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499910 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499913 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499915 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499918 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499921 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499924 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:03.509325 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499927 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499930 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499932 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499937 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499940 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499943 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499945 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499948 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499950 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499953 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499955 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499958 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499961 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499963 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499966 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499968 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499971 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499973 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499976 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499979 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:03.509786 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499981 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499984 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499987 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499990 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499993 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499995 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.499997 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500000 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500002 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500005 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500007 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500010 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500013 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500015 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500018 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500021 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500024 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500026 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500029 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:03.510333 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500031 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500034 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500036 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500039 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500041 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500044 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.500047 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.500823 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.507749 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.507763 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.507776 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.507781 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507836 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507842 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:03.510780 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507844 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507849 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507852 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507856 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507859 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507862 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507864 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507867 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507869 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507872 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507876 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507879 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507882 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507884 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507887 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507890 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507892 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507909 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507912 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:03.511142 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507914 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507917 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507920 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507923 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507925 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507928 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507930 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507933 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507936 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507939 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507942 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507945 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507947 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507950 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507953 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507956 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507958 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507961 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507964 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507966 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:03.511593 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507969 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507971 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507975 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507978 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507982 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507985 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507987 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507990 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507993 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507996 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.507998 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508001 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508003 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508006 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508008 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508011 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508013 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508016 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508019 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508021 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:03.512089 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508024 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508028 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508030 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508033 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508036 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508038 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508041 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508043 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508046 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508048 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508051 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508053 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508056 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508059 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508061 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508063 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508066 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508069 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508071 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508074 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:03.512567 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508076 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508079 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508082 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508084 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508087 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508089 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508091 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508094 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508096 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508099 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508101 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508103 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508106 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508110 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508113 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508116 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508119 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:03.513096 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508122 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.508127 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508233 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508238 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508241 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508245 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508249 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508253 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508256 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508259 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508261 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508264 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508267 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508273 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:03.513513 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508276 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508279 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508281 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508284 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508287 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508290 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508293 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508295 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508298 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508300 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508303 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508306 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508309 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508311 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508314 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508317 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508320 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508322 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508325 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508328 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:03.513856 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508331 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508334 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508337 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508340 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508342 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508345 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508347 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508349 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508352 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508354 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508357 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508359 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508362 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508365 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508367 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508370 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508372 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508375 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508380 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508386 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:03.514361 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508391 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508394 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508398 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508402 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508406 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508409 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508411 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508414 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508416 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508419 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508422 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508424 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508427 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508429 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508431 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508434 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508436 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508439 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508441 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508444 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:03.514839 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508447 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508449 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508451 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508454 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508456 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508462 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508464 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508467 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508469 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508471 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508474 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508477 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508480 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508482 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508485 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508487 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508490 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508492 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508495 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508497 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:03.515327 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508500 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508502 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508504 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508507 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508509 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508512 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:03.508514 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.508519 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.508611 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.510733 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.512228 2561 server.go:1019] "Starting client certificate rotation" Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.512332 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.512364 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 12:41:03.515810 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.515205 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 12:41:03.516513 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.516488 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 12:41:03.530858 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.530838 2561 log.go:25] "Validated CRI v1 runtime API" Jun 09 12:41:03.535853 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.535836 2561 log.go:25] "Validated CRI v1 image API" Jun 09 12:41:03.536589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.536576 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 12:41:03.539144 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.539105 2561 fs.go:135] Filesystem UUIDs: map[4046e97b-0f8f-4fba-85be-5722fa6015b1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b1d3bcb4-d504-4527-80fb-98874e8cbffd:/dev/nvme0n1p4] Jun 09 12:41:03.539197 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.539143 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 12:41:03.545587 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.545482 2561 manager.go:216] Machine: {Timestamp:2026-06-09 12:41:03.544057178 +0000 UTC m=+0.378263434 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103027 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28f35182a72e82ab87c1f11ab89caa SystemUUID:ec28f351-82a7-2e82-ab87-c1f11ab89caa BootID:f4abfc41-4aa7-4bcf-91ad-b243c1869a05 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a8:82:5b:04:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a8:82:5b:04:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:ad:56:b9:72:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 12:41:03.545587 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.545584 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 12:41:03.545696 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.545684 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 12:41:03.547809 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.547782 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 12:41:03.547954 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.547812 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-159.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 12:41:03.548713 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.548703 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 12:41:03.548754 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.548716 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 12:41:03.548754 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.548724 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 12:41:03.549955 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.549944 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 12:41:03.551447 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.551436 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 12:41:03.555168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.555152 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 12:41:03.555565 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.555552 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 09 12:41:03.555823 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.555814 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 12:41:03.555852 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.555845 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 09 12:41:03.555879 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.555855 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 12:41:03.555879 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.555869 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 12:41:03.555879 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.555879 2561 kubelet.go:398] "Adding apiserver pod source" Jun 09 12:41:03.556018 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.555887 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 12:41:03.556242 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.556228 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 12:41:03.556299 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.556252 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 12:41:03.567594 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.567573 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 12:41:03.567738 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.567717 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 12:41:03.567779 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.567746 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 12:41:03.569214 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.569198 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 12:41:03.569290 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.569236 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 12:41:03.570675 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570662 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 12:41:03.570748 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570681 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 12:41:03.570748 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570691 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 12:41:03.570748 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570698 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 12:41:03.570748 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570711 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 12:41:03.570748 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570720 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 12:41:03.570748 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570733 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 12:41:03.570748 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570740 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 12:41:03.570748 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570750 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 12:41:03.571002 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570759 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 12:41:03.571002 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570772 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 12:41:03.571002 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.570780 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 12:41:03.572728 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.572716 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 12:41:03.572778 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.572732 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 12:41:03.575003 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.574984 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-159.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 12:41:03.575643 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.575629 2561 server.go:1268] "Started kubelet" Jun 09 12:41:03.575730 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.575705 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 12:41:03.575825 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.575798 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 12:41:03.575970 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.575838 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 12:41:03.576575 ip-10-0-141-159 systemd[1]: Started Kubernetes Kubelet. Jun 09 12:41:03.580150 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.579999 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 12:41:03.580977 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.580963 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 09 12:41:03.585802 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.585777 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.587261 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.587270 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.587345 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.587918 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.587935 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.587918 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.588058 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.588062 2561 factory.go:55] Registering systemd factory Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.588079 2561 factory.go:223] Registration of the systemd container factory successfully Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.588067 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.588413 2561 factory.go:153] Registering CRI-O factory Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.588427 2561 factory.go:223] Registration of the crio container factory successfully Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.588473 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.588495 2561 factory.go:103] Registering Raw factory Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.588510 2561 manager.go:1196] Started watching for new ooms in manager Jun 09 12:41:03.591561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.588822 2561 manager.go:349] Starting recovery of all containers Jun 09 12:41:03.595007 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.594966 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8x9d7" Jun 09 12:41:03.596443 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.596404 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 12:41:03.596584 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.596561 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 12:41:03.597711 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.596500 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-159.ec2.internal.18b76a200f3ef614 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-159.ec2.internal,UID:ip-10-0-141-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-159.ec2.internal,},FirstTimestamp:2026-06-09 12:41:03.575602708 +0000 UTC m=+0.409808964,LastTimestamp:2026-06-09 12:41:03.575602708 +0000 UTC m=+0.409808964,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-159.ec2.internal,}" Jun 09 12:41:03.598967 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.598948 2561 manager.go:354] Recovery completed Jun 09 12:41:03.603039 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.603026 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:03.605786 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.605767 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:03.605862 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.605804 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:03.605862 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.605819 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:03.606129 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.606113 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8x9d7" Jun 09 12:41:03.606389 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.606378 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 12:41:03.606444 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.606390 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 12:41:03.606444 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.606407 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 09 12:41:03.606444 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.606392 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:03.607171 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.607153 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:03.607226 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.607188 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:03.607269 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.607228 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:03.608123 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.608048 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-159.ec2.internal.18b76a20110b8acf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-159.ec2.internal,UID:ip-10-0-141-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-159.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-159.ec2.internal,},FirstTimestamp:2026-06-09 12:41:03.605787343 +0000 UTC m=+0.439993608,LastTimestamp:2026-06-09 12:41:03.605787343 +0000 UTC m=+0.439993608,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-159.ec2.internal,}" Jun 09 12:41:03.609475 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.609460 2561 policy_none.go:49] "None policy: Start" Jun 09 12:41:03.609552 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.609478 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 12:41:03.609552 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.609492 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 12:41:03.611251 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.611238 2561 policy_none.go:47] "Start" Jun 09 12:41:03.649529 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.649506 2561 manager.go:337] "Starting Device Plugin manager" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.649574 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.649585 2561 server.go:87] "Starting device plugin registration server" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.649795 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.649807 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.650396 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.650510 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.650554 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.650557 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.650569 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.654043 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.655300 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.655331 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.655347 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.655374 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 12:41:03.664994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.657279 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:03.750248 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.750193 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:03.752085 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.752065 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:03.752166 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.752098 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:03.752166 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.752108 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:03.752166 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.752129 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.755841 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.755824 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal"] Jun 09 12:41:03.755930 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.755891 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:03.757392 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.757376 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:03.757471 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.757406 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:03.757471 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.757421 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:03.759723 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.759709 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:03.759803 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.759796 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.759858 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.759825 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:03.760434 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.760418 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:03.760519 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.760435 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:03.760519 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.760448 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:03.760519 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.760458 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:03.760519 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.760464 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:03.760519 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.760473 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:03.761991 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.761974 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.762057 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.762011 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-159.ec2.internal\": node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:03.762644 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.762631 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.762689 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.762655 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:03.763628 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.763613 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:03.763677 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.763646 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:03.763677 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.763661 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:03.776603 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.776585 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:03.779415 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.779402 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-159.ec2.internal\" not found" node="ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.783201 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.783185 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-159.ec2.internal\" not found" node="ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.789174 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.789158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.789246 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.789187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.789246 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.789213 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88c7314f7fb6629a9e73aba1ffec2ed4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-159.ec2.internal\" (UID: \"88c7314f7fb6629a9e73aba1ffec2ed4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.876886 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.876863 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:03.890219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.890200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.890302 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.890225 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.890302 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.890241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88c7314f7fb6629a9e73aba1ffec2ed4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-159.ec2.internal\" (UID: \"88c7314f7fb6629a9e73aba1ffec2ed4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.890302 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.890288 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88c7314f7fb6629a9e73aba1ffec2ed4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-159.ec2.internal\" (UID: \"88c7314f7fb6629a9e73aba1ffec2ed4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.890302 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.890295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.890417 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:03.890313 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14c7604689d2953ccbf42e9f811949bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal\" (UID: \"14c7604689d2953ccbf42e9f811949bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 09 12:41:03.976979 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:03.976957 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:04.077785 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:04.077709 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:04.085876 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.085855 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 09 12:41:04.089237 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.089215 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 09 12:41:04.178057 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:04.178026 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:04.278535 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:04.278496 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:04.379125 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:04.379038 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:04.479684 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:04.479653 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-159.ec2.internal\" not found" Jun 09 12:41:04.489681 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.489664 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:04.511635 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.511613 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 12:41:04.512187 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.511755 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:41:04.512187 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.511787 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:41:04.572081 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.572060 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:04.587376 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.587358 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 12:41:04.587465 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.587382 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" Jun 09 12:41:04.601237 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.601216 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 12:41:04.602410 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.602392 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" Jun 09 12:41:04.607754 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.607738 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 12:41:04.609722 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.609694 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 12:36:03 +0000 UTC" deadline="2028-03-21 19:49:32.26541745 +0000 UTC" Jun 09 12:41:04.609792 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.609723 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15631h8m27.65569842s" Jun 09 12:41:04.616356 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.616340 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 12:41:04.619144 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:04.619103 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c7604689d2953ccbf42e9f811949bd.slice/crio-02b72a7ec12a2567a565c792438b1f47d694d2dc69c709cd987281dbd5778e5a WatchSource:0}: Error finding container 02b72a7ec12a2567a565c792438b1f47d694d2dc69c709cd987281dbd5778e5a: Status 404 returned error can't find the container with id 02b72a7ec12a2567a565c792438b1f47d694d2dc69c709cd987281dbd5778e5a Jun 09 12:41:04.619383 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:04.619364 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c7314f7fb6629a9e73aba1ffec2ed4.slice/crio-e031a9d069c8eb17eb3f51ef8fc53fbe1611a09eab2d24dd12e69d5ea138a253 WatchSource:0}: Error finding container e031a9d069c8eb17eb3f51ef8fc53fbe1611a09eab2d24dd12e69d5ea138a253: Status 404 returned error can't find the container with id e031a9d069c8eb17eb3f51ef8fc53fbe1611a09eab2d24dd12e69d5ea138a253 Jun 09 12:41:04.623455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.623440 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:41:04.642297 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.642251 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qklwx" Jun 09 12:41:04.649518 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.649493 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qklwx" Jun 09 12:41:04.658666 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.658628 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" event={"ID":"88c7314f7fb6629a9e73aba1ffec2ed4","Type":"ContainerStarted","Data":"e031a9d069c8eb17eb3f51ef8fc53fbe1611a09eab2d24dd12e69d5ea138a253"} Jun 09 12:41:04.659602 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.659580 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" event={"ID":"14c7604689d2953ccbf42e9f811949bd","Type":"ContainerStarted","Data":"02b72a7ec12a2567a565c792438b1f47d694d2dc69c709cd987281dbd5778e5a"} Jun 09 12:41:04.884492 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:04.884459 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:05.557251 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.557220 2561 apiserver.go:52] "Watching apiserver" Jun 09 12:41:05.566153 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.565938 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 12:41:05.566372 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.566350 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-xkvmm","openshift-network-diagnostics/network-check-target-8ptt5","openshift-network-operator/iptables-alerter-5sx6d","kube-system/global-pull-secret-syncer-6mrv2","kube-system/konnectivity-agent-kr72z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal","openshift-multus/multus-additional-cni-plugins-nr9vx","openshift-ovn-kubernetes/ovnkube-node-9t7r9","kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2xpl9","openshift-dns/node-resolver-lclj7","openshift-image-registry/node-ca-vr7cj","openshift-multus/multus-hqj5x"] Jun 09 12:41:05.569215 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.569194 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.571253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.571230 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:05.571356 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.571297 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:05.572073 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.572055 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 12:41:05.572154 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.572129 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6vgsm\"" Jun 09 12:41:05.572307 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.572281 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 12:41:05.572307 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.572057 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 12:41:05.572476 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.572463 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:05.574677 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.574009 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.575455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.575435 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:05.575545 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.575497 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:05.576518 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.576499 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 12:41:05.576747 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.576728 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:05.576864 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.576750 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2zk2v\"" Jun 09 12:41:05.576864 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.576796 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 12:41:05.578173 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.578150 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:05.580791 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.580417 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.580963 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.580944 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 12:41:05.581058 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.580978 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fjkkf\"" Jun 09 12:41:05.581058 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.580984 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 12:41:05.583320 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.582858 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lb9qc\"" Jun 09 12:41:05.583320 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.582955 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 12:41:05.583320 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.583109 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 12:41:05.583320 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.583167 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 12:41:05.583320 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.583265 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:05.583597 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.583328 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:05.591555 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.591532 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.595526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.595503 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 12:41:05.595681 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.595665 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q4c9h\"" Jun 09 12:41:05.595741 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.595716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.595778 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.595768 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 12:41:05.595850 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.595838 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 12:41:05.596041 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.596023 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 12:41:05.597650 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.597631 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 12:41:05.597956 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.597935 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.598248 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.598229 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 12:41:05.598674 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.598656 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 12:41:05.598749 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.598688 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 12:41:05.599140 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.599122 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-cni-netd\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr5q7\" (UniqueName: \"kubernetes.io/projected/f1205d62-0f9b-4a95-8a0c-f3008657c5a0-kube-api-access-gr5q7\") pod \"iptables-alerter-5sx6d\" (UID: \"f1205d62-0f9b-4a95-8a0c-f3008657c5a0\") " pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/041086e4-a8c7-4333-a3d2-c02129f0370e-dbus\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7de36c10-50d6-4b8b-a558-f159f3786caf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600177 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-systemd-units\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-var-lib-openvswitch\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-etc-openvswitch\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-node-log\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06b10c0b-e96e-4be9-929a-247411e5eec3-ovn-node-metrics-cert\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600281 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a4cba33-4421-435a-b171-dad3b72060aa-serviceca\") pod \"node-ca-vr7cj\" (UID: \"3a4cba33-4421-435a-b171-dad3b72060aa\") " pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-etc-selinux\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-run-openvswitch\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600335 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06b10c0b-e96e-4be9-929a-247411e5eec3-ovnkube-script-lib\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600353 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b5dh\" (UniqueName: \"kubernetes.io/projected/06b10c0b-e96e-4be9-929a-247411e5eec3-kube-api-access-7b5dh\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f1e7bb4-8c89-4769-bee9-949a59fa4d6e-konnectivity-ca\") pod \"konnectivity-agent-kr72z\" (UID: \"7f1e7bb4-8c89-4769-bee9-949a59fa4d6e\") " pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:05.601507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58p9t\" (UniqueName: \"kubernetes.io/projected/e6af2cbb-1acd-42b2-a2eb-036c91006f06-kube-api-access-58p9t\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-cnibin\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-log-socket\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f1e7bb4-8c89-4769-bee9-949a59fa4d6e-agent-certs\") pod \"konnectivity-agent-kr72z\" (UID: \"7f1e7bb4-8c89-4769-bee9-949a59fa4d6e\") " pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7de36c10-50d6-4b8b-a558-f159f3786caf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcp7m\" (UniqueName: \"kubernetes.io/projected/7de36c10-50d6-4b8b-a558-f159f3786caf-kube-api-access-hcp7m\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1205d62-0f9b-4a95-8a0c-f3008657c5a0-iptables-alerter-script\") pod \"iptables-alerter-5sx6d\" (UID: \"f1205d62-0f9b-4a95-8a0c-f3008657c5a0\") " pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-sys-fs\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600590 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-system-cni-dir\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-run-ovn\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44glm\" (UniqueName: \"kubernetes.io/projected/2725b703-989a-4bb7-ab75-5945026ccb96-kube-api-access-44glm\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbhhd\" (UniqueName: \"kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd\") pod \"network-check-target-8ptt5\" (UID: \"c9ebeeff-2869-45b5-8dc7-b194b392d68b\") " pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600650 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1205d62-0f9b-4a95-8a0c-f3008657c5a0-host-slash\") pod \"iptables-alerter-5sx6d\" (UID: \"f1205d62-0f9b-4a95-8a0c-f3008657c5a0\") " pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-socket-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.602162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-slash\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-run-systemd\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600742 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a4cba33-4421-435a-b171-dad3b72060aa-host\") pod \"node-ca-vr7cj\" (UID: \"3a4cba33-4421-435a-b171-dad3b72060aa\") " pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-kubelet\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-run-netns\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06b10c0b-e96e-4be9-929a-247411e5eec3-ovnkube-config\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600891 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600933 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-registration-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7de36c10-50d6-4b8b-a558-f159f3786caf-cni-binary-copy\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.600981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-cni-bin\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.601006 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06b10c0b-e96e-4be9-929a-247411e5eec3-env-overrides\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.601028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rtz9\" (UniqueName: \"kubernetes.io/projected/3a4cba33-4421-435a-b171-dad3b72060aa-kube-api-access-9rtz9\") pod \"node-ca-vr7cj\" (UID: \"3a4cba33-4421-435a-b171-dad3b72060aa\") " pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.601052 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/041086e4-a8c7-4333-a3d2-c02129f0370e-kubelet-config\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.601092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-device-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.603004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.601115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-os-release\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.603736 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.601139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-run-ovn-kubernetes\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.603736 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.601191 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2q24n\"" Jun 09 12:41:05.603736 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.601465 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 12:41:05.603736 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.601195 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 12:41:05.603736 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.601608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.603736 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.602356 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:05.603736 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.602659 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gtc7j\"" Jun 09 12:41:05.603736 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.602793 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 12:41:05.607385 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.607364 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:05.607535 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.607515 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 12:41:05.607623 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.607560 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 12:41:05.607623 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.607588 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 12:41:05.607623 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.607612 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9jt5g\"" Jun 09 12:41:05.607773 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.607612 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ltspt\"" Jun 09 12:41:05.653430 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.653404 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 12:36:04 +0000 UTC" deadline="2028-02-09 13:44:00.307703611 +0000 UTC" Jun 09 12:41:05.653430 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.653429 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14641h2m54.654278398s" Jun 09 12:41:05.688792 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.688763 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 12:41:05.701430 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-hostroot\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.701549 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701434 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.701549 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701451 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-kubelet\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.701549 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701468 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-var-lib-cni-multus\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.701549 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92784b61-08b7-423d-a33c-e1943b0d82db-tmp\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.701549 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:05.701549 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701533 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-kubelet\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.701549 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701541 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701541 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7de36c10-50d6-4b8b-a558-f159f3786caf-cni-binary-copy\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06b10c0b-e96e-4be9-929a-247411e5eec3-env-overrides\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-systemd\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.701634 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.701701 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret podName:041086e4-a8c7-4333-a3d2-c02129f0370e nodeName:}" failed. No retries permitted until 2026-06-09 12:41:06.201678467 +0000 UTC m=+3.035884718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret") pod "global-pull-secret-syncer-6mrv2" (UID: "041086e4-a8c7-4333-a3d2-c02129f0370e") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rtz9\" (UniqueName: \"kubernetes.io/projected/3a4cba33-4421-435a-b171-dad3b72060aa-kube-api-access-9rtz9\") pod \"node-ca-vr7cj\" (UID: \"3a4cba33-4421-435a-b171-dad3b72060aa\") " pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-os-release\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-cni-netd\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701811 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr5q7\" (UniqueName: \"kubernetes.io/projected/f1205d62-0f9b-4a95-8a0c-f3008657c5a0-kube-api-access-gr5q7\") pod \"iptables-alerter-5sx6d\" (UID: \"f1205d62-0f9b-4a95-8a0c-f3008657c5a0\") " pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-os-release\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701861 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-cni-netd\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.701934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7de36c10-50d6-4b8b-a558-f159f3786caf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.701948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-systemd-units\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-var-lib-openvswitch\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06b10c0b-e96e-4be9-929a-247411e5eec3-ovn-node-metrics-cert\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-systemd-units\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b5dh\" (UniqueName: \"kubernetes.io/projected/06b10c0b-e96e-4be9-929a-247411e5eec3-kube-api-access-7b5dh\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-system-cni-dir\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-cni-dir\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702123 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-var-lib-openvswitch\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702136 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7de36c10-50d6-4b8b-a558-f159f3786caf-cni-binary-copy\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702148 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06b10c0b-e96e-4be9-929a-247411e5eec3-env-overrides\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-etc-selinux\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702225 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-var-lib-kubelet\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702195 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-etc-selinux\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702281 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-run-multus-certs\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-kubernetes\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.702503 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-var-lib-kubelet\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.702358 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58p9t\" (UniqueName: \"kubernetes.io/projected/e6af2cbb-1acd-42b2-a2eb-036c91006f06-kube-api-access-58p9t\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-cnibin\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.702416 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs podName:2725b703-989a-4bb7-ab75-5945026ccb96 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:06.202398608 +0000 UTC m=+3.036604854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs") pod "network-metrics-daemon-xkvmm" (UID: "2725b703-989a-4bb7-ab75-5945026ccb96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702435 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-cnibin\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702435 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7de36c10-50d6-4b8b-a558-f159f3786caf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-log-socket\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f1e7bb4-8c89-4769-bee9-949a59fa4d6e-agent-certs\") pod \"konnectivity-agent-kr72z\" (UID: \"7f1e7bb4-8c89-4769-bee9-949a59fa4d6e\") " pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-sys\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702533 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-log-socket\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcp7m\" (UniqueName: \"kubernetes.io/projected/7de36c10-50d6-4b8b-a558-f159f3786caf-kube-api-access-hcp7m\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702573 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1205d62-0f9b-4a95-8a0c-f3008657c5a0-iptables-alerter-script\") pod \"iptables-alerter-5sx6d\" (UID: \"f1205d62-0f9b-4a95-8a0c-f3008657c5a0\") " pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-run-ovn\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-conf-dir\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702676 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-run\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.703315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-lib-modules\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-slash\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-run-systemd\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88b63d7d-8180-44f1-9019-975a3d9ee716-hosts-file\") pod \"node-resolver-lclj7\" (UID: \"88b63d7d-8180-44f1-9019-975a3d9ee716\") " pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-sysconfig\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-run-ovn\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a4cba33-4421-435a-b171-dad3b72060aa-host\") pod \"node-ca-vr7cj\" (UID: \"3a4cba33-4421-435a-b171-dad3b72060aa\") " pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-run-netns\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702892 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-run-systemd\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702929 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-slash\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a4cba33-4421-435a-b171-dad3b72060aa-host\") pod \"node-ca-vr7cj\" (UID: \"3a4cba33-4421-435a-b171-dad3b72060aa\") " pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702961 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06b10c0b-e96e-4be9-929a-247411e5eec3-ovnkube-config\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702967 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702972 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-run-netns\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.702997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-cni-binary-copy\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-modprobe-d\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.704168 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-registration-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-cni-bin\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-daemon-config\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703105 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-registration-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29gd6\" (UniqueName: \"kubernetes.io/projected/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-kube-api-access-29gd6\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/041086e4-a8c7-4333-a3d2-c02129f0370e-kubelet-config\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703147 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-cni-bin\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703181 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-device-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703188 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/041086e4-a8c7-4333-a3d2-c02129f0370e-kubelet-config\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703197 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1205d62-0f9b-4a95-8a0c-f3008657c5a0-iptables-alerter-script\") pod \"iptables-alerter-5sx6d\" (UID: \"f1205d62-0f9b-4a95-8a0c-f3008657c5a0\") " pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-run-ovn-kubernetes\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703228 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-device-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2gwg\" (UniqueName: \"kubernetes.io/projected/88b63d7d-8180-44f1-9019-975a3d9ee716-kube-api-access-f2gwg\") pod \"node-resolver-lclj7\" (UID: \"88b63d7d-8180-44f1-9019-975a3d9ee716\") " pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703252 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-host-run-ovn-kubernetes\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703269 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/041086e4-a8c7-4333-a3d2-c02129f0370e-dbus\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-etc-openvswitch\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-node-log\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.704946 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703384 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-etc-openvswitch\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703422 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-node-log\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06b10c0b-e96e-4be9-929a-247411e5eec3-ovnkube-script-lib\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703446 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/041086e4-a8c7-4333-a3d2-c02129f0370e-dbus\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703475 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06b10c0b-e96e-4be9-929a-247411e5eec3-ovnkube-config\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f1e7bb4-8c89-4769-bee9-949a59fa4d6e-konnectivity-ca\") pod \"konnectivity-agent-kr72z\" (UID: \"7f1e7bb4-8c89-4769-bee9-949a59fa4d6e\") " pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-var-lib-cni-bin\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a4cba33-4421-435a-b171-dad3b72060aa-serviceca\") pod \"node-ca-vr7cj\" (UID: \"3a4cba33-4421-435a-b171-dad3b72060aa\") " pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-run-openvswitch\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703622 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-os-release\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-etc-kubernetes\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703683 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06b10c0b-e96e-4be9-929a-247411e5eec3-run-openvswitch\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92784b61-08b7-423d-a33c-e1943b0d82db-etc-tuned\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tf9l\" (UniqueName: \"kubernetes.io/projected/92784b61-08b7-423d-a33c-e1943b0d82db-kube-api-access-2tf9l\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703808 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-cnibin\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703865 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-socket-dir-parent\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.705580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-run-k8s-cni-cncf-io\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b63d7d-8180-44f1-9019-975a3d9ee716-tmp-dir\") pod \"node-resolver-lclj7\" (UID: \"88b63d7d-8180-44f1-9019-975a3d9ee716\") " pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-sysctl-d\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703974 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703986 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-sysctl-conf\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.703994 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f1e7bb4-8c89-4769-bee9-949a59fa4d6e-konnectivity-ca\") pod \"konnectivity-agent-kr72z\" (UID: \"7f1e7bb4-8c89-4769-bee9-949a59fa4d6e\") " pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7de36c10-50d6-4b8b-a558-f159f3786caf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704078 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06b10c0b-e96e-4be9-929a-247411e5eec3-ovnkube-script-lib\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704086 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-sys-fs\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-system-cni-dir\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704185 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a4cba33-4421-435a-b171-dad3b72060aa-serviceca\") pod \"node-ca-vr7cj\" (UID: \"3a4cba33-4421-435a-b171-dad3b72060aa\") " pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44glm\" (UniqueName: \"kubernetes.io/projected/2725b703-989a-4bb7-ab75-5945026ccb96-kube-api-access-44glm\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704239 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-sys-fs\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-run-netns\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704277 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7de36c10-50d6-4b8b-a558-f159f3786caf-system-cni-dir\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-host\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhhd\" (UniqueName: \"kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd\") pod \"network-check-target-8ptt5\" (UID: \"c9ebeeff-2869-45b5-8dc7-b194b392d68b\") " pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:05.706253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1205d62-0f9b-4a95-8a0c-f3008657c5a0-host-slash\") pod \"iptables-alerter-5sx6d\" (UID: \"f1205d62-0f9b-4a95-8a0c-f3008657c5a0\") " pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.706817 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-socket-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.706817 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704459 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1205d62-0f9b-4a95-8a0c-f3008657c5a0-host-slash\") pod \"iptables-alerter-5sx6d\" (UID: \"f1205d62-0f9b-4a95-8a0c-f3008657c5a0\") " pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.706817 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6af2cbb-1acd-42b2-a2eb-036c91006f06-socket-dir\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.706817 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.704732 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7de36c10-50d6-4b8b-a558-f159f3786caf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.706817 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.705942 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f1e7bb4-8c89-4769-bee9-949a59fa4d6e-agent-certs\") pod \"konnectivity-agent-kr72z\" (UID: \"7f1e7bb4-8c89-4769-bee9-949a59fa4d6e\") " pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:05.706817 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.706104 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06b10c0b-e96e-4be9-929a-247411e5eec3-ovn-node-metrics-cert\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.712153 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.712059 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr5q7\" (UniqueName: \"kubernetes.io/projected/f1205d62-0f9b-4a95-8a0c-f3008657c5a0-kube-api-access-gr5q7\") pod \"iptables-alerter-5sx6d\" (UID: \"f1205d62-0f9b-4a95-8a0c-f3008657c5a0\") " pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.712153 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.712112 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rtz9\" (UniqueName: \"kubernetes.io/projected/3a4cba33-4421-435a-b171-dad3b72060aa-kube-api-access-9rtz9\") pod \"node-ca-vr7cj\" (UID: \"3a4cba33-4421-435a-b171-dad3b72060aa\") " pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.712479 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.712409 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcp7m\" (UniqueName: \"kubernetes.io/projected/7de36c10-50d6-4b8b-a558-f159f3786caf-kube-api-access-hcp7m\") pod \"multus-additional-cni-plugins-nr9vx\" (UID: \"7de36c10-50d6-4b8b-a558-f159f3786caf\") " pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.712844 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.712828 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:05.712953 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.712847 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:05.712953 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.712856 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vbhhd for pod openshift-network-diagnostics/network-check-target-8ptt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:05.712953 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:05.712921 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd podName:c9ebeeff-2869-45b5-8dc7-b194b392d68b nodeName:}" failed. No retries permitted until 2026-06-09 12:41:06.212890738 +0000 UTC m=+3.047096986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vbhhd" (UniqueName: "kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd") pod "network-check-target-8ptt5" (UID: "c9ebeeff-2869-45b5-8dc7-b194b392d68b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:05.713868 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.713846 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58p9t\" (UniqueName: \"kubernetes.io/projected/e6af2cbb-1acd-42b2-a2eb-036c91006f06-kube-api-access-58p9t\") pod \"aws-ebs-csi-driver-node-tj7jh\" (UID: \"e6af2cbb-1acd-42b2-a2eb-036c91006f06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.713990 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.713965 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b5dh\" (UniqueName: \"kubernetes.io/projected/06b10c0b-e96e-4be9-929a-247411e5eec3-kube-api-access-7b5dh\") pod \"ovnkube-node-9t7r9\" (UID: \"06b10c0b-e96e-4be9-929a-247411e5eec3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.715230 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.715206 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44glm\" (UniqueName: \"kubernetes.io/projected/2725b703-989a-4bb7-ab75-5945026ccb96-kube-api-access-44glm\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:05.804723 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804693 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-system-cni-dir\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.804915 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-cni-dir\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.804915 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804817 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-cni-dir\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.804915 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804819 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-system-cni-dir\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.804915 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804862 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-var-lib-kubelet\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804890 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-run-multus-certs\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804939 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-var-lib-kubelet\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-kubernetes\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-var-lib-kubelet\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-kubernetes\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.804986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-sys\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805000 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-run-multus-certs\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-conf-dir\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805028 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-conf-dir\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805032 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-var-lib-kubelet\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-run\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-sys\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-lib-modules\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88b63d7d-8180-44f1-9019-975a3d9ee716-hosts-file\") pod \"node-resolver-lclj7\" (UID: \"88b63d7d-8180-44f1-9019-975a3d9ee716\") " pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805086 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-run\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805099 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-sysconfig\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.805128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-cni-binary-copy\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-modprobe-d\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805178 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-daemon-config\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-lib-modules\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29gd6\" (UniqueName: \"kubernetes.io/projected/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-kube-api-access-29gd6\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805208 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2gwg\" (UniqueName: \"kubernetes.io/projected/88b63d7d-8180-44f1-9019-975a3d9ee716-kube-api-access-f2gwg\") pod \"node-resolver-lclj7\" (UID: \"88b63d7d-8180-44f1-9019-975a3d9ee716\") " pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-var-lib-cni-bin\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88b63d7d-8180-44f1-9019-975a3d9ee716-hosts-file\") pod \"node-resolver-lclj7\" (UID: \"88b63d7d-8180-44f1-9019-975a3d9ee716\") " pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-os-release\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-etc-kubernetes\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-os-release\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92784b61-08b7-423d-a33c-e1943b0d82db-etc-tuned\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tf9l\" (UniqueName: \"kubernetes.io/projected/92784b61-08b7-423d-a33c-e1943b0d82db-kube-api-access-2tf9l\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805325 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-cnibin\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-socket-dir-parent\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-run-k8s-cni-cncf-io\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b63d7d-8180-44f1-9019-975a3d9ee716-tmp-dir\") pod \"node-resolver-lclj7\" (UID: \"88b63d7d-8180-44f1-9019-975a3d9ee716\") " pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-sysctl-d\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805415 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-sysctl-conf\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-run-netns\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-host\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-hostroot\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-var-lib-cni-multus\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805531 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92784b61-08b7-423d-a33c-e1943b0d82db-tmp\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-systemd\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805567 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-sysconfig\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805625 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-socket-dir-parent\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805631 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-etc-kubernetes\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-run-netns\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-host\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805685 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-var-lib-cni-multus\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805695 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-systemd\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805723 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-modprobe-d\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805728 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-run-k8s-cni-cncf-io\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805779 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-host-var-lib-cni-bin\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805827 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-sysctl-d\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.806664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.806189 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-cnibin\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.807576 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.806212 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92784b61-08b7-423d-a33c-e1943b0d82db-etc-sysctl-conf\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.807576 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.805726 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-hostroot\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.807576 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.806451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-cni-binary-copy\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.807576 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.806460 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88b63d7d-8180-44f1-9019-975a3d9ee716-tmp-dir\") pod \"node-resolver-lclj7\" (UID: \"88b63d7d-8180-44f1-9019-975a3d9ee716\") " pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:05.807768 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.807650 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92784b61-08b7-423d-a33c-e1943b0d82db-etc-tuned\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.807921 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.807887 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92784b61-08b7-423d-a33c-e1943b0d82db-tmp\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.809047 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.809027 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-multus-daemon-config\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.826141 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.826121 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29gd6\" (UniqueName: \"kubernetes.io/projected/205f7194-9ca3-4fef-ae80-7fc3fe0817ae-kube-api-access-29gd6\") pod \"multus-hqj5x\" (UID: \"205f7194-9ca3-4fef-ae80-7fc3fe0817ae\") " pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.828342 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.828322 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2gwg\" (UniqueName: \"kubernetes.io/projected/88b63d7d-8180-44f1-9019-975a3d9ee716-kube-api-access-f2gwg\") pod \"node-resolver-lclj7\" (UID: \"88b63d7d-8180-44f1-9019-975a3d9ee716\") " pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:05.829812 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.829791 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tf9l\" (UniqueName: \"kubernetes.io/projected/92784b61-08b7-423d-a33c-e1943b0d82db-kube-api-access-2tf9l\") pod \"tuned-2xpl9\" (UID: \"92784b61-08b7-423d-a33c-e1943b0d82db\") " pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.884053 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.883942 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vr7cj" Jun 09 12:41:05.898040 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.898021 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5sx6d" Jun 09 12:41:05.907581 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.907562 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:05.915188 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.915170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hqj5x" Jun 09 12:41:05.922287 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.922270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" Jun 09 12:41:05.928375 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.928352 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" Jun 09 12:41:05.934986 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.934971 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:05.941845 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.941826 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" Jun 09 12:41:05.944907 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:05.944884 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lclj7" Jun 09 12:41:06.208792 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.208725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:06.208792 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.208758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:06.208973 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:06.208859 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:06.208973 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:06.208880 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:06.208973 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:06.208936 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret podName:041086e4-a8c7-4333-a3d2-c02129f0370e nodeName:}" failed. No retries permitted until 2026-06-09 12:41:07.208913348 +0000 UTC m=+4.043119592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret") pod "global-pull-secret-syncer-6mrv2" (UID: "041086e4-a8c7-4333-a3d2-c02129f0370e") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:06.208973 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:06.208951 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs podName:2725b703-989a-4bb7-ab75-5945026ccb96 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:07.208944501 +0000 UTC m=+4.043150745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs") pod "network-metrics-daemon-xkvmm" (UID: "2725b703-989a-4bb7-ab75-5945026ccb96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:06.309177 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.309145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhhd\" (UniqueName: \"kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd\") pod \"network-check-target-8ptt5\" (UID: \"c9ebeeff-2869-45b5-8dc7-b194b392d68b\") " pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:06.309337 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:06.309295 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:06.309337 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:06.309314 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:06.309337 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:06.309325 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vbhhd for pod openshift-network-diagnostics/network-check-target-8ptt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:06.309458 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:06.309383 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd podName:c9ebeeff-2869-45b5-8dc7-b194b392d68b nodeName:}" failed. No retries permitted until 2026-06-09 12:41:07.309360105 +0000 UTC m=+4.143566349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbhhd" (UniqueName: "kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd") pod "network-check-target-8ptt5" (UID: "c9ebeeff-2869-45b5-8dc7-b194b392d68b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:06.587765 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:06.587737 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4cba33_4421_435a_b171_dad3b72060aa.slice/crio-05dca38cf4f610e5513017fe89561862439aa30889e50aa1ee7b85d3c091cb72 WatchSource:0}: Error finding container 05dca38cf4f610e5513017fe89561862439aa30889e50aa1ee7b85d3c091cb72: Status 404 returned error can't find the container with id 05dca38cf4f610e5513017fe89561862439aa30889e50aa1ee7b85d3c091cb72 Jun 09 12:41:06.588619 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:06.588596 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de36c10_50d6_4b8b_a558_f159f3786caf.slice/crio-6c36154cd122f3322eaff695fe86a4c479bcd8b62add9580ee37e967666690fc WatchSource:0}: Error finding container 6c36154cd122f3322eaff695fe86a4c479bcd8b62add9580ee37e967666690fc: Status 404 returned error can't find the container with id 6c36154cd122f3322eaff695fe86a4c479bcd8b62add9580ee37e967666690fc Jun 09 12:41:06.590329 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:06.590311 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b10c0b_e96e_4be9_929a_247411e5eec3.slice/crio-e7177ca1f1c24aee5760960b7eedc2a933e28d10dd9b7b5c17b6f294198b969a WatchSource:0}: Error finding container e7177ca1f1c24aee5760960b7eedc2a933e28d10dd9b7b5c17b6f294198b969a: Status 404 returned error can't find the container with id e7177ca1f1c24aee5760960b7eedc2a933e28d10dd9b7b5c17b6f294198b969a Jun 09 12:41:06.592363 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:06.592343 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1205d62_0f9b_4a95_8a0c_f3008657c5a0.slice/crio-92dff2949ffea588e0abd527e65f0627817d03f727efe0e52a1380f55a62e1b1 WatchSource:0}: Error finding container 92dff2949ffea588e0abd527e65f0627817d03f727efe0e52a1380f55a62e1b1: Status 404 returned error can't find the container with id 92dff2949ffea588e0abd527e65f0627817d03f727efe0e52a1380f55a62e1b1 Jun 09 12:41:06.595137 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:06.595116 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92784b61_08b7_423d_a33c_e1943b0d82db.slice/crio-add9686dbe0549dc8810ea9991d477173945aac087eecce4fd5e64c0f6804e99 WatchSource:0}: Error finding container add9686dbe0549dc8810ea9991d477173945aac087eecce4fd5e64c0f6804e99: Status 404 returned error can't find the container with id add9686dbe0549dc8810ea9991d477173945aac087eecce4fd5e64c0f6804e99 Jun 09 12:41:06.596753 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:06.596666 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b63d7d_8180_44f1_9019_975a3d9ee716.slice/crio-58fccb17abc8b8a88e3a354e175989d9fd9a8b2f76baba8343c151aed5c1d44f WatchSource:0}: Error finding container 58fccb17abc8b8a88e3a354e175989d9fd9a8b2f76baba8343c151aed5c1d44f: Status 404 returned error can't find the container with id 58fccb17abc8b8a88e3a354e175989d9fd9a8b2f76baba8343c151aed5c1d44f Jun 09 12:41:06.597171 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:06.597117 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1e7bb4_8c89_4769_bee9_949a59fa4d6e.slice/crio-14ca78a78ec672a1913308915dd93bd86a515a8b8251d4b4b68e745897d1ea00 WatchSource:0}: Error finding container 14ca78a78ec672a1913308915dd93bd86a515a8b8251d4b4b68e745897d1ea00: Status 404 returned error can't find the container with id 14ca78a78ec672a1913308915dd93bd86a515a8b8251d4b4b68e745897d1ea00 Jun 09 12:41:06.598100 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:06.598080 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205f7194_9ca3_4fef_ae80_7fc3fe0817ae.slice/crio-59b2a7887102a12b50ba5fa764cc6e20aa11d14b47a9684beb2dbde0c6fd195e WatchSource:0}: Error finding container 59b2a7887102a12b50ba5fa764cc6e20aa11d14b47a9684beb2dbde0c6fd195e: Status 404 returned error can't find the container with id 59b2a7887102a12b50ba5fa764cc6e20aa11d14b47a9684beb2dbde0c6fd195e Jun 09 12:41:06.601466 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:06.601437 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6af2cbb_1acd_42b2_a2eb_036c91006f06.slice/crio-5bd5ad8ff36b08f91f9283a24c86582d0f87ac37ff74a101f549af56abc0ee55 WatchSource:0}: Error finding container 5bd5ad8ff36b08f91f9283a24c86582d0f87ac37ff74a101f549af56abc0ee55: Status 404 returned error can't find the container with id 5bd5ad8ff36b08f91f9283a24c86582d0f87ac37ff74a101f549af56abc0ee55 Jun 09 12:41:06.654004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.653956 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 12:36:04 +0000 UTC" deadline="2028-02-28 07:52:42.369964622 +0000 UTC" Jun 09 12:41:06.654004 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.654003 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15091h11m35.715964068s" Jun 09 12:41:06.663796 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.663758 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kr72z" event={"ID":"7f1e7bb4-8c89-4769-bee9-949a59fa4d6e","Type":"ContainerStarted","Data":"14ca78a78ec672a1913308915dd93bd86a515a8b8251d4b4b68e745897d1ea00"} Jun 09 12:41:06.664949 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.664924 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" event={"ID":"92784b61-08b7-423d-a33c-e1943b0d82db","Type":"ContainerStarted","Data":"add9686dbe0549dc8810ea9991d477173945aac087eecce4fd5e64c0f6804e99"} Jun 09 12:41:06.665939 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.665918 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" event={"ID":"7de36c10-50d6-4b8b-a558-f159f3786caf","Type":"ContainerStarted","Data":"6c36154cd122f3322eaff695fe86a4c479bcd8b62add9580ee37e967666690fc"} Jun 09 12:41:06.666881 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.666860 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vr7cj" event={"ID":"3a4cba33-4421-435a-b171-dad3b72060aa","Type":"ContainerStarted","Data":"05dca38cf4f610e5513017fe89561862439aa30889e50aa1ee7b85d3c091cb72"} Jun 09 12:41:06.667813 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.667794 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lclj7" event={"ID":"88b63d7d-8180-44f1-9019-975a3d9ee716","Type":"ContainerStarted","Data":"58fccb17abc8b8a88e3a354e175989d9fd9a8b2f76baba8343c151aed5c1d44f"} Jun 09 12:41:06.668918 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.668883 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hqj5x" event={"ID":"205f7194-9ca3-4fef-ae80-7fc3fe0817ae","Type":"ContainerStarted","Data":"59b2a7887102a12b50ba5fa764cc6e20aa11d14b47a9684beb2dbde0c6fd195e"} Jun 09 12:41:06.669864 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.669845 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5sx6d" event={"ID":"f1205d62-0f9b-4a95-8a0c-f3008657c5a0","Type":"ContainerStarted","Data":"92dff2949ffea588e0abd527e65f0627817d03f727efe0e52a1380f55a62e1b1"} Jun 09 12:41:06.671024 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.671007 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" event={"ID":"06b10c0b-e96e-4be9-929a-247411e5eec3","Type":"ContainerStarted","Data":"e7177ca1f1c24aee5760960b7eedc2a933e28d10dd9b7b5c17b6f294198b969a"} Jun 09 12:41:06.672172 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.672154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" event={"ID":"e6af2cbb-1acd-42b2-a2eb-036c91006f06","Type":"ContainerStarted","Data":"5bd5ad8ff36b08f91f9283a24c86582d0f87ac37ff74a101f549af56abc0ee55"} Jun 09 12:41:06.956679 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:06.956646 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:07.218163 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:07.217366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:07.218163 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:07.217416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:07.218163 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.217554 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:07.218163 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.217618 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs podName:2725b703-989a-4bb7-ab75-5945026ccb96 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:09.217600042 +0000 UTC m=+6.051806309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs") pod "network-metrics-daemon-xkvmm" (UID: "2725b703-989a-4bb7-ab75-5945026ccb96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:07.218163 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.218032 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:07.218163 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.218083 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret podName:041086e4-a8c7-4333-a3d2-c02129f0370e nodeName:}" failed. No retries permitted until 2026-06-09 12:41:09.218067556 +0000 UTC m=+6.052273805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret") pod "global-pull-secret-syncer-6mrv2" (UID: "041086e4-a8c7-4333-a3d2-c02129f0370e") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:07.318549 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:07.318510 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhhd\" (UniqueName: \"kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd\") pod \"network-check-target-8ptt5\" (UID: \"c9ebeeff-2869-45b5-8dc7-b194b392d68b\") " pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:07.318728 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.318710 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:07.318791 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.318734 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:07.318791 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.318747 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vbhhd for pod openshift-network-diagnostics/network-check-target-8ptt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:07.318893 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.318805 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd podName:c9ebeeff-2869-45b5-8dc7-b194b392d68b nodeName:}" failed. No retries permitted until 2026-06-09 12:41:09.318787851 +0000 UTC m=+6.152994112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbhhd" (UniqueName: "kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd") pod "network-check-target-8ptt5" (UID: "c9ebeeff-2869-45b5-8dc7-b194b392d68b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:07.656075 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:07.656004 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:07.656496 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.656141 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:07.656580 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:07.656561 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:07.656673 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.656653 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:07.659125 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:07.659103 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:07.659237 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:07.659204 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:07.690628 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:07.690593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" event={"ID":"88c7314f7fb6629a9e73aba1ffec2ed4","Type":"ContainerStarted","Data":"caee2e34df481771d690736214925f5c99bae6a7abff6ec1860865d22e8c3032"} Jun 09 12:41:07.699285 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:07.699234 2561 generic.go:356] "Generic (PLEG): container finished" podID="14c7604689d2953ccbf42e9f811949bd" containerID="0f693c5e5e01ec6072a729e1b5d881f4d12f8991bd78126864ca5725b3dc2a7b" exitCode=0 Jun 09 12:41:07.699285 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:07.699280 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" event={"ID":"14c7604689d2953ccbf42e9f811949bd","Type":"ContainerDied","Data":"0f693c5e5e01ec6072a729e1b5d881f4d12f8991bd78126864ca5725b3dc2a7b"} Jun 09 12:41:07.716672 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:07.715868 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-159.ec2.internal" podStartSLOduration=3.7158497969999997 podStartE2EDuration="3.715849797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:07.71533171 +0000 UTC m=+4.549537979" watchObservedRunningTime="2026-06-09 12:41:07.715849797 +0000 UTC m=+4.550056064" Jun 09 12:41:08.729006 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:08.728954 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" event={"ID":"14c7604689d2953ccbf42e9f811949bd","Type":"ContainerStarted","Data":"718abe3ada2b73422cc7b85852add588d6b9da5686f339961b3fbd06c1471f05"} Jun 09 12:41:09.237174 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:09.237140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:09.237361 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:09.237198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:09.237361 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.237319 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:09.237469 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.237374 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs podName:2725b703-989a-4bb7-ab75-5945026ccb96 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:13.237355973 +0000 UTC m=+10.071562222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs") pod "network-metrics-daemon-xkvmm" (UID: "2725b703-989a-4bb7-ab75-5945026ccb96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:09.237776 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.237760 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:09.237853 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.237810 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret podName:041086e4-a8c7-4333-a3d2-c02129f0370e nodeName:}" failed. No retries permitted until 2026-06-09 12:41:13.237795455 +0000 UTC m=+10.072001705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret") pod "global-pull-secret-syncer-6mrv2" (UID: "041086e4-a8c7-4333-a3d2-c02129f0370e") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:09.338135 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:09.338100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhhd\" (UniqueName: \"kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd\") pod \"network-check-target-8ptt5\" (UID: \"c9ebeeff-2869-45b5-8dc7-b194b392d68b\") " pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:09.338310 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.338268 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:09.338310 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.338292 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:09.338310 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.338305 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vbhhd for pod openshift-network-diagnostics/network-check-target-8ptt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:09.338474 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.338358 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd podName:c9ebeeff-2869-45b5-8dc7-b194b392d68b nodeName:}" failed. No retries permitted until 2026-06-09 12:41:13.338340815 +0000 UTC m=+10.172547092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbhhd" (UniqueName: "kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd") pod "network-check-target-8ptt5" (UID: "c9ebeeff-2869-45b5-8dc7-b194b392d68b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:09.660974 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:09.660409 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:09.660974 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.660526 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:09.660974 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:09.660882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:09.661495 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:09.661323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:09.661495 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.661420 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:09.661822 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:09.661760 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:11.655712 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:11.655681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:11.656230 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:11.655827 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:11.656230 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:11.656205 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:11.656343 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:11.656288 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:11.656397 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:11.656356 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:11.656553 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:11.656468 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:13.271867 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:13.271830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:13.272341 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:13.271946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:13.272341 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.272080 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:13.272341 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.272144 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret podName:041086e4-a8c7-4333-a3d2-c02129f0370e nodeName:}" failed. No retries permitted until 2026-06-09 12:41:21.272125881 +0000 UTC m=+18.106332141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret") pod "global-pull-secret-syncer-6mrv2" (UID: "041086e4-a8c7-4333-a3d2-c02129f0370e") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:13.272538 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.272516 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:13.272595 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.272564 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs podName:2725b703-989a-4bb7-ab75-5945026ccb96 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:21.272548841 +0000 UTC m=+18.106755091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs") pod "network-metrics-daemon-xkvmm" (UID: "2725b703-989a-4bb7-ab75-5945026ccb96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:13.372814 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:13.372776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhhd\" (UniqueName: \"kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd\") pod \"network-check-target-8ptt5\" (UID: \"c9ebeeff-2869-45b5-8dc7-b194b392d68b\") " pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:13.373007 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.372953 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:13.373007 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.372980 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:13.373007 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.372994 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vbhhd for pod openshift-network-diagnostics/network-check-target-8ptt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:13.373151 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.373060 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd podName:c9ebeeff-2869-45b5-8dc7-b194b392d68b nodeName:}" failed. No retries permitted until 2026-06-09 12:41:21.373039962 +0000 UTC m=+18.207246225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbhhd" (UniqueName: "kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd") pod "network-check-target-8ptt5" (UID: "c9ebeeff-2869-45b5-8dc7-b194b392d68b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:13.666359 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:13.666280 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:13.666799 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:13.666773 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:13.666932 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.666766 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:13.667032 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.667003 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:13.667153 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:13.667043 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:13.667209 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:13.667172 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:15.658586 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:15.658555 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:15.659049 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:15.658676 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:15.659049 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:15.659040 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:15.659141 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:15.659119 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:15.659197 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:15.659161 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:15.659250 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:15.659222 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:17.656256 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:17.656226 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:17.656256 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:17.656262 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:17.656788 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:17.656226 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:17.656788 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:17.656364 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:17.656788 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:17.656445 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:17.656788 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:17.656522 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:19.656253 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:19.656215 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:19.656809 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:19.656215 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:19.656809 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:19.656350 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:19.656809 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:19.656362 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:19.656809 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:19.656452 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:19.656809 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:19.656551 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:21.335015 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:21.334963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:21.335441 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:21.335076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:21.335441 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.335132 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:21.335441 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.335187 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:21.335441 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.335222 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs podName:2725b703-989a-4bb7-ab75-5945026ccb96 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:37.335199204 +0000 UTC m=+34.169405463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs") pod "network-metrics-daemon-xkvmm" (UID: "2725b703-989a-4bb7-ab75-5945026ccb96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:21.335441 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.335243 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret podName:041086e4-a8c7-4333-a3d2-c02129f0370e nodeName:}" failed. No retries permitted until 2026-06-09 12:41:37.335233165 +0000 UTC m=+34.169439416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret") pod "global-pull-secret-syncer-6mrv2" (UID: "041086e4-a8c7-4333-a3d2-c02129f0370e") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:21.436338 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:21.436305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhhd\" (UniqueName: \"kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd\") pod \"network-check-target-8ptt5\" (UID: \"c9ebeeff-2869-45b5-8dc7-b194b392d68b\") " pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:21.436523 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.436501 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:21.436577 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.436529 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:21.436577 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.436539 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vbhhd for pod openshift-network-diagnostics/network-check-target-8ptt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:21.436651 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.436594 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd podName:c9ebeeff-2869-45b5-8dc7-b194b392d68b nodeName:}" failed. No retries permitted until 2026-06-09 12:41:37.436579595 +0000 UTC m=+34.270785839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbhhd" (UniqueName: "kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd") pod "network-check-target-8ptt5" (UID: "c9ebeeff-2869-45b5-8dc7-b194b392d68b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:21.655892 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:21.655859 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:21.655892 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:21.655911 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:21.656139 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:21.655996 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:21.656139 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.656000 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:21.656139 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.656070 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:21.656287 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:21.656203 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:23.656823 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:23.656790 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:23.657273 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:23.656869 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:23.657273 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:23.656986 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:23.657273 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:23.657102 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:23.657273 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:23.657148 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:23.657273 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:23.657251 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:25.657541 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.657314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:25.658180 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:25.657635 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:25.658180 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.657457 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:25.658180 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:25.657700 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:25.658180 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.657414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:25.658180 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:25.657765 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:25.759655 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.759627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kr72z" event={"ID":"7f1e7bb4-8c89-4769-bee9-949a59fa4d6e","Type":"ContainerStarted","Data":"d19cd757165f00d1e572e16eaccc91329b9bb242570ce23255ae11f513ae1e4f"} Jun 09 12:41:25.761000 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.760978 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" event={"ID":"92784b61-08b7-423d-a33c-e1943b0d82db","Type":"ContainerStarted","Data":"8d1957eb63c846ab71655dfd0da204cb9cb053e627991f04e06fe6e10c24885e"} Jun 09 12:41:25.762218 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.762196 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" event={"ID":"7de36c10-50d6-4b8b-a558-f159f3786caf","Type":"ContainerStarted","Data":"7fe9e16eec06bed284b50f1621ba0b05db016408e7d7e14cfa7c94031a1845cc"} Jun 09 12:41:25.763513 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.763492 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vr7cj" event={"ID":"3a4cba33-4421-435a-b171-dad3b72060aa","Type":"ContainerStarted","Data":"a7fc9ad64394000f287291581914c1f51c74c0cdf7084ae085bd43478bcb7659"} Jun 09 12:41:25.764875 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.764855 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lclj7" event={"ID":"88b63d7d-8180-44f1-9019-975a3d9ee716","Type":"ContainerStarted","Data":"8d838d22de3fff032bcd3b04fed6be1b97b30e8879d627763a5016dde9fb59d4"} Jun 09 12:41:25.766210 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.766185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hqj5x" event={"ID":"205f7194-9ca3-4fef-ae80-7fc3fe0817ae","Type":"ContainerStarted","Data":"578884247fd24a01c2e6f41450116c5b7d9be5ae6721006762f78ede69c665c9"} Jun 09 12:41:25.767526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.767506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" event={"ID":"06b10c0b-e96e-4be9-929a-247411e5eec3","Type":"ContainerStarted","Data":"813522be7e1f2327305d163968f2b2cbabdeb581c5d1921360e897b99aa3cea7"} Jun 09 12:41:25.768769 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.768752 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" event={"ID":"e6af2cbb-1acd-42b2-a2eb-036c91006f06","Type":"ContainerStarted","Data":"c74704da1b60e961127f720980c8081e34e88b553cb77a72d0b029bdd4c7a86f"} Jun 09 12:41:25.782314 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.782278 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-159.ec2.internal" podStartSLOduration=21.78226646 podStartE2EDuration="21.78226646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:08.753882565 +0000 UTC m=+5.588088832" watchObservedRunningTime="2026-06-09 12:41:25.78226646 +0000 UTC m=+22.616472726" Jun 09 12:41:25.808533 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.808494 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kr72z" podStartSLOduration=4.209785425 podStartE2EDuration="22.808483172s" totalImagesPullingTime="18.598697747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:25.782529098 +0000 UTC m=+22.616735363" watchObservedRunningTime="2026-06-09 12:41:25.808483172 +0000 UTC m=+22.642689438" Jun 09 12:41:25.827601 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.827563 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lclj7" podStartSLOduration=3.997941306 podStartE2EDuration="22.827553507s" totalImagesPullingTime="18.829612201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:25.827199539 +0000 UTC m=+22.661405806" watchObservedRunningTime="2026-06-09 12:41:25.827553507 +0000 UTC m=+22.661759773" Jun 09 12:41:25.827692 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.827647 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hqj5x" podStartSLOduration=3.961724743 podStartE2EDuration="22.827643195s" totalImagesPullingTime="18.865918452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:25.809181545 +0000 UTC m=+22.643387810" watchObservedRunningTime="2026-06-09 12:41:25.827643195 +0000 UTC m=+22.661849462" Jun 09 12:41:25.847254 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.847200 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vr7cj" podStartSLOduration=4.047808375 podStartE2EDuration="22.847184362s" totalImagesPullingTime="18.799375987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:25.84700485 +0000 UTC m=+22.681211116" watchObservedRunningTime="2026-06-09 12:41:25.847184362 +0000 UTC m=+22.681390629" Jun 09 12:41:25.918961 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:25.916153 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2xpl9" podStartSLOduration=4.084887823 podStartE2EDuration="22.916137005s" totalImagesPullingTime="18.831249182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:25.915854424 +0000 UTC m=+22.750060690" watchObservedRunningTime="2026-06-09 12:41:25.916137005 +0000 UTC m=+22.750343272" Jun 09 12:41:26.656292 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.656116 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:26.656717 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.656694 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:26.773940 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.773837 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9t7r9_06b10c0b-e96e-4be9-929a-247411e5eec3/ovn-acl-logging/0.log" Jun 09 12:41:26.774592 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.774568 2561 generic.go:356] "Generic (PLEG): container finished" podID="06b10c0b-e96e-4be9-929a-247411e5eec3" containerID="46345fce17d63c005a30ab1b8fcf815ad414418ffb8c1dd4f1f371488727293c" exitCode=1 Jun 09 12:41:26.774686 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.774640 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" event={"ID":"06b10c0b-e96e-4be9-929a-247411e5eec3","Type":"ContainerStarted","Data":"d96df66d8adf88eca8b6e30dde44fa498cd718248468de7dc0317a0f86236650"} Jun 09 12:41:26.774751 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.774724 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" event={"ID":"06b10c0b-e96e-4be9-929a-247411e5eec3","Type":"ContainerStarted","Data":"2a430e6908febe6bb5188c8b30f2784bfcade2ed6e5cc5d90517d9008a8401b1"} Jun 09 12:41:26.774805 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.774761 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" event={"ID":"06b10c0b-e96e-4be9-929a-247411e5eec3","Type":"ContainerStarted","Data":"6e59a78d1317caf869c1edefa7fa78f6ff7128924eb703132c46604ebd215c41"} Jun 09 12:41:26.774805 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.774803 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" event={"ID":"06b10c0b-e96e-4be9-929a-247411e5eec3","Type":"ContainerStarted","Data":"21911f9303467206ee2839ec8b04be5cfcac367524f0dee8769026db12291084"} Jun 09 12:41:26.774926 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.774831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" event={"ID":"06b10c0b-e96e-4be9-929a-247411e5eec3","Type":"ContainerDied","Data":"46345fce17d63c005a30ab1b8fcf815ad414418ffb8c1dd4f1f371488727293c"} Jun 09 12:41:26.776435 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.776409 2561 generic.go:356] "Generic (PLEG): container finished" podID="7de36c10-50d6-4b8b-a558-f159f3786caf" containerID="7fe9e16eec06bed284b50f1621ba0b05db016408e7d7e14cfa7c94031a1845cc" exitCode=0 Jun 09 12:41:26.776550 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.776453 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" event={"ID":"7de36c10-50d6-4b8b-a558-f159f3786caf","Type":"ContainerDied","Data":"7fe9e16eec06bed284b50f1621ba0b05db016408e7d7e14cfa7c94031a1845cc"} Jun 09 12:41:26.776849 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.776830 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:26.777743 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.777667 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kr72z" Jun 09 12:41:26.865649 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:26.865617 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 12:41:27.655996 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:27.655964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:27.656163 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:27.656086 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:27.656163 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:27.655963 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:27.656251 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:27.656196 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:27.656251 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:27.655964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:27.656316 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:27.656267 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:27.666587 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:27.666501 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T12:41:26.865637477Z","UUID":"4bfaa942-ca45-4bf5-a130-50d0d01ac3af","Handler":null,"Name":"","Endpoint":""} Jun 09 12:41:27.668225 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:27.668205 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 12:41:27.668352 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:27.668249 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 12:41:27.780235 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:27.780199 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" event={"ID":"e6af2cbb-1acd-42b2-a2eb-036c91006f06","Type":"ContainerStarted","Data":"df62cba5916391a43bd6dc4325ad1033366c04b3c35d9bedee9b81c01afb340b"} Jun 09 12:41:27.782502 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:27.781839 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5sx6d" event={"ID":"f1205d62-0f9b-4a95-8a0c-f3008657c5a0","Type":"ContainerStarted","Data":"92b9ee71290d52fe0cbdc84b0aa5f9de501c334d919d380c681e19b607cb9af6"} Jun 09 12:41:27.800960 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:27.800532 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5sx6d" podStartSLOduration=6.005873415 podStartE2EDuration="24.800512356s" totalImagesPullingTime="18.794638941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:27.80015603 +0000 UTC m=+24.634362314" watchObservedRunningTime="2026-06-09 12:41:27.800512356 +0000 UTC m=+24.634718623" Jun 09 12:41:28.786854 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:28.786658 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9t7r9_06b10c0b-e96e-4be9-929a-247411e5eec3/ovn-acl-logging/0.log" Jun 09 12:41:28.787491 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:28.787272 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" event={"ID":"06b10c0b-e96e-4be9-929a-247411e5eec3","Type":"ContainerStarted","Data":"6e13ad5a02e3f50ff358333da7e0a95a4bc0d09a494ef55fd350dc7fbef9397e"} Jun 09 12:41:28.789526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:28.789491 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" event={"ID":"e6af2cbb-1acd-42b2-a2eb-036c91006f06","Type":"ContainerStarted","Data":"102c43b5916f662476cc62d698a55439aef6c655659f81b8af00715f3789faee"} Jun 09 12:41:29.656055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:29.656020 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:29.656233 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:29.656021 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:29.656233 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:29.656151 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:29.656353 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:29.656259 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:29.656353 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:29.656029 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:29.656436 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:29.656395 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:30.797600 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:30.797434 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9t7r9_06b10c0b-e96e-4be9-929a-247411e5eec3/ovn-acl-logging/0.log" Jun 09 12:41:30.798461 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:30.797977 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" event={"ID":"06b10c0b-e96e-4be9-929a-247411e5eec3","Type":"ContainerStarted","Data":"9c41e2391ffb3fc35785315daf11bdc28b13a8107d71896305354fa75fd03e5d"} Jun 09 12:41:30.798461 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:30.798296 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:30.798461 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:30.798363 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:30.798586 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:30.798544 2561 scope.go:117] "RemoveContainer" containerID="46345fce17d63c005a30ab1b8fcf815ad414418ffb8c1dd4f1f371488727293c" Jun 09 12:41:30.815829 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:30.815807 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:30.831492 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:30.831455 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj7jh" podStartSLOduration=6.983663334 podStartE2EDuration="27.831443659s" totalImagesPullingTime="20.847780325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:28.820255176 +0000 UTC m=+25.654461457" watchObservedRunningTime="2026-06-09 12:41:30.831443659 +0000 UTC m=+27.665649926" Jun 09 12:41:31.658921 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:31.657141 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:31.658921 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:31.657282 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:31.658921 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:31.657686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:31.658921 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:31.657797 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:31.658921 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:31.657850 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:31.658921 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:31.657932 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:32.717517 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.717488 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8ptt5"] Jun 09 12:41:32.717885 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.717592 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:32.717885 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:32.717678 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:32.721640 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.721619 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xkvmm"] Jun 09 12:41:32.721750 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.721705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:32.721808 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:32.721792 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:32.723773 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.723754 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6mrv2"] Jun 09 12:41:32.723834 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.723821 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:32.723933 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:32.723893 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:32.803995 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.803967 2561 generic.go:356] "Generic (PLEG): container finished" podID="7de36c10-50d6-4b8b-a558-f159f3786caf" containerID="09d66291398ad9846e1c9e84ddcb7ac7133eaacdf0bc5c22648139725b59704a" exitCode=0 Jun 09 12:41:32.804138 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.804061 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" event={"ID":"7de36c10-50d6-4b8b-a558-f159f3786caf","Type":"ContainerDied","Data":"09d66291398ad9846e1c9e84ddcb7ac7133eaacdf0bc5c22648139725b59704a"} Jun 09 12:41:32.807866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.807852 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9t7r9_06b10c0b-e96e-4be9-929a-247411e5eec3/ovn-acl-logging/0.log" Jun 09 12:41:32.808201 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.808183 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" event={"ID":"06b10c0b-e96e-4be9-929a-247411e5eec3","Type":"ContainerStarted","Data":"aa20b6611b53c7494bdc6a669a21e28fa27108aa9f65eafd0a2568c81015a1a4"} Jun 09 12:41:32.808372 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.808354 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:32.823794 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.823774 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:41:32.872041 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:32.871982 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" podStartSLOduration=10.976591692 podStartE2EDuration="29.871962563s" totalImagesPullingTime="18.895370871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:32.870474797 +0000 UTC m=+29.704681089" watchObservedRunningTime="2026-06-09 12:41:32.871962563 +0000 UTC m=+29.706168830" Jun 09 12:41:34.655929 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:34.655890 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:34.656375 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:34.655890 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:34.656375 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:34.656012 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:34.656375 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:34.656014 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:34.656375 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:34.656075 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:34.656375 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:34.656136 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:34.813468 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:34.813380 2561 generic.go:356] "Generic (PLEG): container finished" podID="7de36c10-50d6-4b8b-a558-f159f3786caf" containerID="3b398fb5b9ed9a140e3c2b03e427a332681771b2759c390aa9ff94e919fa935b" exitCode=0 Jun 09 12:41:34.813468 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:34.813449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" event={"ID":"7de36c10-50d6-4b8b-a558-f159f3786caf","Type":"ContainerDied","Data":"3b398fb5b9ed9a140e3c2b03e427a332681771b2759c390aa9ff94e919fa935b"} Jun 09 12:41:35.818076 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:35.818037 2561 generic.go:356] "Generic (PLEG): container finished" podID="7de36c10-50d6-4b8b-a558-f159f3786caf" containerID="08fcb8fabe1c83ef8a438660519110d50571248828995f314380eb375db7e157" exitCode=0 Jun 09 12:41:35.818736 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:35.818086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" event={"ID":"7de36c10-50d6-4b8b-a558-f159f3786caf","Type":"ContainerDied","Data":"08fcb8fabe1c83ef8a438660519110d50571248828995f314380eb375db7e157"} Jun 09 12:41:36.656563 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:36.656526 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:36.656563 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:36.656561 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:36.656801 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:36.656671 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:36.656801 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:36.656665 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mrv2" podUID="041086e4-a8c7-4333-a3d2-c02129f0370e" Jun 09 12:41:36.656801 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:36.656751 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xkvmm" podUID="2725b703-989a-4bb7-ab75-5945026ccb96" Jun 09 12:41:36.656988 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:36.656824 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8ptt5" podUID="c9ebeeff-2869-45b5-8dc7-b194b392d68b" Jun 09 12:41:37.358062 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:37.358029 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:37.358062 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:37.358069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:37.358537 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:37.358178 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:37.358537 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:37.358178 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:37.358537 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:37.358243 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret podName:041086e4-a8c7-4333-a3d2-c02129f0370e nodeName:}" failed. No retries permitted until 2026-06-09 12:42:09.358227763 +0000 UTC m=+66.192434007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret") pod "global-pull-secret-syncer-6mrv2" (UID: "041086e4-a8c7-4333-a3d2-c02129f0370e") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:37.358537 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:37.358258 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs podName:2725b703-989a-4bb7-ab75-5945026ccb96 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:09.358251569 +0000 UTC m=+66.192457813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs") pod "network-metrics-daemon-xkvmm" (UID: "2725b703-989a-4bb7-ab75-5945026ccb96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:37.459330 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:37.459293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhhd\" (UniqueName: \"kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd\") pod \"network-check-target-8ptt5\" (UID: \"c9ebeeff-2869-45b5-8dc7-b194b392d68b\") " pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:37.459503 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:37.459473 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:37.459503 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:37.459495 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:37.459592 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:37.459508 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vbhhd for pod openshift-network-diagnostics/network-check-target-8ptt5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:37.459592 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:37.459562 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd podName:c9ebeeff-2869-45b5-8dc7-b194b392d68b nodeName:}" failed. No retries permitted until 2026-06-09 12:42:09.459545374 +0000 UTC m=+66.293751619 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbhhd" (UniqueName: "kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd") pod "network-check-target-8ptt5" (UID: "c9ebeeff-2869-45b5-8dc7-b194b392d68b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:38.497412 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.497381 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-159.ec2.internal" event="NodeReady" Jun 09 12:41:38.497854 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.497537 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 12:41:38.547886 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.547856 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5bqfl"] Jun 09 12:41:38.570358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.570334 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6v7kd"] Jun 09 12:41:38.570614 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.570597 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.576460 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.575568 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k7xst\"" Jun 09 12:41:38.576460 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.575672 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 12:41:38.576460 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.576335 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 12:41:38.583804 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.583783 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bqfl"] Jun 09 12:41:38.583892 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.583816 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6v7kd"] Jun 09 12:41:38.583892 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.583887 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6v7kd" Jun 09 12:41:38.586787 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.586590 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 12:41:38.586787 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.586615 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 12:41:38.588212 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.588192 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 12:41:38.588307 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.588195 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mgx5s\"" Jun 09 12:41:38.655639 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.655609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:41:38.655821 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.655653 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:41:38.655821 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.655611 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:41:38.658502 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.658367 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 12:41:38.658502 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.658381 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fjw6q\"" Jun 09 12:41:38.658502 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.658393 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 12:41:38.658771 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.658597 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sfqkv\"" Jun 09 12:41:38.658771 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.658725 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 12:41:38.658886 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.658879 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 12:41:38.668438 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.668419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34381811-6e19-40e6-8df5-247b4d109693-tmp-dir\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.668542 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.668465 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a-cert\") pod \"ingress-canary-6v7kd\" (UID: \"c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a\") " pod="openshift-ingress-canary/ingress-canary-6v7kd" Jun 09 12:41:38.668542 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.668491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn66j\" (UniqueName: \"kubernetes.io/projected/c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a-kube-api-access-mn66j\") pod \"ingress-canary-6v7kd\" (UID: \"c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a\") " pod="openshift-ingress-canary/ingress-canary-6v7kd" Jun 09 12:41:38.668638 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.668588 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.668688 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.668632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34381811-6e19-40e6-8df5-247b4d109693-config-volume\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.668735 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.668707 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xk4z\" (UniqueName: \"kubernetes.io/projected/34381811-6e19-40e6-8df5-247b4d109693-kube-api-access-4xk4z\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.770114 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.770038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a-cert\") pod \"ingress-canary-6v7kd\" (UID: \"c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a\") " pod="openshift-ingress-canary/ingress-canary-6v7kd" Jun 09 12:41:38.770114 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.770083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn66j\" (UniqueName: \"kubernetes.io/projected/c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a-kube-api-access-mn66j\") pod \"ingress-canary-6v7kd\" (UID: \"c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a\") " pod="openshift-ingress-canary/ingress-canary-6v7kd" Jun 09 12:41:38.770315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.770139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.770315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.770183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34381811-6e19-40e6-8df5-247b4d109693-config-volume\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.770315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.770235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xk4z\" (UniqueName: \"kubernetes.io/projected/34381811-6e19-40e6-8df5-247b4d109693-kube-api-access-4xk4z\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.770315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.770276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34381811-6e19-40e6-8df5-247b4d109693-tmp-dir\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.770657 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.770634 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34381811-6e19-40e6-8df5-247b4d109693-tmp-dir\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.770874 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:38.770839 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:38.771010 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:38.770927 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls podName:34381811-6e19-40e6-8df5-247b4d109693 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:39.270887511 +0000 UTC m=+36.105093755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls") pod "dns-default-5bqfl" (UID: "34381811-6e19-40e6-8df5-247b4d109693") : secret "dns-default-metrics-tls" not found Jun 09 12:41:38.771736 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.771558 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34381811-6e19-40e6-8df5-247b4d109693-config-volume\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.775192 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.775174 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a-cert\") pod \"ingress-canary-6v7kd\" (UID: \"c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a\") " pod="openshift-ingress-canary/ingress-canary-6v7kd" Jun 09 12:41:38.782153 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.782126 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xk4z\" (UniqueName: \"kubernetes.io/projected/34381811-6e19-40e6-8df5-247b4d109693-kube-api-access-4xk4z\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:38.782276 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.782251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn66j\" (UniqueName: \"kubernetes.io/projected/c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a-kube-api-access-mn66j\") pod \"ingress-canary-6v7kd\" (UID: \"c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a\") " pod="openshift-ingress-canary/ingress-canary-6v7kd" Jun 09 12:41:38.893364 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:38.893326 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6v7kd" Jun 09 12:41:39.274911 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:39.274867 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:39.275131 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:39.275027 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:39.275131 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:39.275105 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls podName:34381811-6e19-40e6-8df5-247b4d109693 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:40.275082687 +0000 UTC m=+37.109288933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls") pod "dns-default-5bqfl" (UID: "34381811-6e19-40e6-8df5-247b4d109693") : secret "dns-default-metrics-tls" not found Jun 09 12:41:39.845963 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:39.845934 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6v7kd"] Jun 09 12:41:39.849339 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:41:39.849314 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4440e5b_c9b4_4bbd_ab07_eb8ea1ae644a.slice/crio-dcd661341c709a489903ecf6a89cda99af1a6ba3ba396db7bcddb59647cd4524 WatchSource:0}: Error finding container dcd661341c709a489903ecf6a89cda99af1a6ba3ba396db7bcddb59647cd4524: Status 404 returned error can't find the container with id dcd661341c709a489903ecf6a89cda99af1a6ba3ba396db7bcddb59647cd4524 Jun 09 12:41:40.284886 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:40.284856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:40.285042 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:40.284978 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:40.285042 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:40.285032 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls podName:34381811-6e19-40e6-8df5-247b4d109693 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:42.285018576 +0000 UTC m=+39.119224819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls") pod "dns-default-5bqfl" (UID: "34381811-6e19-40e6-8df5-247b4d109693") : secret "dns-default-metrics-tls" not found Jun 09 12:41:40.835614 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:40.835578 2561 generic.go:356] "Generic (PLEG): container finished" podID="7de36c10-50d6-4b8b-a558-f159f3786caf" containerID="13116f89d150c12f7dbaed5f01d3e0285c7b3c20c480254c85e6983f4bb7a848" exitCode=0 Jun 09 12:41:40.835806 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:40.835673 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" event={"ID":"7de36c10-50d6-4b8b-a558-f159f3786caf","Type":"ContainerDied","Data":"13116f89d150c12f7dbaed5f01d3e0285c7b3c20c480254c85e6983f4bb7a848"} Jun 09 12:41:40.839735 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:40.839709 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6v7kd" event={"ID":"c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a","Type":"ContainerStarted","Data":"dcd661341c709a489903ecf6a89cda99af1a6ba3ba396db7bcddb59647cd4524"} Jun 09 12:41:41.844233 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:41.844208 2561 generic.go:356] "Generic (PLEG): container finished" podID="7de36c10-50d6-4b8b-a558-f159f3786caf" containerID="06d6785e1c223beec8649e4fa3a50b4009d65301ae17fdda174b3b7b7cabb566" exitCode=0 Jun 09 12:41:41.844611 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:41.844269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" event={"ID":"7de36c10-50d6-4b8b-a558-f159f3786caf","Type":"ContainerDied","Data":"06d6785e1c223beec8649e4fa3a50b4009d65301ae17fdda174b3b7b7cabb566"} Jun 09 12:41:42.301785 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:42.301744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:42.301975 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:42.301861 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:42.301975 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:42.301927 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls podName:34381811-6e19-40e6-8df5-247b4d109693 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:46.301914578 +0000 UTC m=+43.136120834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls") pod "dns-default-5bqfl" (UID: "34381811-6e19-40e6-8df5-247b4d109693") : secret "dns-default-metrics-tls" not found Jun 09 12:41:42.849791 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:42.849755 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" event={"ID":"7de36c10-50d6-4b8b-a558-f159f3786caf","Type":"ContainerStarted","Data":"1d488eaf008d9225dbfac3cd3ffb5d88adec2fdaf43f0d515999043f8421b3ae"} Jun 09 12:41:42.851200 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:42.851169 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6v7kd" event={"ID":"c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a","Type":"ContainerStarted","Data":"122e5c621e1d274c32a148674dcc0d0dd40de27fdfd449ac78727511a35eadf6"} Jun 09 12:41:42.877867 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:42.877824 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nr9vx" podStartSLOduration=9.765702249 podStartE2EDuration="39.877809539s" totalImagesPullingTime="30.11210729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:42.876538854 +0000 UTC m=+39.710745120" watchObservedRunningTime="2026-06-09 12:41:42.877809539 +0000 UTC m=+39.712015805" Jun 09 12:41:42.897629 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:42.897582 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6v7kd" podStartSLOduration=2.968997724 podStartE2EDuration="4.89756445s" totalImagesPullingTime="1.928566726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:42.897293722 +0000 UTC m=+39.731499990" watchObservedRunningTime="2026-06-09 12:41:42.89756445 +0000 UTC m=+39.731770710" Jun 09 12:41:43.659652 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.659620 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl"] Jun 09 12:41:43.685666 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.685639 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl"] Jun 09 12:41:43.685841 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.685742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:43.689514 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.689487 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 12:41:43.690659 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.690639 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 12:41:43.690659 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.690647 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 12:41:43.690834 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.690669 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 12:41:43.690834 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.690653 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4t25v\"" Jun 09 12:41:43.757413 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.757380 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64486c75f5-wp64w"] Jun 09 12:41:43.775267 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.775244 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:43.776522 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.776487 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64486c75f5-wp64w"] Jun 09 12:41:43.778199 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.778180 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-98jp6\"" Jun 09 12:41:43.778317 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.778294 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 12:41:43.778547 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.778528 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 12:41:43.778655 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.778637 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 12:41:43.778738 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.778669 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 12:41:43.778809 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.778791 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 12:41:43.778884 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.778868 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 12:41:43.812156 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.812129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:43.812289 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.812158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mznbf\" (UniqueName: \"kubernetes.io/projected/cc35f9df-7c82-464e-b8bf-249067b49220-kube-api-access-mznbf\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:43.812289 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.812180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cc35f9df-7c82-464e-b8bf-249067b49220-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:43.912960 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.912865 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:43.912960 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.912915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznbf\" (UniqueName: \"kubernetes.io/projected/cc35f9df-7c82-464e-b8bf-249067b49220-kube-api-access-mznbf\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:43.912960 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.912941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-default-certificate\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:43.912960 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.912962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cc35f9df-7c82-464e-b8bf-249067b49220-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:43.913598 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:43.913027 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:43.913598 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.913066 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-stats-auth\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:43.913598 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:43.913094 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls podName:cc35f9df-7c82-464e-b8bf-249067b49220 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:44.413079663 +0000 UTC m=+41.247285906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hf6wl" (UID: "cc35f9df-7c82-464e-b8bf-249067b49220") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:43.913598 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.913126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6bvt\" (UniqueName: \"kubernetes.io/projected/3663e150-f4a6-42c6-af57-df1fbd8df6f9-kube-api-access-d6bvt\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:43.913598 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.913193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:43.913598 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.913223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:43.913780 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.913655 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cc35f9df-7c82-464e-b8bf-249067b49220-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:43.925772 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:43.925747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mznbf\" (UniqueName: \"kubernetes.io/projected/cc35f9df-7c82-464e-b8bf-249067b49220-kube-api-access-mznbf\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:44.013961 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.013912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:44.013961 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.013961 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:44.014214 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.014017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-default-certificate\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:44.014214 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:44.014072 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:41:44.014214 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.014098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-stats-auth\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:44.014214 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.014124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6bvt\" (UniqueName: \"kubernetes.io/projected/3663e150-f4a6-42c6-af57-df1fbd8df6f9-kube-api-access-d6bvt\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:44.014214 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:44.014156 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:44.51413693 +0000 UTC m=+41.348343178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : secret "router-metrics-certs-default" not found Jun 09 12:41:44.014214 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:44.014191 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:44.514180688 +0000 UTC m=+41.348386937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : configmap references non-existent config key: service-ca.crt Jun 09 12:41:44.016525 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.016501 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-stats-auth\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:44.016623 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.016585 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-default-certificate\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:44.023246 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.023223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6bvt\" (UniqueName: \"kubernetes.io/projected/3663e150-f4a6-42c6-af57-df1fbd8df6f9-kube-api-access-d6bvt\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:44.417559 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.417521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:44.417737 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:44.417671 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:44.417788 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:44.417743 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls podName:cc35f9df-7c82-464e-b8bf-249067b49220 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:45.417727696 +0000 UTC m=+42.251933939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hf6wl" (UID: "cc35f9df-7c82-464e-b8bf-249067b49220") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:44.518933 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.518882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:44.519087 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:44.518938 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:44.519087 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:44.519042 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:41:44.519158 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:44.519105 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:45.519089885 +0000 UTC m=+42.353296130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : secret "router-metrics-certs-default" not found Jun 09 12:41:44.519158 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:44.519134 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:45.519118508 +0000 UTC m=+42.353324752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : configmap references non-existent config key: service-ca.crt Jun 09 12:41:45.424913 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:45.424873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:45.425292 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:45.425039 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:45.425292 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:45.425122 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls podName:cc35f9df-7c82-464e-b8bf-249067b49220 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:47.425093087 +0000 UTC m=+44.259299334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hf6wl" (UID: "cc35f9df-7c82-464e-b8bf-249067b49220") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:45.525746 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:45.525716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:45.525924 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:45.525756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:45.525924 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:45.525857 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:41:45.525924 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:45.525870 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:47.525854474 +0000 UTC m=+44.360060717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : configmap references non-existent config key: service-ca.crt Jun 09 12:41:45.526040 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:45.525926 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:47.525893914 +0000 UTC m=+44.360100157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : secret "router-metrics-certs-default" not found Jun 09 12:41:46.331192 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:46.331161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:46.331377 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:46.331314 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:46.331377 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:46.331368 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls podName:34381811-6e19-40e6-8df5-247b4d109693 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:54.33135482 +0000 UTC m=+51.165561064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls") pod "dns-default-5bqfl" (UID: "34381811-6e19-40e6-8df5-247b4d109693") : secret "dns-default-metrics-tls" not found Jun 09 12:41:47.439839 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:47.439799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:47.440230 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:47.439970 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:47.440230 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:47.440034 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls podName:cc35f9df-7c82-464e-b8bf-249067b49220 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:51.440019787 +0000 UTC m=+48.274226033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hf6wl" (UID: "cc35f9df-7c82-464e-b8bf-249067b49220") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:47.540428 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:47.540392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:47.540428 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:47.540429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:47.540623 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:47.540546 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:41:47.540623 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:47.540555 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:51.540539353 +0000 UTC m=+48.374745600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : configmap references non-existent config key: service-ca.crt Jun 09 12:41:47.540623 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:47.540604 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:51.540592243 +0000 UTC m=+48.374798490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : secret "router-metrics-certs-default" not found Jun 09 12:41:50.681191 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:50.681162 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lclj7_88b63d7d-8180-44f1-9019-975a3d9ee716/dns-node-resolver/0.log" Jun 09 12:41:51.467231 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:51.467190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:51.467419 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:51.467339 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:51.467419 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:51.467407 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls podName:cc35f9df-7c82-464e-b8bf-249067b49220 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:59.467389982 +0000 UTC m=+56.301596225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hf6wl" (UID: "cc35f9df-7c82-464e-b8bf-249067b49220") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:51.568424 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:51.568385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:51.568611 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:51.568431 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:51.568611 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:51.568536 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:41:51.568611 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:51.568569 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:59.568549834 +0000 UTC m=+56.402756083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : configmap references non-existent config key: service-ca.crt Jun 09 12:41:51.568611 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:51.568592 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:59.568578685 +0000 UTC m=+56.402784929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : secret "router-metrics-certs-default" not found Jun 09 12:41:51.881302 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:51.881231 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vr7cj_3a4cba33-4421-435a-b171-dad3b72060aa/node-ca/0.log" Jun 09 12:41:52.481011 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:52.480984 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6v7kd_c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a/serve-healthcheck-canary/0.log" Jun 09 12:41:54.391855 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:54.391819 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:41:54.392316 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:54.392017 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:54.392316 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:54.392084 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls podName:34381811-6e19-40e6-8df5-247b4d109693 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:10.392065739 +0000 UTC m=+67.226272002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls") pod "dns-default-5bqfl" (UID: "34381811-6e19-40e6-8df5-247b4d109693") : secret "dns-default-metrics-tls" not found Jun 09 12:41:59.529889 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:59.529853 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:41:59.530278 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:59.530040 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:59.530278 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:59.530103 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls podName:cc35f9df-7c82-464e-b8bf-249067b49220 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:15.530085231 +0000 UTC m=+72.364291481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hf6wl" (UID: "cc35f9df-7c82-464e-b8bf-249067b49220") : secret "cluster-monitoring-operator-tls" not found Jun 09 12:41:59.630696 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:59.630648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:59.630797 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:41:59.630708 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:41:59.630842 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:59.630807 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:41:59.630879 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:59.630872 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:15.630853393 +0000 UTC m=+72.465059637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : secret "router-metrics-certs-default" not found Jun 09 12:41:59.630946 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:41:59.630886 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle podName:3663e150-f4a6-42c6-af57-df1fbd8df6f9 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:15.630880892 +0000 UTC m=+72.465087137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle") pod "router-default-64486c75f5-wp64w" (UID: "3663e150-f4a6-42c6-af57-df1fbd8df6f9") : configmap references non-existent config key: service-ca.crt Jun 09 12:42:01.992773 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:01.992728 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qxbwv"] Jun 09 12:42:02.050860 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.050827 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qxbwv"] Jun 09 12:42:02.051028 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.050958 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.053843 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.053819 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fgmpm\"" Jun 09 12:42:02.054014 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.053807 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 12:42:02.054014 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.053820 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 12:42:02.054178 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.054163 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 12:42:02.054674 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.054660 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 12:42:02.151574 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.151546 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f357859a-df1c-43ab-8f28-86e3fd612051-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.151757 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.151582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f357859a-df1c-43ab-8f28-86e3fd612051-crio-socket\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.151757 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.151601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f357859a-df1c-43ab-8f28-86e3fd612051-data-volume\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.151757 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.151639 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn6nd\" (UniqueName: \"kubernetes.io/projected/f357859a-df1c-43ab-8f28-86e3fd612051-kube-api-access-dn6nd\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.151757 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.151677 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.252992 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.252908 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f357859a-df1c-43ab-8f28-86e3fd612051-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.252992 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.252960 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f357859a-df1c-43ab-8f28-86e3fd612051-crio-socket\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.252992 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.252986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f357859a-df1c-43ab-8f28-86e3fd612051-data-volume\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.253260 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.253020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn6nd\" (UniqueName: \"kubernetes.io/projected/f357859a-df1c-43ab-8f28-86e3fd612051-kube-api-access-dn6nd\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.253260 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.253062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.253260 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.253084 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f357859a-df1c-43ab-8f28-86e3fd612051-crio-socket\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.253260 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:02.253220 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 12:42:02.253455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.253286 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f357859a-df1c-43ab-8f28-86e3fd612051-data-volume\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.253455 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:02.253299 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls podName:f357859a-df1c-43ab-8f28-86e3fd612051 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:02.753279164 +0000 UTC m=+59.587485423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qxbwv" (UID: "f357859a-df1c-43ab-8f28-86e3fd612051") : secret "insights-runtime-extractor-tls" not found Jun 09 12:42:02.253455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.253430 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f357859a-df1c-43ab-8f28-86e3fd612051-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.265571 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.265546 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn6nd\" (UniqueName: \"kubernetes.io/projected/f357859a-df1c-43ab-8f28-86e3fd612051-kube-api-access-dn6nd\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.757005 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:02.756967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:02.757179 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:02.757115 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 12:42:02.757221 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:02.757179 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls podName:f357859a-df1c-43ab-8f28-86e3fd612051 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:03.757163319 +0000 UTC m=+60.591369562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qxbwv" (UID: "f357859a-df1c-43ab-8f28-86e3fd612051") : secret "insights-runtime-extractor-tls" not found Jun 09 12:42:03.763922 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:03.763877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:03.764277 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:03.763994 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 12:42:03.764277 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:03.764062 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls podName:f357859a-df1c-43ab-8f28-86e3fd612051 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:05.764047364 +0000 UTC m=+62.598253608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qxbwv" (UID: "f357859a-df1c-43ab-8f28-86e3fd612051") : secret "insights-runtime-extractor-tls" not found Jun 09 12:42:04.824024 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:04.823997 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9t7r9" Jun 09 12:42:05.780018 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:05.779973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:05.780212 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:05.780126 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 12:42:05.780212 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:05.780198 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls podName:f357859a-df1c-43ab-8f28-86e3fd612051 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:09.780183472 +0000 UTC m=+66.614389720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qxbwv" (UID: "f357859a-df1c-43ab-8f28-86e3fd612051") : secret "insights-runtime-extractor-tls" not found Jun 09 12:42:09.409241 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.409208 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:42:09.409241 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.409255 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:42:09.412068 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.412048 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 12:42:09.412147 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.412131 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 12:42:09.420344 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:09.420321 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 12:42:09.420426 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:09.420381 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs podName:2725b703-989a-4bb7-ab75-5945026ccb96 nodeName:}" failed. No retries permitted until 2026-06-09 12:43:13.420364677 +0000 UTC m=+130.254570920 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs") pod "network-metrics-daemon-xkvmm" (UID: "2725b703-989a-4bb7-ab75-5945026ccb96") : secret "metrics-daemon-secret" not found Jun 09 12:42:09.422500 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.422479 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/041086e4-a8c7-4333-a3d2-c02129f0370e-original-pull-secret\") pod \"global-pull-secret-syncer-6mrv2\" (UID: \"041086e4-a8c7-4333-a3d2-c02129f0370e\") " pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:42:09.510346 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.510315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhhd\" (UniqueName: \"kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd\") pod \"network-check-target-8ptt5\" (UID: \"c9ebeeff-2869-45b5-8dc7-b194b392d68b\") " pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:42:09.513358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.513338 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 12:42:09.523483 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.523466 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 12:42:09.533358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.533331 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbhhd\" (UniqueName: \"kubernetes.io/projected/c9ebeeff-2869-45b5-8dc7-b194b392d68b-kube-api-access-vbhhd\") pod \"network-check-target-8ptt5\" (UID: \"c9ebeeff-2869-45b5-8dc7-b194b392d68b\") " pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:42:09.567499 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.567466 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mrv2" Jun 09 12:42:09.583097 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.583077 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fjw6q\"" Jun 09 12:42:09.590365 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.590347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:42:09.706691 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.706219 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6mrv2"] Jun 09 12:42:09.710332 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:09.710305 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041086e4_a8c7_4333_a3d2_c02129f0370e.slice/crio-41ed2b338e0a92cad840ea8701325bef383a7f12f8ba97d50e0fd34d9f6ac35b WatchSource:0}: Error finding container 41ed2b338e0a92cad840ea8701325bef383a7f12f8ba97d50e0fd34d9f6ac35b: Status 404 returned error can't find the container with id 41ed2b338e0a92cad840ea8701325bef383a7f12f8ba97d50e0fd34d9f6ac35b Jun 09 12:42:09.730340 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.730316 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8ptt5"] Jun 09 12:42:09.733441 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:09.733420 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ebeeff_2869_45b5_8dc7_b194b392d68b.slice/crio-aedb7a3e9097930a11e97d39a93d7dbc6083d3819235737bf87f805fb9f2c475 WatchSource:0}: Error finding container aedb7a3e9097930a11e97d39a93d7dbc6083d3819235737bf87f805fb9f2c475: Status 404 returned error can't find the container with id aedb7a3e9097930a11e97d39a93d7dbc6083d3819235737bf87f805fb9f2c475 Jun 09 12:42:09.812143 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.812111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:09.814648 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.814624 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f357859a-df1c-43ab-8f28-86e3fd612051-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qxbwv\" (UID: \"f357859a-df1c-43ab-8f28-86e3fd612051\") " pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:09.862801 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.862773 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fgmpm\"" Jun 09 12:42:09.870647 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.870630 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qxbwv" Jun 09 12:42:09.921347 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.921312 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6mrv2" event={"ID":"041086e4-a8c7-4333-a3d2-c02129f0370e","Type":"ContainerStarted","Data":"41ed2b338e0a92cad840ea8701325bef383a7f12f8ba97d50e0fd34d9f6ac35b"} Jun 09 12:42:09.922706 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:09.922668 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8ptt5" event={"ID":"c9ebeeff-2869-45b5-8dc7-b194b392d68b","Type":"ContainerStarted","Data":"aedb7a3e9097930a11e97d39a93d7dbc6083d3819235737bf87f805fb9f2c475"} Jun 09 12:42:10.001225 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:10.001186 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qxbwv"] Jun 09 12:42:10.004575 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:10.004552 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf357859a_df1c_43ab_8f28_86e3fd612051.slice/crio-0565a108bf13cdcbbbe4610075b4112e9830f7a73eed4cbe5266c758bdafc0a1 WatchSource:0}: Error finding container 0565a108bf13cdcbbbe4610075b4112e9830f7a73eed4cbe5266c758bdafc0a1: Status 404 returned error can't find the container with id 0565a108bf13cdcbbbe4610075b4112e9830f7a73eed4cbe5266c758bdafc0a1 Jun 09 12:42:10.417796 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:10.417763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:42:10.420706 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:10.420677 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34381811-6e19-40e6-8df5-247b4d109693-metrics-tls\") pod \"dns-default-5bqfl\" (UID: \"34381811-6e19-40e6-8df5-247b4d109693\") " pod="openshift-dns/dns-default-5bqfl" Jun 09 12:42:10.685553 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:10.685278 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k7xst\"" Jun 09 12:42:10.692595 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:10.692567 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bqfl" Jun 09 12:42:10.930504 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:10.930469 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qxbwv" event={"ID":"f357859a-df1c-43ab-8f28-86e3fd612051","Type":"ContainerStarted","Data":"431af55287801ae38d573f26c43eb8d47913dea3d3734ff86a6dc7628d34f1bf"} Jun 09 12:42:10.930630 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:10.930541 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qxbwv" event={"ID":"f357859a-df1c-43ab-8f28-86e3fd612051","Type":"ContainerStarted","Data":"85b3ebd671523486320cedb7a511f26add9ee8521f3580fc20b602bebce84701"} Jun 09 12:42:10.930630 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:10.930574 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qxbwv" event={"ID":"f357859a-df1c-43ab-8f28-86e3fd612051","Type":"ContainerStarted","Data":"0565a108bf13cdcbbbe4610075b4112e9830f7a73eed4cbe5266c758bdafc0a1"} Jun 09 12:42:10.935324 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:10.935301 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bqfl"] Jun 09 12:42:10.938932 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:10.938875 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34381811_6e19_40e6_8df5_247b4d109693.slice/crio-24133674a803e8da34abb721c85de0cf8d8f650f42d8af73822c978c8879f1a3 WatchSource:0}: Error finding container 24133674a803e8da34abb721c85de0cf8d8f650f42d8af73822c978c8879f1a3: Status 404 returned error can't find the container with id 24133674a803e8da34abb721c85de0cf8d8f650f42d8af73822c978c8879f1a3 Jun 09 12:42:11.935269 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:11.935238 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bqfl" event={"ID":"34381811-6e19-40e6-8df5-247b4d109693","Type":"ContainerStarted","Data":"24133674a803e8da34abb721c85de0cf8d8f650f42d8af73822c978c8879f1a3"} Jun 09 12:42:15.561787 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:15.561751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:42:15.564067 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:15.564048 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc35f9df-7c82-464e-b8bf-249067b49220-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hf6wl\" (UID: \"cc35f9df-7c82-464e-b8bf-249067b49220\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:42:15.662781 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:15.662756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:42:15.662953 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:15.662789 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:42:15.663328 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:15.663305 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3663e150-f4a6-42c6-af57-df1fbd8df6f9-service-ca-bundle\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:42:15.665206 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:15.665184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3663e150-f4a6-42c6-af57-df1fbd8df6f9-metrics-certs\") pod \"router-default-64486c75f5-wp64w\" (UID: \"3663e150-f4a6-42c6-af57-df1fbd8df6f9\") " pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:42:15.797840 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:15.797810 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4t25v\"" Jun 09 12:42:15.805767 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:15.805750 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" Jun 09 12:42:15.887720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:15.887698 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-98jp6\"" Jun 09 12:42:15.895796 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:15.895779 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:42:16.122215 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.122165 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl"] Jun 09 12:42:16.127400 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:16.127370 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc35f9df_7c82_464e_b8bf_249067b49220.slice/crio-96c764a7cd3890e5bece946095fd5c29f10993bc33cb49e3c09c978fd464165e WatchSource:0}: Error finding container 96c764a7cd3890e5bece946095fd5c29f10993bc33cb49e3c09c978fd464165e: Status 404 returned error can't find the container with id 96c764a7cd3890e5bece946095fd5c29f10993bc33cb49e3c09c978fd464165e Jun 09 12:42:16.142518 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.142490 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64486c75f5-wp64w"] Jun 09 12:42:16.145705 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:16.145667 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3663e150_f4a6_42c6_af57_df1fbd8df6f9.slice/crio-ed28654df6588e7bec17fc71883f48b314fca0c082543a0444e854534a710ea1 WatchSource:0}: Error finding container ed28654df6588e7bec17fc71883f48b314fca0c082543a0444e854534a710ea1: Status 404 returned error can't find the container with id ed28654df6588e7bec17fc71883f48b314fca0c082543a0444e854534a710ea1 Jun 09 12:42:16.954661 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.954620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8ptt5" event={"ID":"c9ebeeff-2869-45b5-8dc7-b194b392d68b","Type":"ContainerStarted","Data":"5117b2fb0d0e9c4f02dc9d2e32e7bbc51da68491bb183acf12f0fed4b8f3ced9"} Jun 09 12:42:16.955163 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.954819 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:42:16.956718 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.956688 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qxbwv" event={"ID":"f357859a-df1c-43ab-8f28-86e3fd612051","Type":"ContainerStarted","Data":"26c2bba19e179ea061815839046641309c9e7284d7d1359358cd16543c30ab52"} Jun 09 12:42:16.958584 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.958559 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bqfl" event={"ID":"34381811-6e19-40e6-8df5-247b4d109693","Type":"ContainerStarted","Data":"3e0c1c04ec696131dbbf2edd639214395ffe4321aa7711b894de5a5c09cec9f6"} Jun 09 12:42:16.958675 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.958608 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bqfl" event={"ID":"34381811-6e19-40e6-8df5-247b4d109693","Type":"ContainerStarted","Data":"d121f8814f39755234f122c155143c838d4f3523f8dbea2de8f0c9c17c4ab1e4"} Jun 09 12:42:16.958675 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.958640 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5bqfl" Jun 09 12:42:16.959645 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.959624 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" event={"ID":"cc35f9df-7c82-464e-b8bf-249067b49220","Type":"ContainerStarted","Data":"96c764a7cd3890e5bece946095fd5c29f10993bc33cb49e3c09c978fd464165e"} Jun 09 12:42:16.961242 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.961219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6mrv2" event={"ID":"041086e4-a8c7-4333-a3d2-c02129f0370e","Type":"ContainerStarted","Data":"9a2028430a9698436458fe250d073dea9b47b95f64806401a4ea17f3464ad959"} Jun 09 12:42:16.962692 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.962670 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64486c75f5-wp64w" event={"ID":"3663e150-f4a6-42c6-af57-df1fbd8df6f9","Type":"ContainerStarted","Data":"18315f2f75ef7a4f012821ffce73439637c007a2e1407d5a3a55222489993d1e"} Jun 09 12:42:16.962776 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.962706 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64486c75f5-wp64w" event={"ID":"3663e150-f4a6-42c6-af57-df1fbd8df6f9","Type":"ContainerStarted","Data":"ed28654df6588e7bec17fc71883f48b314fca0c082543a0444e854534a710ea1"} Jun 09 12:42:16.974816 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.974766 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8ptt5" podStartSLOduration=67.757870284 podStartE2EDuration="1m13.974749423s" totalImagesPullingTime="6.216879139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:16.974012179 +0000 UTC m=+73.808218435" watchObservedRunningTime="2026-06-09 12:42:16.974749423 +0000 UTC m=+73.808955692" Jun 09 12:42:16.997074 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:16.997033 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5bqfl" podStartSLOduration=33.980136992 podStartE2EDuration="38.997019709s" totalImagesPullingTime="5.016882717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:16.996042347 +0000 UTC m=+73.830248614" watchObservedRunningTime="2026-06-09 12:42:16.997019709 +0000 UTC m=+73.831225979" Jun 09 12:42:17.026019 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:17.025714 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64486c75f5-wp64w" podStartSLOduration=34.025697924 podStartE2EDuration="34.025697924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:17.022298166 +0000 UTC m=+73.856504432" watchObservedRunningTime="2026-06-09 12:42:17.025697924 +0000 UTC m=+73.859904191" Jun 09 12:42:17.044201 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:17.044168 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qxbwv" podStartSLOduration=10.235775408 podStartE2EDuration="16.044157856s" totalImagesPullingTime="5.808382448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:42:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:17.04262404 +0000 UTC m=+73.876830345" watchObservedRunningTime="2026-06-09 12:42:17.044157856 +0000 UTC m=+73.878364121" Jun 09 12:42:17.067961 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:17.067921 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6mrv2" podStartSLOduration=67.817192529 podStartE2EDuration="1m14.067892002s" totalImagesPullingTime="6.250699473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:17.067817506 +0000 UTC m=+73.902023772" watchObservedRunningTime="2026-06-09 12:42:17.067892002 +0000 UTC m=+73.902098333" Jun 09 12:42:17.896606 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:17.896560 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:42:17.899852 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:17.899826 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:42:17.968953 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:17.968922 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:42:17.969527 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:17.969508 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64486c75f5-wp64w" Jun 09 12:42:18.972312 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:18.972281 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" event={"ID":"cc35f9df-7c82-464e-b8bf-249067b49220","Type":"ContainerStarted","Data":"e13b53880ef577341754e26395b688d38e30d31b0429f3b7fe714d70e9c4c072"} Jun 09 12:42:18.990637 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:18.990590 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hf6wl" podStartSLOduration=33.888723329 podStartE2EDuration="35.990570614s" totalImagesPullingTime="2.101847285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:18.989687946 +0000 UTC m=+75.823894224" watchObservedRunningTime="2026-06-09 12:42:18.990570614 +0000 UTC m=+75.824776861" Jun 09 12:42:23.256824 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.256791 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d48d5c99c-2tndt"] Jun 09 12:42:23.260027 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.260010 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.274441 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.274422 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 12:42:23.274547 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.274469 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 12:42:23.275867 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.275834 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 12:42:23.275867 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.275840 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k9kx5\"" Jun 09 12:42:23.279268 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.279251 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 12:42:23.292131 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.292111 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d48d5c99c-2tndt"] Jun 09 12:42:23.325632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.325605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jmjc\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-kube-api-access-7jmjc\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.325723 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.325640 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6aca831-c89e-470d-b006-84e8ed62ff3f-ca-trust-extracted\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.325723 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.325666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-image-registry-private-configuration\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.325807 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.325730 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-certificates\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.325807 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.325790 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-installation-pull-secrets\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.325886 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.325823 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-tls\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.325886 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.325844 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-bound-sa-token\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.325886 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.325860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-trusted-ca\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.361080 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.361054 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z"] Jun 09 12:42:23.363745 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.363731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z" Jun 09 12:42:23.367762 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.367743 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gxj9h\"" Jun 09 12:42:23.371454 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.371435 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 12:42:23.377001 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.376982 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z"] Jun 09 12:42:23.394128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.394107 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d48d5c99c-2tndt"] Jun 09 12:42:23.394287 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:42:23.394269 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-7jmjc registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" podUID="c6aca831-c89e-470d-b006-84e8ed62ff3f" Jun 09 12:42:23.426362 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.426295 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jmjc\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-kube-api-access-7jmjc\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.426362 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.426339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6aca831-c89e-470d-b006-84e8ed62ff3f-ca-trust-extracted\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.426498 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.426470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-image-registry-private-configuration\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.426555 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.426509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-certificates\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.426629 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.426558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-installation-pull-secrets\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.426629 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.426606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-tls\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.426726 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.426631 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6aca831-c89e-470d-b006-84e8ed62ff3f-ca-trust-extracted\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.426726 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.426643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-bound-sa-token\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.426726 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.426684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-trusted-ca\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.426981 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.426963 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fd4c9ddcb-bczwf"] Jun 09 12:42:23.427342 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.427320 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-certificates\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.427994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.427974 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-trusted-ca\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.429157 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.429137 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-tls\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.429263 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.429246 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-installation-pull-secrets\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.429263 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.429253 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-image-registry-private-configuration\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.439669 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.439649 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.444587 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.444565 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-bound-sa-token\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.445533 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.445511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jmjc\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-kube-api-access-7jmjc\") pod \"image-registry-6d48d5c99c-2tndt\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.450642 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.450622 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-gg8wk"] Jun 09 12:42:23.453671 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.453610 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-gg8wk" Jun 09 12:42:23.456478 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.456461 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5lkjv\"" Jun 09 12:42:23.456550 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.456500 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 12:42:23.456786 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.456766 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 12:42:23.467011 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.466985 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd4c9ddcb-bczwf"] Jun 09 12:42:23.475418 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.475400 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-gg8wk"] Jun 09 12:42:23.527006 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.526982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99309390-c91d-44b4-90b0-4c7f51b1d767-trusted-ca\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.527128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.527011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99309390-c91d-44b4-90b0-4c7f51b1d767-bound-sa-token\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.527128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.527030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99309390-c91d-44b4-90b0-4c7f51b1d767-image-registry-private-configuration\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.527128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.527089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99309390-c91d-44b4-90b0-4c7f51b1d767-ca-trust-extracted\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.527128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.527116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99309390-c91d-44b4-90b0-4c7f51b1d767-registry-tls\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.527332 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.527136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99309390-c91d-44b4-90b0-4c7f51b1d767-registry-certificates\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.527332 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.527157 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2fa240c8-5c4a-4742-87af-6b4b3aef35e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kt59z\" (UID: \"2fa240c8-5c4a-4742-87af-6b4b3aef35e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z" Jun 09 12:42:23.527332 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.527231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8q6n\" (UniqueName: \"kubernetes.io/projected/5c1b105f-36bc-4329-9818-345645c301d7-kube-api-access-k8q6n\") pod \"downloads-6657875f97-gg8wk\" (UID: \"5c1b105f-36bc-4329-9818-345645c301d7\") " pod="openshift-console/downloads-6657875f97-gg8wk" Jun 09 12:42:23.527332 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.527276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7rlb\" (UniqueName: \"kubernetes.io/projected/99309390-c91d-44b4-90b0-4c7f51b1d767-kube-api-access-s7rlb\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.527332 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.527323 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99309390-c91d-44b4-90b0-4c7f51b1d767-installation-pull-secrets\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.628387 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99309390-c91d-44b4-90b0-4c7f51b1d767-ca-trust-extracted\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.628387 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628387 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99309390-c91d-44b4-90b0-4c7f51b1d767-registry-tls\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.628606 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628404 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99309390-c91d-44b4-90b0-4c7f51b1d767-registry-certificates\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.628606 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2fa240c8-5c4a-4742-87af-6b4b3aef35e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kt59z\" (UID: \"2fa240c8-5c4a-4742-87af-6b4b3aef35e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z" Jun 09 12:42:23.628606 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628462 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8q6n\" (UniqueName: \"kubernetes.io/projected/5c1b105f-36bc-4329-9818-345645c301d7-kube-api-access-k8q6n\") pod \"downloads-6657875f97-gg8wk\" (UID: \"5c1b105f-36bc-4329-9818-345645c301d7\") " pod="openshift-console/downloads-6657875f97-gg8wk" Jun 09 12:42:23.628606 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7rlb\" (UniqueName: \"kubernetes.io/projected/99309390-c91d-44b4-90b0-4c7f51b1d767-kube-api-access-s7rlb\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.628606 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99309390-c91d-44b4-90b0-4c7f51b1d767-installation-pull-secrets\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.628848 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99309390-c91d-44b4-90b0-4c7f51b1d767-trusted-ca\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.628848 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99309390-c91d-44b4-90b0-4c7f51b1d767-bound-sa-token\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.628848 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99309390-c91d-44b4-90b0-4c7f51b1d767-image-registry-private-configuration\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.628848 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.628796 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99309390-c91d-44b4-90b0-4c7f51b1d767-ca-trust-extracted\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.630199 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.630167 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99309390-c91d-44b4-90b0-4c7f51b1d767-registry-certificates\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.630689 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.630634 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99309390-c91d-44b4-90b0-4c7f51b1d767-trusted-ca\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.633765 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.633028 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99309390-c91d-44b4-90b0-4c7f51b1d767-registry-tls\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.634454 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.634159 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99309390-c91d-44b4-90b0-4c7f51b1d767-installation-pull-secrets\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.634634 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.634584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2fa240c8-5c4a-4742-87af-6b4b3aef35e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kt59z\" (UID: \"2fa240c8-5c4a-4742-87af-6b4b3aef35e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z" Jun 09 12:42:23.635764 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.635744 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99309390-c91d-44b4-90b0-4c7f51b1d767-image-registry-private-configuration\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.644263 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.644244 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8q6n\" (UniqueName: \"kubernetes.io/projected/5c1b105f-36bc-4329-9818-345645c301d7-kube-api-access-k8q6n\") pod \"downloads-6657875f97-gg8wk\" (UID: \"5c1b105f-36bc-4329-9818-345645c301d7\") " pod="openshift-console/downloads-6657875f97-gg8wk" Jun 09 12:42:23.650620 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.650600 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7rlb\" (UniqueName: \"kubernetes.io/projected/99309390-c91d-44b4-90b0-4c7f51b1d767-kube-api-access-s7rlb\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.651737 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.651721 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99309390-c91d-44b4-90b0-4c7f51b1d767-bound-sa-token\") pod \"image-registry-5fd4c9ddcb-bczwf\" (UID: \"99309390-c91d-44b4-90b0-4c7f51b1d767\") " pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.672354 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.672322 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z" Jun 09 12:42:23.756223 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.756199 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.761943 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.761890 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-gg8wk" Jun 09 12:42:23.798329 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.798287 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z"] Jun 09 12:42:23.802767 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:23.802736 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa240c8_5c4a_4742_87af_6b4b3aef35e3.slice/crio-94c55c426cf66505ce4926b650563675c43ee8831468b0c01f264be0fd33ff7c WatchSource:0}: Error finding container 94c55c426cf66505ce4926b650563675c43ee8831468b0c01f264be0fd33ff7c: Status 404 returned error can't find the container with id 94c55c426cf66505ce4926b650563675c43ee8831468b0c01f264be0fd33ff7c Jun 09 12:42:23.904213 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.904180 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-gg8wk"] Jun 09 12:42:23.907793 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:23.907769 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1b105f_36bc_4329_9818_345645c301d7.slice/crio-2405a0161e4983d1047ea9f29b851ee80499f6dad5f15b664e4b7862d34a15a5 WatchSource:0}: Error finding container 2405a0161e4983d1047ea9f29b851ee80499f6dad5f15b664e4b7862d34a15a5: Status 404 returned error can't find the container with id 2405a0161e4983d1047ea9f29b851ee80499f6dad5f15b664e4b7862d34a15a5 Jun 09 12:42:23.927331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.927309 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd4c9ddcb-bczwf"] Jun 09 12:42:23.930335 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:23.930313 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99309390_c91d_44b4_90b0_4c7f51b1d767.slice/crio-7421cdaf566f979ac5495aa43bb4fe7f0619f19185a0666333c219331ed505c4 WatchSource:0}: Error finding container 7421cdaf566f979ac5495aa43bb4fe7f0619f19185a0666333c219331ed505c4: Status 404 returned error can't find the container with id 7421cdaf566f979ac5495aa43bb4fe7f0619f19185a0666333c219331ed505c4 Jun 09 12:42:23.989631 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.989602 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z" event={"ID":"2fa240c8-5c4a-4742-87af-6b4b3aef35e3","Type":"ContainerStarted","Data":"94c55c426cf66505ce4926b650563675c43ee8831468b0c01f264be0fd33ff7c"} Jun 09 12:42:23.990695 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.990665 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-gg8wk" event={"ID":"5c1b105f-36bc-4329-9818-345645c301d7","Type":"ContainerStarted","Data":"2405a0161e4983d1047ea9f29b851ee80499f6dad5f15b664e4b7862d34a15a5"} Jun 09 12:42:23.992161 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.992137 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" event={"ID":"99309390-c91d-44b4-90b0-4c7f51b1d767","Type":"ContainerStarted","Data":"71c4becad964a78d20c80dbfbe5c44054180665872a94ad4c970915f7530b56b"} Jun 09 12:42:23.992251 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.992167 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:23.992251 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.992179 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" event={"ID":"99309390-c91d-44b4-90b0-4c7f51b1d767","Type":"ContainerStarted","Data":"7421cdaf566f979ac5495aa43bb4fe7f0619f19185a0666333c219331ed505c4"} Jun 09 12:42:23.992328 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.992257 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:23.998462 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:23.998445 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:24.017443 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.017402 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" podStartSLOduration=1.017388881 podStartE2EDuration="1.017388881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:24.016708663 +0000 UTC m=+80.850914928" watchObservedRunningTime="2026-06-09 12:42:24.017388881 +0000 UTC m=+80.851595125" Jun 09 12:42:24.132599 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.132570 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-trusted-ca\") pod \"c6aca831-c89e-470d-b006-84e8ed62ff3f\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " Jun 09 12:42:24.132747 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.132607 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6aca831-c89e-470d-b006-84e8ed62ff3f-ca-trust-extracted\") pod \"c6aca831-c89e-470d-b006-84e8ed62ff3f\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " Jun 09 12:42:24.132747 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.132669 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-bound-sa-token\") pod \"c6aca831-c89e-470d-b006-84e8ed62ff3f\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " Jun 09 12:42:24.132875 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.132769 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-tls\") pod \"c6aca831-c89e-470d-b006-84e8ed62ff3f\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " Jun 09 12:42:24.132875 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.132814 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-certificates\") pod \"c6aca831-c89e-470d-b006-84e8ed62ff3f\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " Jun 09 12:42:24.132875 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.132847 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jmjc\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-kube-api-access-7jmjc\") pod \"c6aca831-c89e-470d-b006-84e8ed62ff3f\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " Jun 09 12:42:24.133041 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.132916 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-image-registry-private-configuration\") pod \"c6aca831-c89e-470d-b006-84e8ed62ff3f\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " Jun 09 12:42:24.133041 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.132940 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6aca831-c89e-470d-b006-84e8ed62ff3f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c6aca831-c89e-470d-b006-84e8ed62ff3f" (UID: "c6aca831-c89e-470d-b006-84e8ed62ff3f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:42:24.133041 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.132953 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-installation-pull-secrets\") pod \"c6aca831-c89e-470d-b006-84e8ed62ff3f\" (UID: \"c6aca831-c89e-470d-b006-84e8ed62ff3f\") " Jun 09 12:42:24.133328 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.133264 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6aca831-c89e-470d-b006-84e8ed62ff3f-ca-trust-extracted\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.133328 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.133269 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c6aca831-c89e-470d-b006-84e8ed62ff3f" (UID: "c6aca831-c89e-470d-b006-84e8ed62ff3f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:42:24.134085 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.133998 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c6aca831-c89e-470d-b006-84e8ed62ff3f" (UID: "c6aca831-c89e-470d-b006-84e8ed62ff3f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:42:24.135174 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.135147 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c6aca831-c89e-470d-b006-84e8ed62ff3f" (UID: "c6aca831-c89e-470d-b006-84e8ed62ff3f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:24.135332 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.135246 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-kube-api-access-7jmjc" (OuterVolumeSpecName: "kube-api-access-7jmjc") pod "c6aca831-c89e-470d-b006-84e8ed62ff3f" (UID: "c6aca831-c89e-470d-b006-84e8ed62ff3f"). InnerVolumeSpecName "kube-api-access-7jmjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:24.135799 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.135774 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c6aca831-c89e-470d-b006-84e8ed62ff3f" (UID: "c6aca831-c89e-470d-b006-84e8ed62ff3f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:42:24.135799 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.135791 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c6aca831-c89e-470d-b006-84e8ed62ff3f" (UID: "c6aca831-c89e-470d-b006-84e8ed62ff3f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:24.136391 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.136370 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c6aca831-c89e-470d-b006-84e8ed62ff3f" (UID: "c6aca831-c89e-470d-b006-84e8ed62ff3f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:42:24.233966 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.233876 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-bound-sa-token\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.233966 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.233925 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-tls\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.233966 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.233935 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-registry-certificates\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.233966 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.233952 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jmjc\" (UniqueName: \"kubernetes.io/projected/c6aca831-c89e-470d-b006-84e8ed62ff3f-kube-api-access-7jmjc\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.233966 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.233964 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-image-registry-private-configuration\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.234220 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.233973 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6aca831-c89e-470d-b006-84e8ed62ff3f-installation-pull-secrets\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.234220 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.233982 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6aca831-c89e-470d-b006-84e8ed62ff3f-trusted-ca\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.996271 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:24.996244 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d48d5c99c-2tndt" Jun 09 12:42:25.083724 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.083695 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d48d5c99c-2tndt"] Jun 09 12:42:25.095575 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.095546 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d48d5c99c-2tndt"] Jun 09 12:42:25.162789 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.162755 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b4bc9d7f6-kmmj4"] Jun 09 12:42:25.166096 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.166067 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.170222 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.169563 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 12:42:25.170222 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.169728 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 12:42:25.170222 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.169737 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 12:42:25.170222 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.169866 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vhppm\"" Jun 09 12:42:25.170222 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.169999 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 12:42:25.170222 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.170096 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 12:42:25.179944 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.179923 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b4bc9d7f6-kmmj4"] Jun 09 12:42:25.241499 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.241467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-config\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.241669 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.241528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-serving-cert\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.241669 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.241557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldbrb\" (UniqueName: \"kubernetes.io/projected/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-kube-api-access-ldbrb\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.241669 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.241585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-service-ca\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.241669 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.241658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-oauth-config\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.241833 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.241704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-oauth-serving-cert\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.342800 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.342719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-oauth-serving-cert\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.342800 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.342759 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-config\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.343010 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.342807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-serving-cert\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.343010 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.342837 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldbrb\" (UniqueName: \"kubernetes.io/projected/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-kube-api-access-ldbrb\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.343010 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.342860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-service-ca\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.343010 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.342920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-oauth-config\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.343879 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.343850 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-oauth-serving-cert\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.344139 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.344113 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-config\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.344214 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.344161 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-service-ca\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.345832 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.345808 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-serving-cert\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.345990 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.345970 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-oauth-config\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.355798 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.355778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldbrb\" (UniqueName: \"kubernetes.io/projected/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-kube-api-access-ldbrb\") pod \"console-6b4bc9d7f6-kmmj4\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.477128 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.477088 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:25.635769 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.635689 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b4bc9d7f6-kmmj4"] Jun 09 12:42:25.642694 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:25.642668 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7e9d2c_6dcf_4a94_bb40_d264deeac10c.slice/crio-f51d05f50aea9cfb04568ae9046f773fa3e3ed5134e3b470469409ca8331440f WatchSource:0}: Error finding container f51d05f50aea9cfb04568ae9046f773fa3e3ed5134e3b470469409ca8331440f: Status 404 returned error can't find the container with id f51d05f50aea9cfb04568ae9046f773fa3e3ed5134e3b470469409ca8331440f Jun 09 12:42:25.659968 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:25.659944 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6aca831-c89e-470d-b006-84e8ed62ff3f" path="/var/lib/kubelet/pods/c6aca831-c89e-470d-b006-84e8ed62ff3f/volumes" Jun 09 12:42:26.001309 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.001261 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z" event={"ID":"2fa240c8-5c4a-4742-87af-6b4b3aef35e3","Type":"ContainerStarted","Data":"496a2ba7cb549e36a18911e708176cca39784a648353e79992e55c1fcab06cc0"} Jun 09 12:42:26.001739 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.001412 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z" Jun 09 12:42:26.002455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.002430 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4bc9d7f6-kmmj4" event={"ID":"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c","Type":"ContainerStarted","Data":"f51d05f50aea9cfb04568ae9046f773fa3e3ed5134e3b470469409ca8331440f"} Jun 09 12:42:26.006177 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.006151 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z" Jun 09 12:42:26.021743 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.021701 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kt59z" podStartSLOduration=1.8033241100000001 podStartE2EDuration="3.021687357s" totalImagesPullingTime="1.218363247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:26.021399894 +0000 UTC m=+82.855606162" watchObservedRunningTime="2026-06-09 12:42:26.021687357 +0000 UTC m=+82.855893622" Jun 09 12:42:26.909083 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.909047 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-vg47r"] Jun 09 12:42:26.912560 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.912537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:26.918445 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.918410 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 12:42:26.918445 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.918419 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 12:42:26.918798 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.918778 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 12:42:26.919820 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.919792 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-d44h4\"" Jun 09 12:42:26.926399 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.926377 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-vg47r"] Jun 09 12:42:26.969908 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:26.969882 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5bqfl" Jun 09 12:42:27.056881 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.056848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a84e2f-e32c-48df-bb09-eb3c56227bf5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.057280 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.056921 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fnfz\" (UniqueName: \"kubernetes.io/projected/02a84e2f-e32c-48df-bb09-eb3c56227bf5-kube-api-access-9fnfz\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.057280 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.057001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02a84e2f-e32c-48df-bb09-eb3c56227bf5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.057280 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.057048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02a84e2f-e32c-48df-bb09-eb3c56227bf5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.158472 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.158432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a84e2f-e32c-48df-bb09-eb3c56227bf5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.158642 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.158479 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnfz\" (UniqueName: \"kubernetes.io/projected/02a84e2f-e32c-48df-bb09-eb3c56227bf5-kube-api-access-9fnfz\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.158642 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.158524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02a84e2f-e32c-48df-bb09-eb3c56227bf5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.158642 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.158546 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02a84e2f-e32c-48df-bb09-eb3c56227bf5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.160084 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.160014 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02a84e2f-e32c-48df-bb09-eb3c56227bf5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.162011 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.161986 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/02a84e2f-e32c-48df-bb09-eb3c56227bf5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.162170 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.162149 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02a84e2f-e32c-48df-bb09-eb3c56227bf5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.169989 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.169962 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fnfz\" (UniqueName: \"kubernetes.io/projected/02a84e2f-e32c-48df-bb09-eb3c56227bf5-kube-api-access-9fnfz\") pod \"prometheus-operator-7f7d445d84-vg47r\" (UID: \"02a84e2f-e32c-48df-bb09-eb3c56227bf5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.223817 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.223793 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" Jun 09 12:42:27.362009 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.361970 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-vg47r"] Jun 09 12:42:27.365834 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:27.365809 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a84e2f_e32c_48df_bb09_eb3c56227bf5.slice/crio-e1f73c1e6fed564668066db2ca5329b3ebe2b0d06f1f0decb85c2484af60a539 WatchSource:0}: Error finding container e1f73c1e6fed564668066db2ca5329b3ebe2b0d06f1f0decb85c2484af60a539: Status 404 returned error can't find the container with id e1f73c1e6fed564668066db2ca5329b3ebe2b0d06f1f0decb85c2484af60a539 Jun 09 12:42:27.523644 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.523571 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-96c56684c-lctzz"] Jun 09 12:42:27.527860 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.527838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.536947 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.536923 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 12:42:27.539195 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.539173 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96c56684c-lctzz"] Jun 09 12:42:27.662236 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.662196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mkhg\" (UniqueName: \"kubernetes.io/projected/b025e057-c2b4-45b5-859e-fe65fc7e0774-kube-api-access-4mkhg\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.662414 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.662253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-serving-cert\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.662414 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.662309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-service-ca\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.662414 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.662384 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-oauth-serving-cert\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.662551 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.662426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-trusted-ca-bundle\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.662551 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.662477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-config\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.662551 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.662505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-oauth-config\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.763111 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.763074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-config\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.763111 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.763114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-oauth-config\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.763333 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.763172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mkhg\" (UniqueName: \"kubernetes.io/projected/b025e057-c2b4-45b5-859e-fe65fc7e0774-kube-api-access-4mkhg\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.763333 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.763215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-serving-cert\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.763333 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.763239 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-service-ca\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.763333 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.763285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-oauth-serving-cert\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.763333 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.763317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-trusted-ca-bundle\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.764183 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.764148 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-service-ca\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.764183 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.764165 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-config\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.764355 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.764216 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-oauth-serving-cert\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.764355 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.764236 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-trusted-ca-bundle\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.766058 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.766038 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-oauth-config\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.766426 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.766398 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-serving-cert\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.774842 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.774794 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mkhg\" (UniqueName: \"kubernetes.io/projected/b025e057-c2b4-45b5-859e-fe65fc7e0774-kube-api-access-4mkhg\") pod \"console-96c56684c-lctzz\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:27.839377 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:27.839348 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:28.003041 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:28.002918 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96c56684c-lctzz"] Jun 09 12:42:28.006514 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:28.006477 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb025e057_c2b4_45b5_859e_fe65fc7e0774.slice/crio-92000190b3580e7bcb81166a93d1856daedfe6e6b9d7d6b5e936f7e48f583494 WatchSource:0}: Error finding container 92000190b3580e7bcb81166a93d1856daedfe6e6b9d7d6b5e936f7e48f583494: Status 404 returned error can't find the container with id 92000190b3580e7bcb81166a93d1856daedfe6e6b9d7d6b5e936f7e48f583494 Jun 09 12:42:28.031537 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:28.031467 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96c56684c-lctzz" event={"ID":"b025e057-c2b4-45b5-859e-fe65fc7e0774","Type":"ContainerStarted","Data":"92000190b3580e7bcb81166a93d1856daedfe6e6b9d7d6b5e936f7e48f583494"} Jun 09 12:42:28.033890 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:28.033864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" event={"ID":"02a84e2f-e32c-48df-bb09-eb3c56227bf5","Type":"ContainerStarted","Data":"e1f73c1e6fed564668066db2ca5329b3ebe2b0d06f1f0decb85c2484af60a539"} Jun 09 12:42:30.043106 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:30.043017 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4bc9d7f6-kmmj4" event={"ID":"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c","Type":"ContainerStarted","Data":"415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed"} Jun 09 12:42:30.044915 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:30.044860 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96c56684c-lctzz" event={"ID":"b025e057-c2b4-45b5-859e-fe65fc7e0774","Type":"ContainerStarted","Data":"11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5"} Jun 09 12:42:30.046969 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:30.046942 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" event={"ID":"02a84e2f-e32c-48df-bb09-eb3c56227bf5","Type":"ContainerStarted","Data":"ce966604cc8f46185026cd4568452313c480ae11fccfdf7e56c6e85fdafe629d"} Jun 09 12:42:30.047072 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:30.046990 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" event={"ID":"02a84e2f-e32c-48df-bb09-eb3c56227bf5","Type":"ContainerStarted","Data":"0247254aee6c33e85a62be01cdf88527d143e0fea97296943196d1f748236fe9"} Jun 09 12:42:30.083681 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:30.083625 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b4bc9d7f6-kmmj4" podStartSLOduration=1.04673859 podStartE2EDuration="5.083605321s" totalImagesPullingTime="4.036866731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:30.082653201 +0000 UTC m=+86.916859492" watchObservedRunningTime="2026-06-09 12:42:30.083605321 +0000 UTC m=+86.917811587" Jun 09 12:42:30.107509 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:30.107458 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-vg47r" podStartSLOduration=1.794192464 podStartE2EDuration="4.107444182s" totalImagesPullingTime="2.313251718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:30.10701249 +0000 UTC m=+86.941218756" watchObservedRunningTime="2026-06-09 12:42:30.107444182 +0000 UTC m=+86.941650447" Jun 09 12:42:30.130373 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:30.130318 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-96c56684c-lctzz" podStartSLOduration=1.456984378 podStartE2EDuration="3.130305671s" totalImagesPullingTime="1.673321293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:30.129843168 +0000 UTC m=+86.964049434" watchObservedRunningTime="2026-06-09 12:42:30.130305671 +0000 UTC m=+86.964511937" Jun 09 12:42:32.287283 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.287248 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj"] Jun 09 12:42:32.290476 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.290461 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.293228 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.293210 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 12:42:32.293228 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.293217 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gt586\"" Jun 09 12:42:32.293369 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.293229 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 12:42:32.304210 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.304187 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj"] Jun 09 12:42:32.308087 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.308063 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mxn6t"] Jun 09 12:42:32.311630 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.311607 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.314370 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.314142 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 12:42:32.314370 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.314184 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 12:42:32.314844 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.314827 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hhcpb\"" Jun 09 12:42:32.315132 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.314827 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 12:42:32.407986 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.407953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-sys\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.407986 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.407989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-textfile\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.408217 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-tls\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.408217 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/31bcde57-4048-4466-ad74-47c6f8a57773-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.408217 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31bcde57-4048-4466-ad74-47c6f8a57773-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.408217 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-root\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.408217 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45xsb\" (UniqueName: \"kubernetes.io/projected/31bcde57-4048-4466-ad74-47c6f8a57773-kube-api-access-45xsb\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.408217 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-metrics-client-ca\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.408452 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-wtmp\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.408452 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.408452 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q787c\" (UniqueName: \"kubernetes.io/projected/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-kube-api-access-q787c\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.408452 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31bcde57-4048-4466-ad74-47c6f8a57773-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.408452 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.408360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.509379 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-textfile\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.509379 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-tls\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.509632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/31bcde57-4048-4466-ad74-47c6f8a57773-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.509632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509440 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31bcde57-4048-4466-ad74-47c6f8a57773-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.509632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509456 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-root\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.509632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45xsb\" (UniqueName: \"kubernetes.io/projected/31bcde57-4048-4466-ad74-47c6f8a57773-kube-api-access-45xsb\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.509632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-metrics-client-ca\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.509632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509546 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-wtmp\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.509632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509555 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-root\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.510054 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.510054 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509729 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q787c\" (UniqueName: \"kubernetes.io/projected/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-kube-api-access-q787c\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.510054 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509769 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-textfile\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.510054 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509792 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31bcde57-4048-4466-ad74-47c6f8a57773-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.510054 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.510054 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-sys\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.510054 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.509976 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-sys\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.510632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.510071 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-wtmp\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.510632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.510183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-metrics-client-ca\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.510632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.510275 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31bcde57-4048-4466-ad74-47c6f8a57773-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.510632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.510527 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.512204 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.512175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-tls\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.512299 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.512244 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.512376 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.512360 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/31bcde57-4048-4466-ad74-47c6f8a57773-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.512413 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.512371 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31bcde57-4048-4466-ad74-47c6f8a57773-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.521945 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.521881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45xsb\" (UniqueName: \"kubernetes.io/projected/31bcde57-4048-4466-ad74-47c6f8a57773-kube-api-access-45xsb\") pod \"openshift-state-metrics-65f78d5c66-ncrdj\" (UID: \"31bcde57-4048-4466-ad74-47c6f8a57773\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.522250 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.522231 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q787c\" (UniqueName: \"kubernetes.io/projected/aaed2e0c-c35f-4805-8f37-b12b130a4fbb-kube-api-access-q787c\") pod \"node-exporter-mxn6t\" (UID: \"aaed2e0c-c35f-4805-8f37-b12b130a4fbb\") " pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.599509 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.599436 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" Jun 09 12:42:32.622853 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.622828 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mxn6t" Jun 09 12:42:32.638406 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:32.638365 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaed2e0c_c35f_4805_8f37_b12b130a4fbb.slice/crio-d02dd4eb356cae2879637628974bb5cc29423d6e35b58f5a474b41f4e18ae79b WatchSource:0}: Error finding container d02dd4eb356cae2879637628974bb5cc29423d6e35b58f5a474b41f4e18ae79b: Status 404 returned error can't find the container with id d02dd4eb356cae2879637628974bb5cc29423d6e35b58f5a474b41f4e18ae79b Jun 09 12:42:32.747506 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:32.747475 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj"] Jun 09 12:42:32.750713 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:32.750686 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31bcde57_4048_4466_ad74_47c6f8a57773.slice/crio-750ae0e364db5a7d9e585ddfd469873946dba08ed332b5a12318bcab9b0e35f4 WatchSource:0}: Error finding container 750ae0e364db5a7d9e585ddfd469873946dba08ed332b5a12318bcab9b0e35f4: Status 404 returned error can't find the container with id 750ae0e364db5a7d9e585ddfd469873946dba08ed332b5a12318bcab9b0e35f4 Jun 09 12:42:33.061402 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.061361 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxn6t" event={"ID":"aaed2e0c-c35f-4805-8f37-b12b130a4fbb","Type":"ContainerStarted","Data":"d02dd4eb356cae2879637628974bb5cc29423d6e35b58f5a474b41f4e18ae79b"} Jun 09 12:42:33.064404 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.064368 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" event={"ID":"31bcde57-4048-4466-ad74-47c6f8a57773","Type":"ContainerStarted","Data":"74582d3db5576a9fc33c921be0fd3000b19aeb23f3711ac808d574ea7cefcb0d"} Jun 09 12:42:33.064526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.064430 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" event={"ID":"31bcde57-4048-4466-ad74-47c6f8a57773","Type":"ContainerStarted","Data":"2ca4248ed90e0057962ec4c90aa32655f39ec5e7587f7e8ea3355d00c1218b15"} Jun 09 12:42:33.064526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.064493 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" event={"ID":"31bcde57-4048-4466-ad74-47c6f8a57773","Type":"ContainerStarted","Data":"750ae0e364db5a7d9e585ddfd469873946dba08ed332b5a12318bcab9b0e35f4"} Jun 09 12:42:33.571743 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.571715 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:42:33.577043 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.577023 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.585526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.585023 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9lk5h\"" Jun 09 12:42:33.585526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.585254 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 12:42:33.585526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.585500 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 12:42:33.585825 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.585679 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 12:42:33.585887 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.585859 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 12:42:33.586057 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.586038 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 12:42:33.586219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.586202 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 12:42:33.587074 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.587050 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 12:42:33.590316 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.590294 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 12:42:33.590679 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.590659 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 12:42:33.597495 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.597454 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.720842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4spgr\" (UniqueName: \"kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-kube-api-access-4spgr\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.720884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.720941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-web-config\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.720971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.720997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.721031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.721059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.721092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.721118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-out\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.721147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.721332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.721395 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.721558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.721423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.821938 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.821826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4spgr\" (UniqueName: \"kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-kube-api-access-4spgr\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.821938 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.821875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.821938 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.821935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-web-config\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.822219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.821974 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.822219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.822002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.822219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.822069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.822219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.822101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.822219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.822139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.822219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.822196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-out\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.822505 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.822233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.822505 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.822305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.822505 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.822386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.822505 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.822421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.823790 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.823216 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.823790 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.823500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.825943 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.825921 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-web-config\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.827721 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.827394 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-out\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.827721 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.827549 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.827721 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.827665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.827721 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.827683 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.833538 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.827858 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.833538 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.829666 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.833538 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.830029 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.833538 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.831536 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.833538 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.833106 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4spgr\" (UniqueName: \"kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-kube-api-access-4spgr\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.833538 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.833216 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:33.903238 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:33.903199 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:42:34.064331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:34.064298 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:42:34.071769 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:34.071735 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f5cb904_f0d9_4a98_89fa_79d9a2955685.slice/crio-147bce1a38dfc8121be30988b562fe5dbfab95b501081a740d47d991aea841e6 WatchSource:0}: Error finding container 147bce1a38dfc8121be30988b562fe5dbfab95b501081a740d47d991aea841e6: Status 404 returned error can't find the container with id 147bce1a38dfc8121be30988b562fe5dbfab95b501081a740d47d991aea841e6 Jun 09 12:42:34.073302 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:34.073274 2561 generic.go:356] "Generic (PLEG): container finished" podID="aaed2e0c-c35f-4805-8f37-b12b130a4fbb" containerID="c0335068ad139fe045a8469dd2d3fdfbe49878a51ec0fd7ff99f8b3e24d1db61" exitCode=0 Jun 09 12:42:34.073414 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:34.073319 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxn6t" event={"ID":"aaed2e0c-c35f-4805-8f37-b12b130a4fbb","Type":"ContainerDied","Data":"c0335068ad139fe045a8469dd2d3fdfbe49878a51ec0fd7ff99f8b3e24d1db61"} Jun 09 12:42:35.082924 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.082744 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxn6t" event={"ID":"aaed2e0c-c35f-4805-8f37-b12b130a4fbb","Type":"ContainerStarted","Data":"12c1e167d475e9a109d3622157d9744ffc16777fcc73476091b581f594f48407"} Jun 09 12:42:35.082924 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.082846 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxn6t" event={"ID":"aaed2e0c-c35f-4805-8f37-b12b130a4fbb","Type":"ContainerStarted","Data":"28c9f4596a73aa7aa0ad7a0cc33d6b1f1dd577cff099133805090bc3258ab171"} Jun 09 12:42:35.085072 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.085046 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" event={"ID":"31bcde57-4048-4466-ad74-47c6f8a57773","Type":"ContainerStarted","Data":"51ec14128309ed6a6c561ae3e5e9b48426cc0d32a28e8962ae97ce19930271d4"} Jun 09 12:42:35.086260 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.086234 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerStarted","Data":"147bce1a38dfc8121be30988b562fe5dbfab95b501081a740d47d991aea841e6"} Jun 09 12:42:35.111488 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.111442 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mxn6t" podStartSLOduration=2.121629083 podStartE2EDuration="3.111424326s" totalImagesPullingTime="899.224475ms" totalInitContainerRuntime="90.570768ms" isStatefulPod=true podCreationTimestamp="2026-06-09 12:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:35.109230956 +0000 UTC m=+91.943437221" watchObservedRunningTime="2026-06-09 12:42:35.111424326 +0000 UTC m=+91.945630597" Jun 09 12:42:35.130586 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.130535 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ncrdj" podStartSLOduration=1.622481032 podStartE2EDuration="3.130524135s" totalImagesPullingTime="1.508043103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:35.13048988 +0000 UTC m=+91.964696149" watchObservedRunningTime="2026-06-09 12:42:35.130524135 +0000 UTC m=+91.964730392" Jun 09 12:42:35.419252 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.419214 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-847759ffd7-tdlmg"] Jun 09 12:42:35.423330 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.423304 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.426038 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.426017 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 12:42:35.426410 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.426392 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 12:42:35.426502 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.426481 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2024e8isc5fjd\"" Jun 09 12:42:35.426651 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.426630 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cjng6\"" Jun 09 12:42:35.426943 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.426926 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 12:42:35.427033 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.427020 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 12:42:35.427262 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.427233 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 12:42:35.437869 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.437795 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-847759ffd7-tdlmg"] Jun 09 12:42:35.478177 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.478151 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:35.478310 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.478197 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:35.483873 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.483851 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:35.536423 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.536397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-tls\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.536542 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.536435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7f7z\" (UniqueName: \"kubernetes.io/projected/3395edd9-e3d4-40f5-8e80-bd205205da71-kube-api-access-n7f7z\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.536542 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.536480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.536542 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.536526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.536666 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.536548 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.536666 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.536578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3395edd9-e3d4-40f5-8e80-bd205205da71-metrics-client-ca\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.536666 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.536601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-grpc-tls\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.536666 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.536642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.637264 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.637234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3395edd9-e3d4-40f5-8e80-bd205205da71-metrics-client-ca\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.637264 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.637267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-grpc-tls\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.637489 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.637299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.637489 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.637381 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-tls\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.637489 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.637435 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7f7z\" (UniqueName: \"kubernetes.io/projected/3395edd9-e3d4-40f5-8e80-bd205205da71-kube-api-access-n7f7z\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.637655 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.637492 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.637655 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.637554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.637655 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.637610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.638136 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.638107 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3395edd9-e3d4-40f5-8e80-bd205205da71-metrics-client-ca\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.640384 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.640339 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.640487 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.640392 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.640697 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.640659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-grpc-tls\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.640697 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.640687 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.640816 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.640733 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.641097 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.641072 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3395edd9-e3d4-40f5-8e80-bd205205da71-secret-thanos-querier-tls\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.651526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.651506 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7f7z\" (UniqueName: \"kubernetes.io/projected/3395edd9-e3d4-40f5-8e80-bd205205da71-kube-api-access-n7f7z\") pod \"thanos-querier-847759ffd7-tdlmg\" (UID: \"3395edd9-e3d4-40f5-8e80-bd205205da71\") " pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.733961 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.733859 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:35.887892 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:35.887869 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-847759ffd7-tdlmg"] Jun 09 12:42:35.889869 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:35.889845 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3395edd9_e3d4_40f5_8e80_bd205205da71.slice/crio-79822cdfccae449749b539bdbf3b513432dc98384e478d8f3f101ff49f4602b8 WatchSource:0}: Error finding container 79822cdfccae449749b539bdbf3b513432dc98384e478d8f3f101ff49f4602b8: Status 404 returned error can't find the container with id 79822cdfccae449749b539bdbf3b513432dc98384e478d8f3f101ff49f4602b8 Jun 09 12:42:36.092152 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:36.092072 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerID="1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20" exitCode=0 Jun 09 12:42:36.092576 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:36.092171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerDied","Data":"1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20"} Jun 09 12:42:36.094014 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:36.093839 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" event={"ID":"3395edd9-e3d4-40f5-8e80-bd205205da71","Type":"ContainerStarted","Data":"79822cdfccae449749b539bdbf3b513432dc98384e478d8f3f101ff49f4602b8"} Jun 09 12:42:36.098327 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:36.098307 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:42:37.839524 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:37.839473 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:37.839973 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:37.839551 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:37.845512 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:37.845483 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:38.108755 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:38.108677 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:42:38.178570 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:38.178543 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b4bc9d7f6-kmmj4"] Jun 09 12:42:39.114195 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:39.114117 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerStarted","Data":"71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703"} Jun 09 12:42:39.114195 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:39.114192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerStarted","Data":"5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629"} Jun 09 12:42:39.114848 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:39.114237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerStarted","Data":"790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11"} Jun 09 12:42:39.114848 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:39.114270 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerStarted","Data":"8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac"} Jun 09 12:42:39.114848 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:39.114293 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerStarted","Data":"f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58"} Jun 09 12:42:39.118810 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:39.118768 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" event={"ID":"3395edd9-e3d4-40f5-8e80-bd205205da71","Type":"ContainerStarted","Data":"35949b37841072c0bd63d479d760f6d349755e8101a54fdd6efc4e71879aa912"} Jun 09 12:42:39.118959 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:39.118846 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" event={"ID":"3395edd9-e3d4-40f5-8e80-bd205205da71","Type":"ContainerStarted","Data":"d5f6b511f26b7f0f0e486fd1217759df75590652158775b78f6a61b92fb3b9ba"} Jun 09 12:42:39.118959 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:39.118876 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" event={"ID":"3395edd9-e3d4-40f5-8e80-bd205205da71","Type":"ContainerStarted","Data":"35520d93aa353f19099b2849e044ecdbbcdfc73ecd61d8c6bec0fe4b2667cede"} Jun 09 12:42:40.126105 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:40.126002 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerStarted","Data":"de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6"} Jun 09 12:42:40.128757 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:40.128735 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" event={"ID":"3395edd9-e3d4-40f5-8e80-bd205205da71","Type":"ContainerStarted","Data":"88c9837f7d665adc13111ef6db4f835510529479b6433476c4cc10ff14510796"} Jun 09 12:42:40.128857 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:40.128785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" event={"ID":"3395edd9-e3d4-40f5-8e80-bd205205da71","Type":"ContainerStarted","Data":"4730c200f588626cd5f9bfee6f0bbdaceeb1d09ec53f5a407e527118f8688d4f"} Jun 09 12:42:40.128857 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:40.128811 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" event={"ID":"3395edd9-e3d4-40f5-8e80-bd205205da71","Type":"ContainerStarted","Data":"2d8591c3c1880a02634134a49aed741cea7eaf7c915cb7a1d09430019bc9e685"} Jun 09 12:42:40.128950 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:40.128853 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:40.190644 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:40.190597 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.846051563 podStartE2EDuration="7.190581756s" totalImagesPullingTime="4.325494852s" totalInitContainerRuntime="19.035341ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:40.180868622 +0000 UTC m=+97.015074912" watchObservedRunningTime="2026-06-09 12:42:40.190581756 +0000 UTC m=+97.024788001" Jun 09 12:42:40.310610 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:40.310550 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" podStartSLOduration=1.7395946530000002 podStartE2EDuration="5.310528364s" totalImagesPullingTime="3.570933711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:40.309258229 +0000 UTC m=+97.143464536" watchObservedRunningTime="2026-06-09 12:42:40.310528364 +0000 UTC m=+97.144734631" Jun 09 12:42:45.001542 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.001506 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fd4c9ddcb-bczwf" Jun 09 12:42:45.332093 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.332015 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79bc68947f-fpr4b"] Jun 09 12:42:45.335516 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.335493 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.349941 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.349504 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79bc68947f-fpr4b"] Jun 09 12:42:45.435866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.435819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp6kh\" (UniqueName: \"kubernetes.io/projected/dc33bffe-b750-466d-871b-8af76fd2b346-kube-api-access-fp6kh\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.435866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.435867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-serving-cert\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.436105 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.435946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-trusted-ca-bundle\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.436105 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.435985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-oauth-config\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.436105 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.436004 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-console-config\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.436105 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.436053 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-oauth-serving-cert\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.436105 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.436080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-service-ca\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.537373 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.537344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-trusted-ca-bundle\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.537566 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.537389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-oauth-config\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.537566 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.537419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-console-config\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.537566 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.537461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-oauth-serving-cert\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.537566 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.537479 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-service-ca\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.537566 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.537545 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp6kh\" (UniqueName: \"kubernetes.io/projected/dc33bffe-b750-466d-871b-8af76fd2b346-kube-api-access-fp6kh\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.537867 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.537575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-serving-cert\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.538251 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.538199 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-console-config\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.538705 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.538682 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-oauth-serving-cert\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.539208 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.539182 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-trusted-ca-bundle\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.539335 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.539310 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-service-ca\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.540203 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.540184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-serving-cert\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.540386 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.540365 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-oauth-config\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.556992 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.556968 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp6kh\" (UniqueName: \"kubernetes.io/projected/dc33bffe-b750-466d-871b-8af76fd2b346-kube-api-access-fp6kh\") pod \"console-79bc68947f-fpr4b\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:45.646942 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:45.646888 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:46.141850 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:46.141772 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-847759ffd7-tdlmg" Jun 09 12:42:47.971508 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:47.971459 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8ptt5" Jun 09 12:42:48.098584 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:48.098555 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79bc68947f-fpr4b"] Jun 09 12:42:48.192828 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:42:48.192794 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc33bffe_b750_466d_871b_8af76fd2b346.slice/crio-0a46d374e6efc7ab880d7f40375ebbbb004b34667b03b5faaafabc43e1ce8648 WatchSource:0}: Error finding container 0a46d374e6efc7ab880d7f40375ebbbb004b34667b03b5faaafabc43e1ce8648: Status 404 returned error can't find the container with id 0a46d374e6efc7ab880d7f40375ebbbb004b34667b03b5faaafabc43e1ce8648 Jun 09 12:42:49.172114 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:49.172078 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-gg8wk" event={"ID":"5c1b105f-36bc-4329-9818-345645c301d7","Type":"ContainerStarted","Data":"697d4c3391e518612c2bf7d39860ecbcd78ab10dab9c3dfdaa2e59e5825a4ac9"} Jun 09 12:42:49.172662 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:49.172419 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-gg8wk" Jun 09 12:42:49.174084 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:49.174044 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bc68947f-fpr4b" event={"ID":"dc33bffe-b750-466d-871b-8af76fd2b346","Type":"ContainerStarted","Data":"32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2"} Jun 09 12:42:49.174201 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:49.174103 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bc68947f-fpr4b" event={"ID":"dc33bffe-b750-466d-871b-8af76fd2b346","Type":"ContainerStarted","Data":"0a46d374e6efc7ab880d7f40375ebbbb004b34667b03b5faaafabc43e1ce8648"} Jun 09 12:42:49.188426 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:49.188403 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-gg8wk" Jun 09 12:42:49.194010 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:49.193961 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-gg8wk" podStartSLOduration=1.8480096609999999 podStartE2EDuration="26.193948437s" totalImagesPullingTime="24.345938776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:49.19327837 +0000 UTC m=+106.027484635" watchObservedRunningTime="2026-06-09 12:42:49.193948437 +0000 UTC m=+106.028154702" Jun 09 12:42:49.248169 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:49.248105 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79bc68947f-fpr4b" podStartSLOduration=4.248082346 podStartE2EDuration="4.248082346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:49.246000708 +0000 UTC m=+106.080206975" watchObservedRunningTime="2026-06-09 12:42:49.248082346 +0000 UTC m=+106.082288614" Jun 09 12:42:55.647507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:55.647470 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:55.648114 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:55.647537 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:55.653293 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:55.653266 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:56.212013 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:56.211984 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:42:56.272757 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:42:56.272722 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-96c56684c-lctzz"] Jun 09 12:43:03.209183 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.209119 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b4bc9d7f6-kmmj4" podUID="cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" containerName="console" containerID="cri-o://415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed" gracePeriod=15 Jun 09 12:43:03.494173 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.494138 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:43:03.611204 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.611164 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-oauth-serving-cert\") pod \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " Jun 09 12:43:03.611362 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.611252 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldbrb\" (UniqueName: \"kubernetes.io/projected/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-kube-api-access-ldbrb\") pod \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " Jun 09 12:43:03.611362 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.611291 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-config\") pod \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " Jun 09 12:43:03.611475 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.611386 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-serving-cert\") pod \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " Jun 09 12:43:03.611475 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.611411 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-service-ca\") pod \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " Jun 09 12:43:03.611475 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.611438 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-oauth-config\") pod \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\" (UID: \"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c\") " Jun 09 12:43:03.611666 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.611634 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" (UID: "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:43:03.611727 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.611697 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-config" (OuterVolumeSpecName: "console-config") pod "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" (UID: "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:43:03.612176 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.612150 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" (UID: "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:43:03.613974 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.613940 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" (UID: "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:03.613974 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.613957 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" (UID: "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:03.613974 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.613944 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-kube-api-access-ldbrb" (OuterVolumeSpecName: "kube-api-access-ldbrb") pod "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" (UID: "cf7e9d2c-6dcf-4a94-bb40-d264deeac10c"). InnerVolumeSpecName "kube-api-access-ldbrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:43:03.712636 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.712562 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldbrb\" (UniqueName: \"kubernetes.io/projected/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-kube-api-access-ldbrb\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:03.712636 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.712590 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:03.712636 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.712604 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:03.712636 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.712615 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-service-ca\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:03.712636 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.712627 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-console-oauth-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:03.712636 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:03.712639 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c-oauth-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:04.239633 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:04.239597 2561 generic.go:356] "Generic (PLEG): container finished" podID="cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" containerID="415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed" exitCode=0 Jun 09 12:43:04.240084 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:04.239659 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4bc9d7f6-kmmj4" Jun 09 12:43:04.240084 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:04.239668 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4bc9d7f6-kmmj4" event={"ID":"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c","Type":"ContainerDied","Data":"415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed"} Jun 09 12:43:04.240084 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:04.239735 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4bc9d7f6-kmmj4" event={"ID":"cf7e9d2c-6dcf-4a94-bb40-d264deeac10c","Type":"ContainerDied","Data":"f51d05f50aea9cfb04568ae9046f773fa3e3ed5134e3b470469409ca8331440f"} Jun 09 12:43:04.240084 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:04.239765 2561 scope.go:117] "RemoveContainer" containerID="415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed" Jun 09 12:43:04.247956 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:04.247940 2561 scope.go:117] "RemoveContainer" containerID="415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed" Jun 09 12:43:04.248217 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:43:04.248195 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed\": container with ID starting with 415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed not found: ID does not exist" containerID="415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed" Jun 09 12:43:04.248280 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:04.248225 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed"} err="failed to get container status \"415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed\": rpc error: code = NotFound desc = could not find container \"415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed\": container with ID starting with 415cd5d4685330bbe44f2153e4388050d62643ac377516acf2272b8ec3dc47ed not found: ID does not exist" Jun 09 12:43:04.260881 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:04.260857 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b4bc9d7f6-kmmj4"] Jun 09 12:43:04.267796 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:04.267775 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b4bc9d7f6-kmmj4"] Jun 09 12:43:05.661470 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:05.661438 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" path="/var/lib/kubelet/pods/cf7e9d2c-6dcf-4a94-bb40-d264deeac10c/volumes" Jun 09 12:43:13.497364 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:13.497321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:43:13.499686 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:13.499660 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2725b703-989a-4bb7-ab75-5945026ccb96-metrics-certs\") pod \"network-metrics-daemon-xkvmm\" (UID: \"2725b703-989a-4bb7-ab75-5945026ccb96\") " pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:43:13.779177 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:13.779108 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sfqkv\"" Jun 09 12:43:13.785491 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:13.785466 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xkvmm" Jun 09 12:43:13.935847 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:13.935812 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xkvmm"] Jun 09 12:43:13.938439 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:43:13.938396 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2725b703_989a_4bb7_ab75_5945026ccb96.slice/crio-9da9097714423c64d103196da979039f243491e33acfcedd53b325347a05ad7a WatchSource:0}: Error finding container 9da9097714423c64d103196da979039f243491e33acfcedd53b325347a05ad7a: Status 404 returned error can't find the container with id 9da9097714423c64d103196da979039f243491e33acfcedd53b325347a05ad7a Jun 09 12:43:14.280311 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:14.280274 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xkvmm" event={"ID":"2725b703-989a-4bb7-ab75-5945026ccb96","Type":"ContainerStarted","Data":"9da9097714423c64d103196da979039f243491e33acfcedd53b325347a05ad7a"} Jun 09 12:43:16.292567 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:16.292528 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xkvmm" event={"ID":"2725b703-989a-4bb7-ab75-5945026ccb96","Type":"ContainerStarted","Data":"9018cefaae29d7714b922aad31b5aaf1c11a41a736a580a49c69a30c71b91dcc"} Jun 09 12:43:16.292938 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:16.292596 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xkvmm" event={"ID":"2725b703-989a-4bb7-ab75-5945026ccb96","Type":"ContainerStarted","Data":"f50ccd71837c4a69f407bf1f8d4fb9c025162b426689b38e791dc77f1d527629"} Jun 09 12:43:16.319648 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:16.319303 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xkvmm" podStartSLOduration=132.038815407 podStartE2EDuration="2m13.319281317s" totalImagesPullingTime="1.28046591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:43:16.316812114 +0000 UTC m=+133.151018392" watchObservedRunningTime="2026-06-09 12:43:16.319281317 +0000 UTC m=+133.153487585" Jun 09 12:43:21.299892 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.299848 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-96c56684c-lctzz" podUID="b025e057-c2b4-45b5-859e-fe65fc7e0774" containerName="console" containerID="cri-o://11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5" gracePeriod=15 Jun 09 12:43:21.584960 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.584933 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:43:21.669685 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.669648 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-serving-cert\") pod \"b025e057-c2b4-45b5-859e-fe65fc7e0774\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " Jun 09 12:43:21.669836 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.669688 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-oauth-config\") pod \"b025e057-c2b4-45b5-859e-fe65fc7e0774\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " Jun 09 12:43:21.669836 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.669721 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-trusted-ca-bundle\") pod \"b025e057-c2b4-45b5-859e-fe65fc7e0774\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " Jun 09 12:43:21.669836 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.669753 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-config\") pod \"b025e057-c2b4-45b5-859e-fe65fc7e0774\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " Jun 09 12:43:21.669836 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.669784 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-service-ca\") pod \"b025e057-c2b4-45b5-859e-fe65fc7e0774\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " Jun 09 12:43:21.670073 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.669882 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-oauth-serving-cert\") pod \"b025e057-c2b4-45b5-859e-fe65fc7e0774\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " Jun 09 12:43:21.670073 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.669978 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mkhg\" (UniqueName: \"kubernetes.io/projected/b025e057-c2b4-45b5-859e-fe65fc7e0774-kube-api-access-4mkhg\") pod \"b025e057-c2b4-45b5-859e-fe65fc7e0774\" (UID: \"b025e057-c2b4-45b5-859e-fe65fc7e0774\") " Jun 09 12:43:21.670730 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.670231 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-config" (OuterVolumeSpecName: "console-config") pod "b025e057-c2b4-45b5-859e-fe65fc7e0774" (UID: "b025e057-c2b4-45b5-859e-fe65fc7e0774"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:43:21.670730 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.670281 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b025e057-c2b4-45b5-859e-fe65fc7e0774" (UID: "b025e057-c2b4-45b5-859e-fe65fc7e0774"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:43:21.670730 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.670290 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-service-ca" (OuterVolumeSpecName: "service-ca") pod "b025e057-c2b4-45b5-859e-fe65fc7e0774" (UID: "b025e057-c2b4-45b5-859e-fe65fc7e0774"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:43:21.670730 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.670382 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b025e057-c2b4-45b5-859e-fe65fc7e0774" (UID: "b025e057-c2b4-45b5-859e-fe65fc7e0774"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:43:21.672121 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.672095 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b025e057-c2b4-45b5-859e-fe65fc7e0774" (UID: "b025e057-c2b4-45b5-859e-fe65fc7e0774"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:21.672201 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.672153 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b025e057-c2b4-45b5-859e-fe65fc7e0774" (UID: "b025e057-c2b4-45b5-859e-fe65fc7e0774"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:21.672370 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.672346 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b025e057-c2b4-45b5-859e-fe65fc7e0774-kube-api-access-4mkhg" (OuterVolumeSpecName: "kube-api-access-4mkhg") pod "b025e057-c2b4-45b5-859e-fe65fc7e0774" (UID: "b025e057-c2b4-45b5-859e-fe65fc7e0774"). InnerVolumeSpecName "kube-api-access-4mkhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:43:21.771067 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.771034 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:21.771067 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.771060 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-oauth-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:21.771067 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.771070 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-trusted-ca-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:21.771285 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.771079 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-console-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:21.771285 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.771087 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-service-ca\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:21.771285 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.771095 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b025e057-c2b4-45b5-859e-fe65fc7e0774-oauth-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:21.771285 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:21.771103 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mkhg\" (UniqueName: \"kubernetes.io/projected/b025e057-c2b4-45b5-859e-fe65fc7e0774-kube-api-access-4mkhg\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:22.320165 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:22.320135 2561 generic.go:356] "Generic (PLEG): container finished" podID="b025e057-c2b4-45b5-859e-fe65fc7e0774" containerID="11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5" exitCode=0 Jun 09 12:43:22.320573 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:22.320180 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96c56684c-lctzz" Jun 09 12:43:22.320573 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:22.320234 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96c56684c-lctzz" event={"ID":"b025e057-c2b4-45b5-859e-fe65fc7e0774","Type":"ContainerDied","Data":"11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5"} Jun 09 12:43:22.320573 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:22.320277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96c56684c-lctzz" event={"ID":"b025e057-c2b4-45b5-859e-fe65fc7e0774","Type":"ContainerDied","Data":"92000190b3580e7bcb81166a93d1856daedfe6e6b9d7d6b5e936f7e48f583494"} Jun 09 12:43:22.320573 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:22.320300 2561 scope.go:117] "RemoveContainer" containerID="11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5" Jun 09 12:43:22.329277 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:22.329261 2561 scope.go:117] "RemoveContainer" containerID="11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5" Jun 09 12:43:22.329525 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:43:22.329509 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5\": container with ID starting with 11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5 not found: ID does not exist" containerID="11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5" Jun 09 12:43:22.329592 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:22.329532 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5"} err="failed to get container status \"11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5\": rpc error: code = NotFound desc = could not find container \"11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5\": container with ID starting with 11d4e6344f6e345ee7ebe9e3b5529b71f4edee829afaac46e88adbed705076e5 not found: ID does not exist" Jun 09 12:43:22.350832 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:22.350809 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-96c56684c-lctzz"] Jun 09 12:43:22.352532 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:22.352513 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-96c56684c-lctzz"] Jun 09 12:43:23.664509 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:23.664474 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b025e057-c2b4-45b5-859e-fe65fc7e0774" path="/var/lib/kubelet/pods/b025e057-c2b4-45b5-859e-fe65fc7e0774/volumes" Jun 09 12:43:52.875367 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:52.875287 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:43:52.875838 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:52.875657 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="alertmanager" containerID="cri-o://f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58" gracePeriod=120 Jun 09 12:43:52.875838 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:52.875689 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy-metric" containerID="cri-o://71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703" gracePeriod=120 Jun 09 12:43:52.875838 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:52.875726 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy-web" containerID="cri-o://790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11" gracePeriod=120 Jun 09 12:43:52.875838 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:52.875778 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy" containerID="cri-o://5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629" gracePeriod=120 Jun 09 12:43:52.876097 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:52.875751 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="config-reloader" containerID="cri-o://8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac" gracePeriod=120 Jun 09 12:43:52.876097 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:52.875718 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="prom-label-proxy" containerID="cri-o://de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6" gracePeriod=120 Jun 09 12:43:53.443415 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:53.443379 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerID="de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6" exitCode=0 Jun 09 12:43:53.443415 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:53.443407 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerID="5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629" exitCode=0 Jun 09 12:43:53.443415 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:53.443416 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerID="8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac" exitCode=0 Jun 09 12:43:53.443415 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:53.443423 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerID="f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58" exitCode=0 Jun 09 12:43:53.443685 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:53.443453 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerDied","Data":"de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6"} Jun 09 12:43:53.443685 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:53.443542 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerDied","Data":"5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629"} Jun 09 12:43:53.443685 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:53.443572 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerDied","Data":"8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac"} Jun 09 12:43:53.443685 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:53.443597 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerDied","Data":"f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58"} Jun 09 12:43:54.123028 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.123006 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.224107 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224038 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4spgr\" (UniqueName: \"kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-kube-api-access-4spgr\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224107 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224068 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-tls-assets\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224107 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224091 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-trusted-ca-bundle\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224368 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224124 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224368 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224166 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-web-config\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224368 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224189 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-main-tls\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224368 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224218 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-out\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224368 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224241 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-metrics-client-ca\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224368 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224269 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224368 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224317 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-volume\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224368 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224345 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-main-db\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224742 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224376 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-web\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224742 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224402 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-cluster-tls-config\") pod \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\" (UID: \"9f5cb904-f0d9-4a98-89fa-79d9a2955685\") " Jun 09 12:43:54.224742 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224497 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:43:54.224742 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.224689 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.225097 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.225069 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:43:54.225385 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.225359 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:43:54.227623 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.227592 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:54.227916 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.227799 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-kube-api-access-4spgr" (OuterVolumeSpecName: "kube-api-access-4spgr") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "kube-api-access-4spgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:43:54.227916 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.227846 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:43:54.227916 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.227864 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-out" (OuterVolumeSpecName: "config-out") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:43:54.228417 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.228388 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:54.228704 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.228683 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:54.229358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.229326 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:54.229437 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.229403 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-volume" (OuterVolumeSpecName: "config-volume") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:54.231525 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.231501 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:54.237792 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.237770 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-web-config" (OuterVolumeSpecName: "web-config") pod "9f5cb904-f0d9-4a98-89fa-79d9a2955685" (UID: "9f5cb904-f0d9-4a98-89fa-79d9a2955685"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:43:54.326101 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326055 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326101 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326097 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-web-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326101 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326112 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-main-tls\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326125 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-out\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326137 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f5cb904-f0d9-4a98-89fa-79d9a2955685-metrics-client-ca\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326149 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326161 2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-config-volume\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326173 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f5cb904-f0d9-4a98-89fa-79d9a2955685-alertmanager-main-db\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326185 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326197 2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f5cb904-f0d9-4a98-89fa-79d9a2955685-cluster-tls-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326208 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4spgr\" (UniqueName: \"kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-kube-api-access-4spgr\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.326331 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.326220 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f5cb904-f0d9-4a98-89fa-79d9a2955685-tls-assets\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:43:54.450632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.450597 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerID="71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703" exitCode=0 Jun 09 12:43:54.450632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.450622 2561 generic.go:356] "Generic (PLEG): container finished" podID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerID="790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11" exitCode=0 Jun 09 12:43:54.450866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.450645 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerDied","Data":"71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703"} Jun 09 12:43:54.450866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.450690 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.450866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.450706 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerDied","Data":"790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11"} Jun 09 12:43:54.450866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.450737 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f5cb904-f0d9-4a98-89fa-79d9a2955685","Type":"ContainerDied","Data":"147bce1a38dfc8121be30988b562fe5dbfab95b501081a740d47d991aea841e6"} Jun 09 12:43:54.450866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.450780 2561 scope.go:117] "RemoveContainer" containerID="de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6" Jun 09 12:43:54.459392 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.459282 2561 scope.go:117] "RemoveContainer" containerID="71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703" Jun 09 12:43:54.466245 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.466224 2561 scope.go:117] "RemoveContainer" containerID="5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629" Jun 09 12:43:54.472675 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.472658 2561 scope.go:117] "RemoveContainer" containerID="790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11" Jun 09 12:43:54.477755 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.477707 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:43:54.479575 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.479556 2561 scope.go:117] "RemoveContainer" containerID="8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac" Jun 09 12:43:54.482803 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.482779 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:43:54.486446 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.486423 2561 scope.go:117] "RemoveContainer" containerID="f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58" Jun 09 12:43:54.493048 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.493032 2561 scope.go:117] "RemoveContainer" containerID="1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20" Jun 09 12:43:54.499571 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.499557 2561 scope.go:117] "RemoveContainer" containerID="de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6" Jun 09 12:43:54.499817 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:43:54.499797 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6\": container with ID starting with de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6 not found: ID does not exist" containerID="de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6" Jun 09 12:43:54.499923 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.499824 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6"} err="failed to get container status \"de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6\": rpc error: code = NotFound desc = could not find container \"de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6\": container with ID starting with de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6 not found: ID does not exist" Jun 09 12:43:54.499923 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.499842 2561 scope.go:117] "RemoveContainer" containerID="71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703" Jun 09 12:43:54.500112 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:43:54.500091 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703\": container with ID starting with 71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703 not found: ID does not exist" containerID="71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703" Jun 09 12:43:54.500152 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.500118 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703"} err="failed to get container status \"71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703\": rpc error: code = NotFound desc = could not find container \"71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703\": container with ID starting with 71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703 not found: ID does not exist" Jun 09 12:43:54.500152 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.500134 2561 scope.go:117] "RemoveContainer" containerID="5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629" Jun 09 12:43:54.500327 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:43:54.500312 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629\": container with ID starting with 5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629 not found: ID does not exist" containerID="5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629" Jun 09 12:43:54.500369 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.500331 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629"} err="failed to get container status \"5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629\": rpc error: code = NotFound desc = could not find container \"5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629\": container with ID starting with 5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629 not found: ID does not exist" Jun 09 12:43:54.500369 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.500343 2561 scope.go:117] "RemoveContainer" containerID="790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11" Jun 09 12:43:54.500535 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:43:54.500520 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11\": container with ID starting with 790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11 not found: ID does not exist" containerID="790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11" Jun 09 12:43:54.500574 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.500539 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11"} err="failed to get container status \"790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11\": rpc error: code = NotFound desc = could not find container \"790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11\": container with ID starting with 790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11 not found: ID does not exist" Jun 09 12:43:54.500574 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.500551 2561 scope.go:117] "RemoveContainer" containerID="8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac" Jun 09 12:43:54.500752 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:43:54.500734 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac\": container with ID starting with 8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac not found: ID does not exist" containerID="8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac" Jun 09 12:43:54.500788 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.500758 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac"} err="failed to get container status \"8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac\": rpc error: code = NotFound desc = could not find container \"8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac\": container with ID starting with 8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac not found: ID does not exist" Jun 09 12:43:54.500788 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.500773 2561 scope.go:117] "RemoveContainer" containerID="f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58" Jun 09 12:43:54.501015 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:43:54.500998 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58\": container with ID starting with f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58 not found: ID does not exist" containerID="f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58" Jun 09 12:43:54.501065 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.501019 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58"} err="failed to get container status \"f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58\": rpc error: code = NotFound desc = could not find container \"f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58\": container with ID starting with f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58 not found: ID does not exist" Jun 09 12:43:54.501065 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.501031 2561 scope.go:117] "RemoveContainer" containerID="1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20" Jun 09 12:43:54.501235 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:43:54.501215 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20\": container with ID starting with 1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20 not found: ID does not exist" containerID="1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20" Jun 09 12:43:54.501298 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.501244 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20"} err="failed to get container status \"1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20\": rpc error: code = NotFound desc = could not find container \"1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20\": container with ID starting with 1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20 not found: ID does not exist" Jun 09 12:43:54.501298 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.501264 2561 scope.go:117] "RemoveContainer" containerID="de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6" Jun 09 12:43:54.501471 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.501454 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6"} err="failed to get container status \"de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6\": rpc error: code = NotFound desc = could not find container \"de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6\": container with ID starting with de477e0885f5917e36cfb9ed80393eb43b2d97ef42a90e332685f3534a12def6 not found: ID does not exist" Jun 09 12:43:54.501521 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.501472 2561 scope.go:117] "RemoveContainer" containerID="71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703" Jun 09 12:43:54.501678 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.501658 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703"} err="failed to get container status \"71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703\": rpc error: code = NotFound desc = could not find container \"71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703\": container with ID starting with 71bef9b1537ee7fb08175b73feed6db668b74458663b088e953a108c49ad3703 not found: ID does not exist" Jun 09 12:43:54.501731 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.501679 2561 scope.go:117] "RemoveContainer" containerID="5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629" Jun 09 12:43:54.501883 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.501867 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629"} err="failed to get container status \"5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629\": rpc error: code = NotFound desc = could not find container \"5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629\": container with ID starting with 5b8dc093ee13ca204509268366d4aa10bccd9d4a7eef21c9dbcf4caca1c67629 not found: ID does not exist" Jun 09 12:43:54.501962 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.501884 2561 scope.go:117] "RemoveContainer" containerID="790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11" Jun 09 12:43:54.502145 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.502126 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11"} err="failed to get container status \"790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11\": rpc error: code = NotFound desc = could not find container \"790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11\": container with ID starting with 790c92669dfec8f679005994e35842997972e6ad1499ed03ecb9a7dffc7c5a11 not found: ID does not exist" Jun 09 12:43:54.502145 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.502144 2561 scope.go:117] "RemoveContainer" containerID="8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac" Jun 09 12:43:54.502341 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.502324 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac"} err="failed to get container status \"8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac\": rpc error: code = NotFound desc = could not find container \"8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac\": container with ID starting with 8ebb101afdbdcf47b3830b74e2cb825e115edc8b4b6a9fe8e2eaf1230aeb39ac not found: ID does not exist" Jun 09 12:43:54.502382 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.502343 2561 scope.go:117] "RemoveContainer" containerID="f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58" Jun 09 12:43:54.502540 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.502523 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58"} err="failed to get container status \"f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58\": rpc error: code = NotFound desc = could not find container \"f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58\": container with ID starting with f9b4a62a5c5cac0b563b8399b3b3c1666fd049d8d6912da1faba15e41b4eef58 not found: ID does not exist" Jun 09 12:43:54.502581 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.502540 2561 scope.go:117] "RemoveContainer" containerID="1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20" Jun 09 12:43:54.502735 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.502719 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20"} err="failed to get container status \"1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20\": rpc error: code = NotFound desc = could not find container \"1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20\": container with ID starting with 1c282d645cd944a0a551139054741ec32e78d7f04826000643e56a3335ffba20 not found: ID does not exist" Jun 09 12:43:54.517031 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517010 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:43:54.517276 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517264 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="prom-label-proxy" Jun 09 12:43:54.517313 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517278 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="prom-label-proxy" Jun 09 12:43:54.517313 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517293 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy-metric" Jun 09 12:43:54.517313 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517299 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy-metric" Jun 09 12:43:54.517313 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517307 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy" Jun 09 12:43:54.517313 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517313 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517320 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy-web" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517325 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy-web" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517332 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="config-reloader" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517337 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="config-reloader" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517345 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" containerName="console" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517350 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" containerName="console" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517355 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="init-config-reloader" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517360 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="init-config-reloader" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517371 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b025e057-c2b4-45b5-859e-fe65fc7e0774" containerName="console" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517376 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b025e057-c2b4-45b5-859e-fe65fc7e0774" containerName="console" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517381 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="alertmanager" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517386 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="alertmanager" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517430 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b025e057-c2b4-45b5-859e-fe65fc7e0774" containerName="console" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517439 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517447 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="alertmanager" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517452 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy-web" Jun 09 12:43:54.517453 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517457 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="prom-label-proxy" Jun 09 12:43:54.517928 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517463 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="config-reloader" Jun 09 12:43:54.517928 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517469 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" containerName="kube-rbac-proxy-metric" Jun 09 12:43:54.517928 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.517474 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7e9d2c-6dcf-4a94-bb40-d264deeac10c" containerName="console" Jun 09 12:43:54.520601 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.520584 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.523781 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.523570 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 12:43:54.523781 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.523569 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 12:43:54.523781 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.523605 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 12:43:54.523781 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.523642 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 12:43:54.523781 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.523674 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 12:43:54.524226 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.524208 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 12:43:54.524310 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.524211 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 12:43:54.524371 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.524323 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 12:43:54.524436 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.524421 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9lk5h\"" Jun 09 12:43:54.528088 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.528071 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 12:43:54.536983 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.536963 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:43:54.627850 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.627808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.627850 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.627860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a28f63b-5744-4f95-87af-878710ab0981-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628060 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.627886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a28f63b-5744-4f95-87af-878710ab0981-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628060 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.627970 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628060 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.628015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-web-config\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628060 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.628046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628180 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.628068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zv22\" (UniqueName: \"kubernetes.io/projected/4a28f63b-5744-4f95-87af-878710ab0981-kube-api-access-4zv22\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628180 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.628096 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628180 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.628114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a28f63b-5744-4f95-87af-878710ab0981-config-out\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628180 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.628136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a28f63b-5744-4f95-87af-878710ab0981-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628180 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.628159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628180 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.628180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a28f63b-5744-4f95-87af-878710ab0981-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.628347 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.628199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729193 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729193 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a28f63b-5744-4f95-87af-878710ab0981-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729193 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729195 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a28f63b-5744-4f95-87af-878710ab0981-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729248 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-web-config\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zv22\" (UniqueName: \"kubernetes.io/projected/4a28f63b-5744-4f95-87af-878710ab0981-kube-api-access-4zv22\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729349 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a28f63b-5744-4f95-87af-878710ab0981-config-out\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a28f63b-5744-4f95-87af-878710ab0981-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729455 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729837 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a28f63b-5744-4f95-87af-878710ab0981-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.729837 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.729503 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.730499 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.730470 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a28f63b-5744-4f95-87af-878710ab0981-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.730618 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.730498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a28f63b-5744-4f95-87af-878710ab0981-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.732406 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.732376 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-web-config\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.732557 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.732457 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.732557 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.732460 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a28f63b-5744-4f95-87af-878710ab0981-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.732685 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.732659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a28f63b-5744-4f95-87af-878710ab0981-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.732732 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.732667 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.733094 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.733066 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a28f63b-5744-4f95-87af-878710ab0981-config-out\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.733195 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.733181 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.733298 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.733279 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.733549 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.733529 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.734614 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.734592 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a28f63b-5744-4f95-87af-878710ab0981-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.739260 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.739240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zv22\" (UniqueName: \"kubernetes.io/projected/4a28f63b-5744-4f95-87af-878710ab0981-kube-api-access-4zv22\") pod \"alertmanager-main-0\" (UID: \"4a28f63b-5744-4f95-87af-878710ab0981\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.831257 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.831226 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:43:54.981943 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:54.980342 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:43:54.984851 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:43:54.984824 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a28f63b_5744_4f95_87af_878710ab0981.slice/crio-cf6d7e185168e6b749b50291cfb60a977c5b3a867ddbee01a4fbc7af965829f9 WatchSource:0}: Error finding container cf6d7e185168e6b749b50291cfb60a977c5b3a867ddbee01a4fbc7af965829f9: Status 404 returned error can't find the container with id cf6d7e185168e6b749b50291cfb60a977c5b3a867ddbee01a4fbc7af965829f9 Jun 09 12:43:55.456086 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:55.456057 2561 generic.go:356] "Generic (PLEG): container finished" podID="4a28f63b-5744-4f95-87af-878710ab0981" containerID="ab85868242273f717c4ea26b96209f533f51abe759ce1012caf0bbbd8fd9893b" exitCode=0 Jun 09 12:43:55.456541 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:55.456149 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a28f63b-5744-4f95-87af-878710ab0981","Type":"ContainerDied","Data":"ab85868242273f717c4ea26b96209f533f51abe759ce1012caf0bbbd8fd9893b"} Jun 09 12:43:55.456541 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:55.456219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a28f63b-5744-4f95-87af-878710ab0981","Type":"ContainerStarted","Data":"cf6d7e185168e6b749b50291cfb60a977c5b3a867ddbee01a4fbc7af965829f9"} Jun 09 12:43:55.662464 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:55.662439 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f5cb904-f0d9-4a98-89fa-79d9a2955685" path="/var/lib/kubelet/pods/9f5cb904-f0d9-4a98-89fa-79d9a2955685/volumes" Jun 09 12:43:56.464096 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.464062 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a28f63b-5744-4f95-87af-878710ab0981","Type":"ContainerStarted","Data":"45fd21e8f3eb50c6f2bfa4d26ef60d9f180e6506beead41675a3242fad20bc56"} Jun 09 12:43:56.464534 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.464129 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a28f63b-5744-4f95-87af-878710ab0981","Type":"ContainerStarted","Data":"eeb22901e0db136d9d2a85ee736a83285a6c475c608b05b8c9107050a11ab328"} Jun 09 12:43:56.464534 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.464155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a28f63b-5744-4f95-87af-878710ab0981","Type":"ContainerStarted","Data":"bb87c95c49cc5ead77a9b0d6055d7e083fe6e26aa095ea22201bbd8fa3324d8c"} Jun 09 12:43:56.464534 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.464178 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a28f63b-5744-4f95-87af-878710ab0981","Type":"ContainerStarted","Data":"315bf5f7e91973630936abc390f5a8448de21749e9b99dc7ee553f3973395f3c"} Jun 09 12:43:56.464534 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.464206 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a28f63b-5744-4f95-87af-878710ab0981","Type":"ContainerStarted","Data":"f95d80c974bab60c01c351b57a8bc34719c159df7ba38e8d3bd43ac98fee55c1"} Jun 09 12:43:56.464534 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.464231 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a28f63b-5744-4f95-87af-878710ab0981","Type":"ContainerStarted","Data":"7796ea4dc40c3cb93652df0c79b5acc8de56e018c716813ac90d0ed00126c822"} Jun 09 12:43:56.496773 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.496716 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.480694684 podStartE2EDuration="2.496694626s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.999942ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:43:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:43:56.494986443 +0000 UTC m=+173.329192708" watchObservedRunningTime="2026-06-09 12:43:56.496694626 +0000 UTC m=+173.330900895" Jun 09 12:43:56.892581 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.892504 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75b7b654cb-f8gf2"] Jun 09 12:43:56.894693 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.894675 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:56.897197 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.897176 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 12:43:56.898158 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.898140 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 12:43:56.898282 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.898263 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 12:43:56.898596 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.898573 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 12:43:56.898687 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.898604 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sw2k8\"" Jun 09 12:43:56.898687 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.898653 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 12:43:56.907833 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.905291 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 12:43:56.910490 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:56.910446 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75b7b654cb-f8gf2"] Jun 09 12:43:57.052192 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.052153 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.052447 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.052406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-secret-telemeter-client\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.052586 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.052572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-serving-certs-ca-bundle\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.052707 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.052693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.052796 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.052785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-telemeter-client-tls\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.052934 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.052920 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jbpz\" (UniqueName: \"kubernetes.io/projected/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-kube-api-access-6jbpz\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.053044 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.053031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-federate-client-tls\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.053127 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.053115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-metrics-client-ca\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.154208 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.154180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-serving-certs-ca-bundle\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.154358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.154219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.154358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.154240 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-telemeter-client-tls\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.154358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.154273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jbpz\" (UniqueName: \"kubernetes.io/projected/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-kube-api-access-6jbpz\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.154358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.154292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-federate-client-tls\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.154358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.154308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-metrics-client-ca\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.154358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.154328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.154358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.154359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-secret-telemeter-client\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.155258 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.155208 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-serving-certs-ca-bundle\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.155393 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.155295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.155463 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.155412 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-metrics-client-ca\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.156935 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.156888 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.157103 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.157082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-federate-client-tls\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.157433 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.157413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-secret-telemeter-client\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.157475 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.157419 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-telemeter-client-tls\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.167997 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.167972 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jbpz\" (UniqueName: \"kubernetes.io/projected/79e5de4a-7f1c-4816-bf5e-a7cdc38da512-kube-api-access-6jbpz\") pod \"telemeter-client-75b7b654cb-f8gf2\" (UID: \"79e5de4a-7f1c-4816-bf5e-a7cdc38da512\") " pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.206040 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.206018 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" Jun 09 12:43:57.360411 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.359596 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75b7b654cb-f8gf2"] Jun 09 12:43:57.361997 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:43:57.361968 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e5de4a_7f1c_4816_bf5e_a7cdc38da512.slice/crio-d391ff19defeb005437eecabaf6fc09384de00120adb35492385d8a6e90b0934 WatchSource:0}: Error finding container d391ff19defeb005437eecabaf6fc09384de00120adb35492385d8a6e90b0934: Status 404 returned error can't find the container with id d391ff19defeb005437eecabaf6fc09384de00120adb35492385d8a6e90b0934 Jun 09 12:43:57.470338 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:57.470255 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" event={"ID":"79e5de4a-7f1c-4816-bf5e-a7cdc38da512","Type":"ContainerStarted","Data":"d391ff19defeb005437eecabaf6fc09384de00120adb35492385d8a6e90b0934"} Jun 09 12:43:59.481612 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:59.481584 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" event={"ID":"79e5de4a-7f1c-4816-bf5e-a7cdc38da512","Type":"ContainerStarted","Data":"236ddcac45180297450fdbc921ccaea916edac085b191d5376f2ae0c17f25704"} Jun 09 12:43:59.481974 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:43:59.481651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" event={"ID":"79e5de4a-7f1c-4816-bf5e-a7cdc38da512","Type":"ContainerStarted","Data":"93b84de6874e8905a853144428e9597309a7882f7bea9c2ac893bffdf5fc5216"} Jun 09 12:44:00.487833 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:00.487799 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" event={"ID":"79e5de4a-7f1c-4816-bf5e-a7cdc38da512","Type":"ContainerStarted","Data":"193c1bbd42b96be8a6b3778882395072b14f8fdc28006f06ac3f7144fb2cfd13"} Jun 09 12:44:00.512555 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:00.512506 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75b7b654cb-f8gf2" podStartSLOduration=2.530274734 podStartE2EDuration="4.512485748s" totalImagesPullingTime="1.982211014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:44:00.512096796 +0000 UTC m=+177.346303061" watchObservedRunningTime="2026-06-09 12:44:00.512485748 +0000 UTC m=+177.346692014" Jun 09 12:44:01.296043 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.296007 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54c9f6fbd9-tjlbg"] Jun 09 12:44:01.298621 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.298593 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.313485 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.313452 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c9f6fbd9-tjlbg"] Jun 09 12:44:01.391689 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.391645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-trusted-ca-bundle\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.391689 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.391695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-config\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.391978 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.391713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-service-ca\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.391978 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.391795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-serving-cert\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.391978 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.391858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-oauth-serving-cert\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.391978 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.391884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwxnk\" (UniqueName: \"kubernetes.io/projected/02703d5c-959c-4bc5-a89c-efe7ea5aac01-kube-api-access-dwxnk\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.391978 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.391934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-oauth-config\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.492494 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.492462 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-trusted-ca-bundle\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.492494 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.492503 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-config\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.493055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.492518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-service-ca\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.493055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.492539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-serving-cert\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.493055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.492570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-oauth-serving-cert\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.493055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.492586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwxnk\" (UniqueName: \"kubernetes.io/projected/02703d5c-959c-4bc5-a89c-efe7ea5aac01-kube-api-access-dwxnk\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.493055 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.492601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-oauth-config\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.493401 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.493376 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-config\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.493460 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.493403 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-service-ca\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.493602 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.493578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-oauth-serving-cert\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.493952 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.493921 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-trusted-ca-bundle\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.495187 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.495159 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-oauth-config\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.495827 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.495803 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-serving-cert\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.502809 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.502786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwxnk\" (UniqueName: \"kubernetes.io/projected/02703d5c-959c-4bc5-a89c-efe7ea5aac01-kube-api-access-dwxnk\") pod \"console-54c9f6fbd9-tjlbg\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.610867 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.610781 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:01.749504 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:01.749439 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c9f6fbd9-tjlbg"] Jun 09 12:44:01.751622 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:44:01.751597 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02703d5c_959c_4bc5_a89c_efe7ea5aac01.slice/crio-2ba31a10a8c9a37550b5b5ddde69eb669a12ae3e090492e01dc16e977b91c6f0 WatchSource:0}: Error finding container 2ba31a10a8c9a37550b5b5ddde69eb669a12ae3e090492e01dc16e977b91c6f0: Status 404 returned error can't find the container with id 2ba31a10a8c9a37550b5b5ddde69eb669a12ae3e090492e01dc16e977b91c6f0 Jun 09 12:44:02.498356 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:02.498324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9f6fbd9-tjlbg" event={"ID":"02703d5c-959c-4bc5-a89c-efe7ea5aac01","Type":"ContainerStarted","Data":"d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e"} Jun 09 12:44:02.498719 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:02.498373 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9f6fbd9-tjlbg" event={"ID":"02703d5c-959c-4bc5-a89c-efe7ea5aac01","Type":"ContainerStarted","Data":"2ba31a10a8c9a37550b5b5ddde69eb669a12ae3e090492e01dc16e977b91c6f0"} Jun 09 12:44:02.519558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:02.519515 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54c9f6fbd9-tjlbg" podStartSLOduration=1.519499353 podStartE2EDuration="1.519499353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:44:02.518268567 +0000 UTC m=+179.352474837" watchObservedRunningTime="2026-06-09 12:44:02.519499353 +0000 UTC m=+179.353705618" Jun 09 12:44:11.611561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:11.611513 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:11.612094 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:11.611591 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:11.616518 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:11.616494 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:12.541905 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:12.541866 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:44:12.642474 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:12.642438 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79bc68947f-fpr4b"] Jun 09 12:44:37.665157 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:37.665120 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79bc68947f-fpr4b" podUID="dc33bffe-b750-466d-871b-8af76fd2b346" containerName="console" containerID="cri-o://32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2" gracePeriod=15 Jun 09 12:44:37.919862 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:37.919809 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:44:38.008179 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008151 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-trusted-ca-bundle\") pod \"dc33bffe-b750-466d-871b-8af76fd2b346\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " Jun 09 12:44:38.008324 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008226 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-serving-cert\") pod \"dc33bffe-b750-466d-871b-8af76fd2b346\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " Jun 09 12:44:38.008324 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008247 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-oauth-config\") pod \"dc33bffe-b750-466d-871b-8af76fd2b346\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " Jun 09 12:44:38.008324 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008278 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp6kh\" (UniqueName: \"kubernetes.io/projected/dc33bffe-b750-466d-871b-8af76fd2b346-kube-api-access-fp6kh\") pod \"dc33bffe-b750-466d-871b-8af76fd2b346\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " Jun 09 12:44:38.008324 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008303 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-service-ca\") pod \"dc33bffe-b750-466d-871b-8af76fd2b346\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " Jun 09 12:44:38.008530 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008468 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-console-config\") pod \"dc33bffe-b750-466d-871b-8af76fd2b346\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " Jun 09 12:44:38.008530 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008517 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-oauth-serving-cert\") pod \"dc33bffe-b750-466d-871b-8af76fd2b346\" (UID: \"dc33bffe-b750-466d-871b-8af76fd2b346\") " Jun 09 12:44:38.008645 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008620 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dc33bffe-b750-466d-871b-8af76fd2b346" (UID: "dc33bffe-b750-466d-871b-8af76fd2b346"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:44:38.008719 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008699 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-service-ca" (OuterVolumeSpecName: "service-ca") pod "dc33bffe-b750-466d-871b-8af76fd2b346" (UID: "dc33bffe-b750-466d-871b-8af76fd2b346"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:44:38.008828 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008799 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-service-ca\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:44:38.008887 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008826 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-trusted-ca-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:44:38.008887 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008768 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-console-config" (OuterVolumeSpecName: "console-config") pod "dc33bffe-b750-466d-871b-8af76fd2b346" (UID: "dc33bffe-b750-466d-871b-8af76fd2b346"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:44:38.009187 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.008924 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dc33bffe-b750-466d-871b-8af76fd2b346" (UID: "dc33bffe-b750-466d-871b-8af76fd2b346"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:44:38.010496 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.010475 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dc33bffe-b750-466d-871b-8af76fd2b346" (UID: "dc33bffe-b750-466d-871b-8af76fd2b346"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:44:38.010969 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.010948 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc33bffe-b750-466d-871b-8af76fd2b346-kube-api-access-fp6kh" (OuterVolumeSpecName: "kube-api-access-fp6kh") pod "dc33bffe-b750-466d-871b-8af76fd2b346" (UID: "dc33bffe-b750-466d-871b-8af76fd2b346"). InnerVolumeSpecName "kube-api-access-fp6kh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:44:38.011031 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.010969 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dc33bffe-b750-466d-871b-8af76fd2b346" (UID: "dc33bffe-b750-466d-871b-8af76fd2b346"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:44:38.110198 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.110171 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp6kh\" (UniqueName: \"kubernetes.io/projected/dc33bffe-b750-466d-871b-8af76fd2b346-kube-api-access-fp6kh\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:44:38.110198 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.110191 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-console-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:44:38.110198 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.110201 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc33bffe-b750-466d-871b-8af76fd2b346-oauth-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:44:38.110372 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.110210 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:44:38.110372 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.110218 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc33bffe-b750-466d-871b-8af76fd2b346-console-oauth-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:44:38.661235 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.661199 2561 generic.go:356] "Generic (PLEG): container finished" podID="dc33bffe-b750-466d-871b-8af76fd2b346" containerID="32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2" exitCode=0 Jun 09 12:44:38.661407 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.661250 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bc68947f-fpr4b" Jun 09 12:44:38.661407 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.661270 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bc68947f-fpr4b" event={"ID":"dc33bffe-b750-466d-871b-8af76fd2b346","Type":"ContainerDied","Data":"32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2"} Jun 09 12:44:38.661407 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.661307 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bc68947f-fpr4b" event={"ID":"dc33bffe-b750-466d-871b-8af76fd2b346","Type":"ContainerDied","Data":"0a46d374e6efc7ab880d7f40375ebbbb004b34667b03b5faaafabc43e1ce8648"} Jun 09 12:44:38.661407 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.661328 2561 scope.go:117] "RemoveContainer" containerID="32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2" Jun 09 12:44:38.669990 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.669743 2561 scope.go:117] "RemoveContainer" containerID="32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2" Jun 09 12:44:38.670208 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:44:38.670023 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2\": container with ID starting with 32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2 not found: ID does not exist" containerID="32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2" Jun 09 12:44:38.670208 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.670044 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2"} err="failed to get container status \"32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2\": rpc error: code = NotFound desc = could not find container \"32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2\": container with ID starting with 32bdc331dcefddfd3b0e63df914b9dc549990f593fc995daddcf0666f61b46d2 not found: ID does not exist" Jun 09 12:44:38.700711 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.700689 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79bc68947f-fpr4b"] Jun 09 12:44:38.717671 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:38.717649 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79bc68947f-fpr4b"] Jun 09 12:44:39.661278 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:44:39.661244 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc33bffe-b750-466d-871b-8af76fd2b346" path="/var/lib/kubelet/pods/dc33bffe-b750-466d-871b-8af76fd2b346/volumes" Jun 09 12:45:18.656475 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.656402 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-847f55bf4f-df7xd"] Jun 09 12:45:18.656909 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.656698 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc33bffe-b750-466d-871b-8af76fd2b346" containerName="console" Jun 09 12:45:18.656909 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.656709 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc33bffe-b750-466d-871b-8af76fd2b346" containerName="console" Jun 09 12:45:18.656909 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.656774 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc33bffe-b750-466d-871b-8af76fd2b346" containerName="console" Jun 09 12:45:18.659515 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.659500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.682186 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.682164 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-847f55bf4f-df7xd"] Jun 09 12:45:18.749469 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.749435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-trusted-ca-bundle\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.749630 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.749552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-oauth-serving-cert\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.749630 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.749601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-config\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.749630 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.749625 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx9mp\" (UniqueName: \"kubernetes.io/projected/b12989fc-0b4a-4ea0-8994-4e46a71d896c-kube-api-access-hx9mp\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.749758 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.749658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-service-ca\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.749758 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.749691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-oauth-config\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.749822 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.749760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-serving-cert\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.850418 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.850386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-config\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.850418 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.850418 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx9mp\" (UniqueName: \"kubernetes.io/projected/b12989fc-0b4a-4ea0-8994-4e46a71d896c-kube-api-access-hx9mp\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.850646 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.850441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-service-ca\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.850646 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.850560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-oauth-config\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.850646 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.850612 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-serving-cert\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.850822 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.850657 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-trusted-ca-bundle\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.850822 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.850745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-oauth-serving-cert\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.851262 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.851231 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-config\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.851378 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.851245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-service-ca\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.851378 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.851366 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-oauth-serving-cert\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.851564 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.851541 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-trusted-ca-bundle\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.852995 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.852967 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-oauth-config\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.853089 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.853073 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-serving-cert\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.861478 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.861455 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx9mp\" (UniqueName: \"kubernetes.io/projected/b12989fc-0b4a-4ea0-8994-4e46a71d896c-kube-api-access-hx9mp\") pod \"console-847f55bf4f-df7xd\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:18.967882 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:18.967768 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:19.105787 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:19.105756 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-847f55bf4f-df7xd"] Jun 09 12:45:19.108681 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:45:19.108645 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12989fc_0b4a_4ea0_8994_4e46a71d896c.slice/crio-8aa421b35bfcb17083bddd298d3480cb7baed40b8f491b42a1849a84384b330a WatchSource:0}: Error finding container 8aa421b35bfcb17083bddd298d3480cb7baed40b8f491b42a1849a84384b330a: Status 404 returned error can't find the container with id 8aa421b35bfcb17083bddd298d3480cb7baed40b8f491b42a1849a84384b330a Jun 09 12:45:19.830129 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:19.830083 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847f55bf4f-df7xd" event={"ID":"b12989fc-0b4a-4ea0-8994-4e46a71d896c","Type":"ContainerStarted","Data":"5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f"} Jun 09 12:45:19.830618 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:19.830175 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847f55bf4f-df7xd" event={"ID":"b12989fc-0b4a-4ea0-8994-4e46a71d896c","Type":"ContainerStarted","Data":"8aa421b35bfcb17083bddd298d3480cb7baed40b8f491b42a1849a84384b330a"} Jun 09 12:45:19.858053 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:19.857999 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-847f55bf4f-df7xd" podStartSLOduration=1.8579837270000001 podStartE2EDuration="1.857983727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:45:19.856888176 +0000 UTC m=+256.691094442" watchObservedRunningTime="2026-06-09 12:45:19.857983727 +0000 UTC m=+256.692189996" Jun 09 12:45:28.968249 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:28.968206 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:28.968755 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:28.968282 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:28.973087 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:28.973070 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:29.878303 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:29.878273 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:45:29.933232 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:29.933196 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c9f6fbd9-tjlbg"] Jun 09 12:45:54.962576 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:54.962509 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54c9f6fbd9-tjlbg" podUID="02703d5c-959c-4bc5-a89c-efe7ea5aac01" containerName="console" containerID="cri-o://d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e" gracePeriod=15 Jun 09 12:45:55.198119 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.198092 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:45:55.256576 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.256502 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-oauth-config\") pod \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " Jun 09 12:45:55.256576 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.256550 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-serving-cert\") pod \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " Jun 09 12:45:55.256771 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.256590 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-config\") pod \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " Jun 09 12:45:55.256771 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.256613 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-oauth-serving-cert\") pod \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " Jun 09 12:45:55.256771 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.256672 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwxnk\" (UniqueName: \"kubernetes.io/projected/02703d5c-959c-4bc5-a89c-efe7ea5aac01-kube-api-access-dwxnk\") pod \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " Jun 09 12:45:55.256771 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.256751 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-trusted-ca-bundle\") pod \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " Jun 09 12:45:55.256998 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.256790 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-service-ca\") pod \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\" (UID: \"02703d5c-959c-4bc5-a89c-efe7ea5aac01\") " Jun 09 12:45:55.257067 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.257003 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-config" (OuterVolumeSpecName: "console-config") pod "02703d5c-959c-4bc5-a89c-efe7ea5aac01" (UID: "02703d5c-959c-4bc5-a89c-efe7ea5aac01"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:45:55.257124 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.257073 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02703d5c-959c-4bc5-a89c-efe7ea5aac01" (UID: "02703d5c-959c-4bc5-a89c-efe7ea5aac01"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:45:55.257317 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.257252 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:45:55.257317 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.257281 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-oauth-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:45:55.257636 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.257370 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-service-ca" (OuterVolumeSpecName: "service-ca") pod "02703d5c-959c-4bc5-a89c-efe7ea5aac01" (UID: "02703d5c-959c-4bc5-a89c-efe7ea5aac01"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:45:55.257636 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.257538 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "02703d5c-959c-4bc5-a89c-efe7ea5aac01" (UID: "02703d5c-959c-4bc5-a89c-efe7ea5aac01"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:45:55.258878 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.258839 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02703d5c-959c-4bc5-a89c-efe7ea5aac01" (UID: "02703d5c-959c-4bc5-a89c-efe7ea5aac01"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:45:55.259011 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.258967 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02703d5c-959c-4bc5-a89c-efe7ea5aac01" (UID: "02703d5c-959c-4bc5-a89c-efe7ea5aac01"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:45:55.259106 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.259078 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02703d5c-959c-4bc5-a89c-efe7ea5aac01-kube-api-access-dwxnk" (OuterVolumeSpecName: "kube-api-access-dwxnk") pod "02703d5c-959c-4bc5-a89c-efe7ea5aac01" (UID: "02703d5c-959c-4bc5-a89c-efe7ea5aac01"). InnerVolumeSpecName "kube-api-access-dwxnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:45:55.358478 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.358441 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-oauth-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:45:55.358478 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.358472 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02703d5c-959c-4bc5-a89c-efe7ea5aac01-console-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:45:55.358478 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.358481 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwxnk\" (UniqueName: \"kubernetes.io/projected/02703d5c-959c-4bc5-a89c-efe7ea5aac01-kube-api-access-dwxnk\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:45:55.358478 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.358490 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-trusted-ca-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:45:55.358748 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.358500 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02703d5c-959c-4bc5-a89c-efe7ea5aac01-service-ca\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:45:55.405307 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.405276 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm"] Jun 09 12:45:55.405595 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.405583 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02703d5c-959c-4bc5-a89c-efe7ea5aac01" containerName="console" Jun 09 12:45:55.405635 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.405596 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02703d5c-959c-4bc5-a89c-efe7ea5aac01" containerName="console" Jun 09 12:45:55.405669 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.405652 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02703d5c-959c-4bc5-a89c-efe7ea5aac01" containerName="console" Jun 09 12:45:55.408947 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.408932 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.411552 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.411535 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:45:55.411789 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.411775 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:45:55.411884 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.411858 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dbrkp\"" Jun 09 12:45:55.419601 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.419580 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm"] Jun 09 12:45:55.459245 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.459215 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.459245 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.459245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvbx4\" (UniqueName: \"kubernetes.io/projected/ab180fa6-d4ae-4b74-a75f-16c5210c4463-kube-api-access-wvbx4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.459438 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.459269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.560558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.560492 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.560558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.560522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvbx4\" (UniqueName: \"kubernetes.io/projected/ab180fa6-d4ae-4b74-a75f-16c5210c4463-kube-api-access-wvbx4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.560558 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.560546 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.560857 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.560831 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.560958 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.560939 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.572475 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.572449 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvbx4\" (UniqueName: \"kubernetes.io/projected/ab180fa6-d4ae-4b74-a75f-16c5210c4463-kube-api-access-wvbx4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.717930 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.717874 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:45:55.854462 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.854380 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm"] Jun 09 12:45:55.858290 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:45:55.858263 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab180fa6_d4ae_4b74_a75f_16c5210c4463.slice/crio-d86b940e38aaf5588ab251bdd39bf20bfbb704bbc4cec5a1d095d3e7a68ea492 WatchSource:0}: Error finding container d86b940e38aaf5588ab251bdd39bf20bfbb704bbc4cec5a1d095d3e7a68ea492: Status 404 returned error can't find the container with id d86b940e38aaf5588ab251bdd39bf20bfbb704bbc4cec5a1d095d3e7a68ea492 Jun 09 12:45:55.980695 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.980669 2561 generic.go:356] "Generic (PLEG): container finished" podID="02703d5c-959c-4bc5-a89c-efe7ea5aac01" containerID="d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e" exitCode=0 Jun 09 12:45:55.981144 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.980724 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9f6fbd9-tjlbg" Jun 09 12:45:55.981144 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.980751 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9f6fbd9-tjlbg" event={"ID":"02703d5c-959c-4bc5-a89c-efe7ea5aac01","Type":"ContainerDied","Data":"d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e"} Jun 09 12:45:55.981144 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.980809 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9f6fbd9-tjlbg" event={"ID":"02703d5c-959c-4bc5-a89c-efe7ea5aac01","Type":"ContainerDied","Data":"2ba31a10a8c9a37550b5b5ddde69eb669a12ae3e090492e01dc16e977b91c6f0"} Jun 09 12:45:55.981144 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.980840 2561 scope.go:117] "RemoveContainer" containerID="d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e" Jun 09 12:45:55.982162 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.982024 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" event={"ID":"ab180fa6-d4ae-4b74-a75f-16c5210c4463","Type":"ContainerStarted","Data":"d86b940e38aaf5588ab251bdd39bf20bfbb704bbc4cec5a1d095d3e7a68ea492"} Jun 09 12:45:55.988746 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.988726 2561 scope.go:117] "RemoveContainer" containerID="d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e" Jun 09 12:45:55.989011 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:45:55.988993 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e\": container with ID starting with d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e not found: ID does not exist" containerID="d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e" Jun 09 12:45:55.989080 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:55.989023 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e"} err="failed to get container status \"d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e\": rpc error: code = NotFound desc = could not find container \"d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e\": container with ID starting with d5664dc1008518d80bb49a21421baed1f3d477a3529a1afa559bfc92b9b1fd4e not found: ID does not exist" Jun 09 12:45:56.010749 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:56.010727 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c9f6fbd9-tjlbg"] Jun 09 12:45:56.015314 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:56.015295 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54c9f6fbd9-tjlbg"] Jun 09 12:45:57.660650 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:45:57.660617 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02703d5c-959c-4bc5-a89c-efe7ea5aac01" path="/var/lib/kubelet/pods/02703d5c-959c-4bc5-a89c-efe7ea5aac01/volumes" Jun 09 12:46:04.907666 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:04.907640 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9t7r9_06b10c0b-e96e-4be9-929a-247411e5eec3/ovn-acl-logging/0.log" Jun 09 12:46:04.908500 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:04.908484 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9t7r9_06b10c0b-e96e-4be9-929a-247411e5eec3/ovn-acl-logging/0.log" Jun 09 12:46:04.915191 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:04.915173 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 12:46:05.023040 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:05.023010 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" event={"ID":"ab180fa6-d4ae-4b74-a75f-16c5210c4463","Type":"ContainerStarted","Data":"3e79b37a44fe3d99d0768ec585f3476e844244b670617899e1f0248bdbbcb6e6"} Jun 09 12:46:06.027955 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:06.027920 2561 generic.go:356] "Generic (PLEG): container finished" podID="ab180fa6-d4ae-4b74-a75f-16c5210c4463" containerID="3e79b37a44fe3d99d0768ec585f3476e844244b670617899e1f0248bdbbcb6e6" exitCode=0 Jun 09 12:46:06.028374 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:06.027986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" event={"ID":"ab180fa6-d4ae-4b74-a75f-16c5210c4463","Type":"ContainerDied","Data":"3e79b37a44fe3d99d0768ec585f3476e844244b670617899e1f0248bdbbcb6e6"} Jun 09 12:46:06.028956 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:06.028941 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:46:09.042527 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:09.042488 2561 generic.go:356] "Generic (PLEG): container finished" podID="ab180fa6-d4ae-4b74-a75f-16c5210c4463" containerID="a2b3bf5ed574a1f84b7c3a26c1a0da7a4059c0fdc6d909d6a413de34fd041d99" exitCode=0 Jun 09 12:46:09.042962 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:09.042562 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" event={"ID":"ab180fa6-d4ae-4b74-a75f-16c5210c4463","Type":"ContainerDied","Data":"a2b3bf5ed574a1f84b7c3a26c1a0da7a4059c0fdc6d909d6a413de34fd041d99"} Jun 09 12:46:18.084727 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:18.084690 2561 generic.go:356] "Generic (PLEG): container finished" podID="ab180fa6-d4ae-4b74-a75f-16c5210c4463" containerID="02565652dfb4e73b98e756a68f676d23abe6be3ebf591ec4a36634ff3c3831aa" exitCode=0 Jun 09 12:46:18.085156 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:18.084777 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" event={"ID":"ab180fa6-d4ae-4b74-a75f-16c5210c4463","Type":"ContainerDied","Data":"02565652dfb4e73b98e756a68f676d23abe6be3ebf591ec4a36634ff3c3831aa"} Jun 09 12:46:19.227772 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:19.227741 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:46:19.368844 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:19.368763 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-util\") pod \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " Jun 09 12:46:19.368844 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:19.368805 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvbx4\" (UniqueName: \"kubernetes.io/projected/ab180fa6-d4ae-4b74-a75f-16c5210c4463-kube-api-access-wvbx4\") pod \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " Jun 09 12:46:19.368844 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:19.368831 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-bundle\") pod \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\" (UID: \"ab180fa6-d4ae-4b74-a75f-16c5210c4463\") " Jun 09 12:46:19.369481 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:19.369411 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-bundle" (OuterVolumeSpecName: "bundle") pod "ab180fa6-d4ae-4b74-a75f-16c5210c4463" (UID: "ab180fa6-d4ae-4b74-a75f-16c5210c4463"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:46:19.371145 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:19.371114 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab180fa6-d4ae-4b74-a75f-16c5210c4463-kube-api-access-wvbx4" (OuterVolumeSpecName: "kube-api-access-wvbx4") pod "ab180fa6-d4ae-4b74-a75f-16c5210c4463" (UID: "ab180fa6-d4ae-4b74-a75f-16c5210c4463"). InnerVolumeSpecName "kube-api-access-wvbx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:46:19.373396 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:19.373376 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-util" (OuterVolumeSpecName: "util") pod "ab180fa6-d4ae-4b74-a75f-16c5210c4463" (UID: "ab180fa6-d4ae-4b74-a75f-16c5210c4463"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:46:19.469710 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:19.469672 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:46:19.469710 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:19.469704 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvbx4\" (UniqueName: \"kubernetes.io/projected/ab180fa6-d4ae-4b74-a75f-16c5210c4463-kube-api-access-wvbx4\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:46:19.469710 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:19.469714 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab180fa6-d4ae-4b74-a75f-16c5210c4463-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:46:20.094720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:20.094640 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" Jun 09 12:46:20.094720 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:20.094659 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8szbm" event={"ID":"ab180fa6-d4ae-4b74-a75f-16c5210c4463","Type":"ContainerDied","Data":"d86b940e38aaf5588ab251bdd39bf20bfbb704bbc4cec5a1d095d3e7a68ea492"} Jun 09 12:46:20.094933 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:20.094723 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d86b940e38aaf5588ab251bdd39bf20bfbb704bbc4cec5a1d095d3e7a68ea492" Jun 09 12:46:24.024244 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.024212 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr"] Jun 09 12:46:24.024617 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.024516 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab180fa6-d4ae-4b74-a75f-16c5210c4463" containerName="pull" Jun 09 12:46:24.024617 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.024526 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab180fa6-d4ae-4b74-a75f-16c5210c4463" containerName="pull" Jun 09 12:46:24.024617 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.024543 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab180fa6-d4ae-4b74-a75f-16c5210c4463" containerName="extract" Jun 09 12:46:24.024617 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.024549 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab180fa6-d4ae-4b74-a75f-16c5210c4463" containerName="extract" Jun 09 12:46:24.024617 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.024563 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab180fa6-d4ae-4b74-a75f-16c5210c4463" containerName="util" Jun 09 12:46:24.024617 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.024569 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab180fa6-d4ae-4b74-a75f-16c5210c4463" containerName="util" Jun 09 12:46:24.024617 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.024618 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab180fa6-d4ae-4b74-a75f-16c5210c4463" containerName="extract" Jun 09 12:46:24.026371 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.026355 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" Jun 09 12:46:24.029537 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.029503 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:46:24.029537 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.029529 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-trjzj\"" Jun 09 12:46:24.029719 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.029503 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 12:46:24.049635 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.049613 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr"] Jun 09 12:46:24.107048 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.107018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2dvx\" (UniqueName: \"kubernetes.io/projected/11282be7-3ef4-4666-a2fc-3fba614d02a8-kube-api-access-h2dvx\") pod \"cert-manager-operator-controller-manager-57757f7cfc-btmrr\" (UID: \"11282be7-3ef4-4666-a2fc-3fba614d02a8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" Jun 09 12:46:24.107209 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.107066 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11282be7-3ef4-4666-a2fc-3fba614d02a8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-btmrr\" (UID: \"11282be7-3ef4-4666-a2fc-3fba614d02a8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" Jun 09 12:46:24.207842 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.207800 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2dvx\" (UniqueName: \"kubernetes.io/projected/11282be7-3ef4-4666-a2fc-3fba614d02a8-kube-api-access-h2dvx\") pod \"cert-manager-operator-controller-manager-57757f7cfc-btmrr\" (UID: \"11282be7-3ef4-4666-a2fc-3fba614d02a8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" Jun 09 12:46:24.208070 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.207856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11282be7-3ef4-4666-a2fc-3fba614d02a8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-btmrr\" (UID: \"11282be7-3ef4-4666-a2fc-3fba614d02a8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" Jun 09 12:46:24.208308 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.208290 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11282be7-3ef4-4666-a2fc-3fba614d02a8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-btmrr\" (UID: \"11282be7-3ef4-4666-a2fc-3fba614d02a8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" Jun 09 12:46:24.240513 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.240482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2dvx\" (UniqueName: \"kubernetes.io/projected/11282be7-3ef4-4666-a2fc-3fba614d02a8-kube-api-access-h2dvx\") pod \"cert-manager-operator-controller-manager-57757f7cfc-btmrr\" (UID: \"11282be7-3ef4-4666-a2fc-3fba614d02a8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" Jun 09 12:46:24.335842 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.335763 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" Jun 09 12:46:24.480385 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:24.480291 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr"] Jun 09 12:46:24.482588 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:46:24.482562 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11282be7_3ef4_4666_a2fc_3fba614d02a8.slice/crio-0e1052922353d1deed49ad67a881861cdc65c67fe7e209ea14cce51661790e47 WatchSource:0}: Error finding container 0e1052922353d1deed49ad67a881861cdc65c67fe7e209ea14cce51661790e47: Status 404 returned error can't find the container with id 0e1052922353d1deed49ad67a881861cdc65c67fe7e209ea14cce51661790e47 Jun 09 12:46:25.120547 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:25.120512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" event={"ID":"11282be7-3ef4-4666-a2fc-3fba614d02a8","Type":"ContainerStarted","Data":"0e1052922353d1deed49ad67a881861cdc65c67fe7e209ea14cce51661790e47"} Jun 09 12:46:27.130974 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:27.130930 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" event={"ID":"11282be7-3ef4-4666-a2fc-3fba614d02a8","Type":"ContainerStarted","Data":"eb1d884e5e5454ca52f0cb6dbbfdf771a8da3cc2287ee6581bd2ab4249d119a2"} Jun 09 12:46:27.180578 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:27.180524 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-btmrr" podStartSLOduration=2.552894148 podStartE2EDuration="4.18050964s" totalImagesPullingTime="1.627615492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:46:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:46:27.177656416 +0000 UTC m=+324.011862682" watchObservedRunningTime="2026-06-09 12:46:27.18050964 +0000 UTC m=+324.014715905" Jun 09 12:46:29.655916 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.655863 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-b26x9"] Jun 09 12:46:29.657975 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.657955 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" Jun 09 12:46:29.660344 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.660325 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 12:46:29.661482 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.661462 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xvfhc\"" Jun 09 12:46:29.661585 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.661470 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 12:46:29.681743 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.681714 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-b26x9"] Jun 09 12:46:29.754495 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.754455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/061cbd1e-a94c-417f-82f7-ea133b0d8bbf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-b26x9\" (UID: \"061cbd1e-a94c-417f-82f7-ea133b0d8bbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" Jun 09 12:46:29.755021 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.754578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7stt\" (UniqueName: \"kubernetes.io/projected/061cbd1e-a94c-417f-82f7-ea133b0d8bbf-kube-api-access-k7stt\") pod \"cert-manager-webhook-7dc76cbb94-b26x9\" (UID: \"061cbd1e-a94c-417f-82f7-ea133b0d8bbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" Jun 09 12:46:29.856031 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.855986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/061cbd1e-a94c-417f-82f7-ea133b0d8bbf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-b26x9\" (UID: \"061cbd1e-a94c-417f-82f7-ea133b0d8bbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" Jun 09 12:46:29.856183 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.856093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7stt\" (UniqueName: \"kubernetes.io/projected/061cbd1e-a94c-417f-82f7-ea133b0d8bbf-kube-api-access-k7stt\") pod \"cert-manager-webhook-7dc76cbb94-b26x9\" (UID: \"061cbd1e-a94c-417f-82f7-ea133b0d8bbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" Jun 09 12:46:29.876257 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.876227 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7stt\" (UniqueName: \"kubernetes.io/projected/061cbd1e-a94c-417f-82f7-ea133b0d8bbf-kube-api-access-k7stt\") pod \"cert-manager-webhook-7dc76cbb94-b26x9\" (UID: \"061cbd1e-a94c-417f-82f7-ea133b0d8bbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" Jun 09 12:46:29.877081 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.877054 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/061cbd1e-a94c-417f-82f7-ea133b0d8bbf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-b26x9\" (UID: \"061cbd1e-a94c-417f-82f7-ea133b0d8bbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" Jun 09 12:46:29.978828 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:29.978749 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" Jun 09 12:46:30.117589 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:30.117561 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-b26x9"] Jun 09 12:46:30.119443 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:46:30.119418 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod061cbd1e_a94c_417f_82f7_ea133b0d8bbf.slice/crio-e6597bffe5553955d2d4727840bbfde6b1f4c1af35c4df561fef7c0843df9fad WatchSource:0}: Error finding container e6597bffe5553955d2d4727840bbfde6b1f4c1af35c4df561fef7c0843df9fad: Status 404 returned error can't find the container with id e6597bffe5553955d2d4727840bbfde6b1f4c1af35c4df561fef7c0843df9fad Jun 09 12:46:30.145309 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:30.145277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" event={"ID":"061cbd1e-a94c-417f-82f7-ea133b0d8bbf","Type":"ContainerStarted","Data":"e6597bffe5553955d2d4727840bbfde6b1f4c1af35c4df561fef7c0843df9fad"} Jun 09 12:46:33.160684 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:33.160645 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" event={"ID":"061cbd1e-a94c-417f-82f7-ea133b0d8bbf","Type":"ContainerStarted","Data":"7fbee2985683ad8623c1ddcdc8a0bb426b90293af68c55df38e2219c85c8ed97"} Jun 09 12:46:33.161155 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:33.160768 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" Jun 09 12:46:33.192110 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:33.192021 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" podStartSLOduration=1.348074692 podStartE2EDuration="4.192003589s" totalImagesPullingTime="2.843928897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:46:33.191136879 +0000 UTC m=+330.025343144" watchObservedRunningTime="2026-06-09 12:46:33.192003589 +0000 UTC m=+330.026209857" Jun 09 12:46:39.166628 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:39.166595 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b26x9" Jun 09 12:46:47.975371 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:47.975294 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-lvqbm"] Jun 09 12:46:47.990098 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:47.990070 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-lvqbm"] Jun 09 12:46:47.990238 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:47.990178 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-lvqbm" Jun 09 12:46:47.992943 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:47.992918 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v9h67\"" Jun 09 12:46:48.008080 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:48.008051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/558f4865-aa89-4785-8d63-9c7e32559be2-bound-sa-token\") pod \"cert-manager-59c77684cc-lvqbm\" (UID: \"558f4865-aa89-4785-8d63-9c7e32559be2\") " pod="cert-manager/cert-manager-59c77684cc-lvqbm" Jun 09 12:46:48.008186 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:48.008086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkkwv\" (UniqueName: \"kubernetes.io/projected/558f4865-aa89-4785-8d63-9c7e32559be2-kube-api-access-jkkwv\") pod \"cert-manager-59c77684cc-lvqbm\" (UID: \"558f4865-aa89-4785-8d63-9c7e32559be2\") " pod="cert-manager/cert-manager-59c77684cc-lvqbm" Jun 09 12:46:48.108866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:48.108832 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/558f4865-aa89-4785-8d63-9c7e32559be2-bound-sa-token\") pod \"cert-manager-59c77684cc-lvqbm\" (UID: \"558f4865-aa89-4785-8d63-9c7e32559be2\") " pod="cert-manager/cert-manager-59c77684cc-lvqbm" Jun 09 12:46:48.108866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:48.108873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkkwv\" (UniqueName: \"kubernetes.io/projected/558f4865-aa89-4785-8d63-9c7e32559be2-kube-api-access-jkkwv\") pod \"cert-manager-59c77684cc-lvqbm\" (UID: \"558f4865-aa89-4785-8d63-9c7e32559be2\") " pod="cert-manager/cert-manager-59c77684cc-lvqbm" Jun 09 12:46:48.120219 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:48.120189 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/558f4865-aa89-4785-8d63-9c7e32559be2-bound-sa-token\") pod \"cert-manager-59c77684cc-lvqbm\" (UID: \"558f4865-aa89-4785-8d63-9c7e32559be2\") " pod="cert-manager/cert-manager-59c77684cc-lvqbm" Jun 09 12:46:48.120688 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:48.120670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkkwv\" (UniqueName: \"kubernetes.io/projected/558f4865-aa89-4785-8d63-9c7e32559be2-kube-api-access-jkkwv\") pod \"cert-manager-59c77684cc-lvqbm\" (UID: \"558f4865-aa89-4785-8d63-9c7e32559be2\") " pod="cert-manager/cert-manager-59c77684cc-lvqbm" Jun 09 12:46:48.299651 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:48.299563 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-lvqbm" Jun 09 12:46:48.442554 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:48.442503 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-lvqbm"] Jun 09 12:46:48.444630 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:46:48.444596 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod558f4865_aa89_4785_8d63_9c7e32559be2.slice/crio-a6535a9b1f07a1de77c9c1510d8f1d32acf35c3d87e32caf7196613cb9e47204 WatchSource:0}: Error finding container a6535a9b1f07a1de77c9c1510d8f1d32acf35c3d87e32caf7196613cb9e47204: Status 404 returned error can't find the container with id a6535a9b1f07a1de77c9c1510d8f1d32acf35c3d87e32caf7196613cb9e47204 Jun 09 12:46:49.232261 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:49.232226 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-lvqbm" event={"ID":"558f4865-aa89-4785-8d63-9c7e32559be2","Type":"ContainerStarted","Data":"05a8779af77da8451c41df412f10501b1415a9ade60eda46189b56054aee0ea1"} Jun 09 12:46:49.232261 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:49.232265 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-lvqbm" event={"ID":"558f4865-aa89-4785-8d63-9c7e32559be2","Type":"ContainerStarted","Data":"a6535a9b1f07a1de77c9c1510d8f1d32acf35c3d87e32caf7196613cb9e47204"} Jun 09 12:46:49.252333 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:46:49.252288 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-lvqbm" podStartSLOduration=2.252275433 podStartE2EDuration="2.252275433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:46:49.251122736 +0000 UTC m=+346.085329006" watchObservedRunningTime="2026-06-09 12:46:49.252275433 +0000 UTC m=+346.086481699" Jun 09 12:47:00.230076 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.230029 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql"] Jun 09 12:47:00.235164 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.235142 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.238524 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.238497 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dbrkp\"" Jun 09 12:47:00.238614 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.238524 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:47:00.239245 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.239229 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:47:00.246776 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.246739 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql"] Jun 09 12:47:00.321429 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.321388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.321605 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.321445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4xf7\" (UniqueName: \"kubernetes.io/projected/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-kube-api-access-q4xf7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.321605 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.321499 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.422768 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.422731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.422993 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.422823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.422993 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.422886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4xf7\" (UniqueName: \"kubernetes.io/projected/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-kube-api-access-q4xf7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.423182 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.423161 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.423244 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.423188 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.434923 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.434870 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4xf7\" (UniqueName: \"kubernetes.io/projected/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-kube-api-access-q4xf7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.547805 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.547717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:00.695847 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:00.695815 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql"] Jun 09 12:47:00.699075 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:47:00.699041 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9dfa51d_8e0c_47ff_aa09_7e7d20b6f28a.slice/crio-bca27e54968433deca9443b1670b404fe9908069d13c3dc84594fb6477d9712a WatchSource:0}: Error finding container bca27e54968433deca9443b1670b404fe9908069d13c3dc84594fb6477d9712a: Status 404 returned error can't find the container with id bca27e54968433deca9443b1670b404fe9908069d13c3dc84594fb6477d9712a Jun 09 12:47:01.289764 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:01.289729 2561 generic.go:356] "Generic (PLEG): container finished" podID="f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" containerID="d78dee92dd7225bb320e33dbfbc036b92bbc45abd16e0376fcba7db3c4a868ec" exitCode=0 Jun 09 12:47:01.290193 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:01.289820 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" event={"ID":"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a","Type":"ContainerDied","Data":"d78dee92dd7225bb320e33dbfbc036b92bbc45abd16e0376fcba7db3c4a868ec"} Jun 09 12:47:01.290193 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:01.289874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" event={"ID":"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a","Type":"ContainerStarted","Data":"bca27e54968433deca9443b1670b404fe9908069d13c3dc84594fb6477d9712a"} Jun 09 12:47:02.297295 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:02.297258 2561 generic.go:356] "Generic (PLEG): container finished" podID="f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" containerID="fc84f5b1712c65334373a19c0c289f62e94aa31be1c74401e1836751d3c36994" exitCode=0 Jun 09 12:47:02.297295 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:02.297302 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" event={"ID":"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a","Type":"ContainerDied","Data":"fc84f5b1712c65334373a19c0c289f62e94aa31be1c74401e1836751d3c36994"} Jun 09 12:47:03.303426 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:03.303387 2561 generic.go:356] "Generic (PLEG): container finished" podID="f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" containerID="b6fba3b450a1459e3716d433f5f4b03f7781eb2d256c7eb44c3eb06dd6f74119" exitCode=0 Jun 09 12:47:03.303801 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:03.303474 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" event={"ID":"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a","Type":"ContainerDied","Data":"b6fba3b450a1459e3716d433f5f4b03f7781eb2d256c7eb44c3eb06dd6f74119"} Jun 09 12:47:04.434824 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:04.434800 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:04.561414 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:04.561332 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-util\") pod \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " Jun 09 12:47:04.561414 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:04.561373 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-bundle\") pod \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " Jun 09 12:47:04.561414 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:04.561400 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4xf7\" (UniqueName: \"kubernetes.io/projected/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-kube-api-access-q4xf7\") pod \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\" (UID: \"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a\") " Jun 09 12:47:04.562045 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:04.562016 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-bundle" (OuterVolumeSpecName: "bundle") pod "f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" (UID: "f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:47:04.563482 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:04.563452 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-kube-api-access-q4xf7" (OuterVolumeSpecName: "kube-api-access-q4xf7") pod "f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" (UID: "f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a"). InnerVolumeSpecName "kube-api-access-q4xf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:47:04.568990 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:04.568950 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-util" (OuterVolumeSpecName: "util") pod "f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" (UID: "f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:47:04.661953 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:04.661909 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4xf7\" (UniqueName: \"kubernetes.io/projected/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-kube-api-access-q4xf7\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:47:04.661953 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:04.661942 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:47:04.661953 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:04.661953 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:47:05.314113 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:05.314081 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" Jun 09 12:47:05.314113 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:05.314096 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmqsql" event={"ID":"f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a","Type":"ContainerDied","Data":"bca27e54968433deca9443b1670b404fe9908069d13c3dc84594fb6477d9712a"} Jun 09 12:47:05.314330 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:05.314136 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bca27e54968433deca9443b1670b404fe9908069d13c3dc84594fb6477d9712a" Jun 09 12:47:14.529787 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.529753 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx"] Jun 09 12:47:14.530276 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.530096 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" containerName="util" Jun 09 12:47:14.530276 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.530109 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" containerName="util" Jun 09 12:47:14.530276 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.530131 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" containerName="pull" Jun 09 12:47:14.530276 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.530136 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" containerName="pull" Jun 09 12:47:14.530276 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.530142 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" containerName="extract" Jun 09 12:47:14.530276 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.530148 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" containerName="extract" Jun 09 12:47:14.530276 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.530200 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9dfa51d-8e0c-47ff-aa09-7e7d20b6f28a" containerName="extract" Jun 09 12:47:14.534518 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.534487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.537081 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.537059 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 12:47:14.538346 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.538328 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 12:47:14.538435 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.538363 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-448xf\"" Jun 09 12:47:14.539568 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.539552 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 12:47:14.539656 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.539571 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 12:47:14.574957 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.574934 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx"] Jun 09 12:47:14.650802 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.650761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.650802 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.650800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67gws\" (UniqueName: \"kubernetes.io/projected/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-kube-api-access-67gws\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.651046 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.650924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-manifests\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.651046 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.651033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-webhook-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.651116 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.651067 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-tmp\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.751618 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.751580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-webhook-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.751618 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.751622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-tmp\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.751838 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.751646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.751838 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.751662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67gws\" (UniqueName: \"kubernetes.io/projected/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-kube-api-access-67gws\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.751838 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.751700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-manifests\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.752174 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.752148 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-manifests\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.754175 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.754152 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-tmp\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.754291 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.754230 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.754352 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.754315 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-webhook-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.768141 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.768118 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67gws\" (UniqueName: \"kubernetes.io/projected/c895a74d-9e5a-4a28-909a-35bdcfb2fccf-kube-api-access-67gws\") pod \"opendatahub-operator-controller-manager-54544cfb76-kf5sx\" (UID: \"c895a74d-9e5a-4a28-909a-35bdcfb2fccf\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:14.844264 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:14.844176 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:15.017675 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:15.017650 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx"] Jun 09 12:47:15.019888 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:47:15.019864 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc895a74d_9e5a_4a28_909a_35bdcfb2fccf.slice/crio-4e6eb54a70910ec97ccd1b1f44a09c6da2d1fc5d195e2d04fa53c7090456ef45 WatchSource:0}: Error finding container 4e6eb54a70910ec97ccd1b1f44a09c6da2d1fc5d195e2d04fa53c7090456ef45: Status 404 returned error can't find the container with id 4e6eb54a70910ec97ccd1b1f44a09c6da2d1fc5d195e2d04fa53c7090456ef45 Jun 09 12:47:15.358328 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:15.358294 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" event={"ID":"c895a74d-9e5a-4a28-909a-35bdcfb2fccf","Type":"ContainerStarted","Data":"4e6eb54a70910ec97ccd1b1f44a09c6da2d1fc5d195e2d04fa53c7090456ef45"} Jun 09 12:47:18.377544 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:18.377504 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" event={"ID":"c895a74d-9e5a-4a28-909a-35bdcfb2fccf","Type":"ContainerStarted","Data":"4171c2ec9f4d6b2d2d46850d075291d9a38c7442290182e57a246b99f89226d8"} Jun 09 12:47:19.383829 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:19.383797 2561 generic.go:356] "Generic (PLEG): container finished" podID="c895a74d-9e5a-4a28-909a-35bdcfb2fccf" containerID="4171c2ec9f4d6b2d2d46850d075291d9a38c7442290182e57a246b99f89226d8" exitCode=0 Jun 09 12:47:19.384291 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:19.383885 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" event={"ID":"c895a74d-9e5a-4a28-909a-35bdcfb2fccf","Type":"ContainerDied","Data":"4171c2ec9f4d6b2d2d46850d075291d9a38c7442290182e57a246b99f89226d8"} Jun 09 12:47:20.390330 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:20.390301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" event={"ID":"c895a74d-9e5a-4a28-909a-35bdcfb2fccf","Type":"ContainerStarted","Data":"40d9920e6701daee4f06c33d19c46e937d8dff8f0177dceafc3a5d0b27d84571"} Jun 09 12:47:20.390722 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:20.390411 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:20.434922 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:20.434846 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" podStartSLOduration=2.313541462 podStartE2EDuration="6.434830328s" totalImagesPullingTime="3.138494956s" totalInitContainerRuntime="982.79391ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:20.429871415 +0000 UTC m=+377.264077684" watchObservedRunningTime="2026-06-09 12:47:20.434830328 +0000 UTC m=+377.269036631" Jun 09 12:47:31.396970 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:31.396940 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-kf5sx" Jun 09 12:47:34.621287 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.621252 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5"] Jun 09 12:47:34.632392 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.632364 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:34.635785 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.635761 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 12:47:34.636164 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.636137 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 12:47:34.637299 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.637283 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5w7qh\"" Jun 09 12:47:34.651044 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.651021 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5"] Jun 09 12:47:34.714305 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.714276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5b1a282-6765-4e19-a38f-0bdbeec908e1-tmp\") pod \"kube-auth-proxy-7ccb5f5468-m2qp5\" (UID: \"e5b1a282-6765-4e19-a38f-0bdbeec908e1\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:34.714478 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.714330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b1a282-6765-4e19-a38f-0bdbeec908e1-tls-certs\") pod \"kube-auth-proxy-7ccb5f5468-m2qp5\" (UID: \"e5b1a282-6765-4e19-a38f-0bdbeec908e1\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:34.714478 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.714348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmcmt\" (UniqueName: \"kubernetes.io/projected/e5b1a282-6765-4e19-a38f-0bdbeec908e1-kube-api-access-hmcmt\") pod \"kube-auth-proxy-7ccb5f5468-m2qp5\" (UID: \"e5b1a282-6765-4e19-a38f-0bdbeec908e1\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:34.814767 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.814725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5b1a282-6765-4e19-a38f-0bdbeec908e1-tmp\") pod \"kube-auth-proxy-7ccb5f5468-m2qp5\" (UID: \"e5b1a282-6765-4e19-a38f-0bdbeec908e1\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:34.814966 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.814800 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b1a282-6765-4e19-a38f-0bdbeec908e1-tls-certs\") pod \"kube-auth-proxy-7ccb5f5468-m2qp5\" (UID: \"e5b1a282-6765-4e19-a38f-0bdbeec908e1\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:34.814966 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.814822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcmt\" (UniqueName: \"kubernetes.io/projected/e5b1a282-6765-4e19-a38f-0bdbeec908e1-kube-api-access-hmcmt\") pod \"kube-auth-proxy-7ccb5f5468-m2qp5\" (UID: \"e5b1a282-6765-4e19-a38f-0bdbeec908e1\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:34.815065 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:47:34.814967 2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 09 12:47:34.815110 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:47:34.815065 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b1a282-6765-4e19-a38f-0bdbeec908e1-tls-certs podName:e5b1a282-6765-4e19-a38f-0bdbeec908e1 nodeName:}" failed. No retries permitted until 2026-06-09 12:47:35.31504288 +0000 UTC m=+392.149249142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e5b1a282-6765-4e19-a38f-0bdbeec908e1-tls-certs") pod "kube-auth-proxy-7ccb5f5468-m2qp5" (UID: "e5b1a282-6765-4e19-a38f-0bdbeec908e1") : secret "kube-auth-proxy-tls" not found Jun 09 12:47:34.817152 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.817121 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5b1a282-6765-4e19-a38f-0bdbeec908e1-tmp\") pod \"kube-auth-proxy-7ccb5f5468-m2qp5\" (UID: \"e5b1a282-6765-4e19-a38f-0bdbeec908e1\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:34.859342 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:34.859318 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmcmt\" (UniqueName: \"kubernetes.io/projected/e5b1a282-6765-4e19-a38f-0bdbeec908e1-kube-api-access-hmcmt\") pod \"kube-auth-proxy-7ccb5f5468-m2qp5\" (UID: \"e5b1a282-6765-4e19-a38f-0bdbeec908e1\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:35.319443 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:35.319410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b1a282-6765-4e19-a38f-0bdbeec908e1-tls-certs\") pod \"kube-auth-proxy-7ccb5f5468-m2qp5\" (UID: \"e5b1a282-6765-4e19-a38f-0bdbeec908e1\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:35.322097 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:35.322071 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b1a282-6765-4e19-a38f-0bdbeec908e1-tls-certs\") pod \"kube-auth-proxy-7ccb5f5468-m2qp5\" (UID: \"e5b1a282-6765-4e19-a38f-0bdbeec908e1\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:35.542583 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:35.542545 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" Jun 09 12:47:35.683250 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:35.683163 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5"] Jun 09 12:47:35.686062 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:47:35.686031 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b1a282_6765_4e19_a38f_0bdbeec908e1.slice/crio-efc08c6e57b3508aa9d8392e580d45a8c4f73ae3ebc330374575a57a7efc9f46 WatchSource:0}: Error finding container efc08c6e57b3508aa9d8392e580d45a8c4f73ae3ebc330374575a57a7efc9f46: Status 404 returned error can't find the container with id efc08c6e57b3508aa9d8392e580d45a8c4f73ae3ebc330374575a57a7efc9f46 Jun 09 12:47:36.465200 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:36.465164 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" event={"ID":"e5b1a282-6765-4e19-a38f-0bdbeec908e1","Type":"ContainerStarted","Data":"efc08c6e57b3508aa9d8392e580d45a8c4f73ae3ebc330374575a57a7efc9f46"} Jun 09 12:47:39.483966 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:39.483929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" event={"ID":"e5b1a282-6765-4e19-a38f-0bdbeec908e1","Type":"ContainerStarted","Data":"a5946ac09c67468aa51c1a194cb16187a7967b7d3d750c9098d0bf31c95b90ab"} Jun 09 12:47:39.509941 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:39.509862 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-m2qp5" podStartSLOduration=2.69120229 podStartE2EDuration="5.509847461s" totalImagesPullingTime="2.818645171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:39.509415976 +0000 UTC m=+396.343622244" watchObservedRunningTime="2026-06-09 12:47:39.509847461 +0000 UTC m=+396.344053727" Jun 09 12:47:48.227301 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.227262 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz"] Jun 09 12:47:48.230818 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.230790 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" Jun 09 12:47:48.232869 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.232844 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-5zwsd"] Jun 09 12:47:48.236151 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.236122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" Jun 09 12:47:48.238510 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.238492 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lkdcg\"" Jun 09 12:47:48.241139 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.241119 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 12:47:48.241232 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.241120 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pk4kd\"" Jun 09 12:47:48.259644 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.259620 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 12:47:48.281087 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.281056 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz"] Jun 09 12:47:48.283829 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.283806 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-5zwsd"] Jun 09 12:47:48.332633 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.332597 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/977506c0-4d7d-4700-8ee6-a667e7c162bc-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-mmkdz\" (UID: \"977506c0-4d7d-4700-8ee6-a667e7c162bc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" Jun 09 12:47:48.332807 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.332655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce00ab7-5794-4ff1-bff8-b601b1bcf156-cert\") pod \"kserve-controller-manager-69fc866d76-5zwsd\" (UID: \"2ce00ab7-5794-4ff1-bff8-b601b1bcf156\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" Jun 09 12:47:48.332807 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.332698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcthg\" (UniqueName: \"kubernetes.io/projected/2ce00ab7-5794-4ff1-bff8-b601b1bcf156-kube-api-access-vcthg\") pod \"kserve-controller-manager-69fc866d76-5zwsd\" (UID: \"2ce00ab7-5794-4ff1-bff8-b601b1bcf156\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" Jun 09 12:47:48.332807 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.332740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd9jb\" (UniqueName: \"kubernetes.io/projected/977506c0-4d7d-4700-8ee6-a667e7c162bc-kube-api-access-jd9jb\") pod \"llmisvc-controller-manager-864bfd7bc9-mmkdz\" (UID: \"977506c0-4d7d-4700-8ee6-a667e7c162bc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" Jun 09 12:47:48.433753 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.433724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce00ab7-5794-4ff1-bff8-b601b1bcf156-cert\") pod \"kserve-controller-manager-69fc866d76-5zwsd\" (UID: \"2ce00ab7-5794-4ff1-bff8-b601b1bcf156\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" Jun 09 12:47:48.433978 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.433758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcthg\" (UniqueName: \"kubernetes.io/projected/2ce00ab7-5794-4ff1-bff8-b601b1bcf156-kube-api-access-vcthg\") pod \"kserve-controller-manager-69fc866d76-5zwsd\" (UID: \"2ce00ab7-5794-4ff1-bff8-b601b1bcf156\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" Jun 09 12:47:48.433978 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.433780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd9jb\" (UniqueName: \"kubernetes.io/projected/977506c0-4d7d-4700-8ee6-a667e7c162bc-kube-api-access-jd9jb\") pod \"llmisvc-controller-manager-864bfd7bc9-mmkdz\" (UID: \"977506c0-4d7d-4700-8ee6-a667e7c162bc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" Jun 09 12:47:48.433978 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.433838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/977506c0-4d7d-4700-8ee6-a667e7c162bc-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-mmkdz\" (UID: \"977506c0-4d7d-4700-8ee6-a667e7c162bc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" Jun 09 12:47:48.436296 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.436272 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce00ab7-5794-4ff1-bff8-b601b1bcf156-cert\") pod \"kserve-controller-manager-69fc866d76-5zwsd\" (UID: \"2ce00ab7-5794-4ff1-bff8-b601b1bcf156\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" Jun 09 12:47:48.436419 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.436305 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/977506c0-4d7d-4700-8ee6-a667e7c162bc-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-mmkdz\" (UID: \"977506c0-4d7d-4700-8ee6-a667e7c162bc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" Jun 09 12:47:48.453732 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.453698 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcthg\" (UniqueName: \"kubernetes.io/projected/2ce00ab7-5794-4ff1-bff8-b601b1bcf156-kube-api-access-vcthg\") pod \"kserve-controller-manager-69fc866d76-5zwsd\" (UID: \"2ce00ab7-5794-4ff1-bff8-b601b1bcf156\") " pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" Jun 09 12:47:48.461507 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.461482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd9jb\" (UniqueName: \"kubernetes.io/projected/977506c0-4d7d-4700-8ee6-a667e7c162bc-kube-api-access-jd9jb\") pod \"llmisvc-controller-manager-864bfd7bc9-mmkdz\" (UID: \"977506c0-4d7d-4700-8ee6-a667e7c162bc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" Jun 09 12:47:48.541201 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.541117 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" Jun 09 12:47:48.548244 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.548219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" Jun 09 12:47:48.707286 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.707257 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz"] Jun 09 12:47:48.709682 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:47:48.709653 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod977506c0_4d7d_4700_8ee6_a667e7c162bc.slice/crio-2d9c4fc9aa43b610064c41454587685c88fcac1226aeb26bad68c500d9e9defe WatchSource:0}: Error finding container 2d9c4fc9aa43b610064c41454587685c88fcac1226aeb26bad68c500d9e9defe: Status 404 returned error can't find the container with id 2d9c4fc9aa43b610064c41454587685c88fcac1226aeb26bad68c500d9e9defe Jun 09 12:47:48.724597 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:48.724572 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-5zwsd"] Jun 09 12:47:48.734819 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:47:48.734794 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce00ab7_5794_4ff1_bff8_b601b1bcf156.slice/crio-048c29cc4a242ea7413b90396d34125af83536ea7045561da528293b56add1fd WatchSource:0}: Error finding container 048c29cc4a242ea7413b90396d34125af83536ea7045561da528293b56add1fd: Status 404 returned error can't find the container with id 048c29cc4a242ea7413b90396d34125af83536ea7045561da528293b56add1fd Jun 09 12:47:49.533470 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:49.533420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" event={"ID":"2ce00ab7-5794-4ff1-bff8-b601b1bcf156","Type":"ContainerStarted","Data":"048c29cc4a242ea7413b90396d34125af83536ea7045561da528293b56add1fd"} Jun 09 12:47:49.535031 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:49.534964 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" event={"ID":"977506c0-4d7d-4700-8ee6-a667e7c162bc","Type":"ContainerStarted","Data":"2d9c4fc9aa43b610064c41454587685c88fcac1226aeb26bad68c500d9e9defe"} Jun 09 12:47:50.902768 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:50.902728 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt"] Jun 09 12:47:50.907751 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:50.907728 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:50.934985 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:50.934952 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:47:50.935120 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:50.935073 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:47:50.935361 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:50.935335 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dbrkp\"" Jun 09 12:47:50.958559 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:50.958523 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5nvv\" (UniqueName: \"kubernetes.io/projected/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-kube-api-access-k5nvv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:50.958706 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:50.958582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:50.958706 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:50.958660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:50.992362 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:50.992323 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt"] Jun 09 12:47:51.059784 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.059745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5nvv\" (UniqueName: \"kubernetes.io/projected/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-kube-api-access-k5nvv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:51.059994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.059795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:51.059994 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.059893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:51.060277 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.060255 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:51.060343 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.060291 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:51.130179 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.130143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5nvv\" (UniqueName: \"kubernetes.io/projected/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-kube-api-access-k5nvv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:51.219844 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.219780 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:51.472355 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.472150 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt"] Jun 09 12:47:51.547755 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.547719 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" event={"ID":"2ce00ab7-5794-4ff1-bff8-b601b1bcf156","Type":"ContainerStarted","Data":"7e2e0b0e909a776979e4dc6f0d4afdda74d59931dae8a8f813bfb80c1c14caae"} Jun 09 12:47:51.547966 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.547782 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" Jun 09 12:47:51.628951 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:51.628881 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" podStartSLOduration=1.171143829 podStartE2EDuration="3.628857745s" totalImagesPullingTime="2.457713916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:51.62762075 +0000 UTC m=+408.461827029" watchObservedRunningTime="2026-06-09 12:47:51.628857745 +0000 UTC m=+408.463064014" Jun 09 12:47:51.963604 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:47:51.963569 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa12d639_1bc6_4903_a6e9_79496c8cb7c6.slice/crio-252c320753677db384fc9027f6a912fed6b9fea93a21909da1db709fea86c70b WatchSource:0}: Error finding container 252c320753677db384fc9027f6a912fed6b9fea93a21909da1db709fea86c70b: Status 404 returned error can't find the container with id 252c320753677db384fc9027f6a912fed6b9fea93a21909da1db709fea86c70b Jun 09 12:47:52.553945 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:52.553883 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" event={"ID":"977506c0-4d7d-4700-8ee6-a667e7c162bc","Type":"ContainerStarted","Data":"ce0ad544935f8e33d0184c6d90a7c8d4d2a0187e5cb87c2e7a5f44006feab1ed"} Jun 09 12:47:52.554123 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:52.554023 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" Jun 09 12:47:52.555399 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:52.555374 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa12d639-1bc6-4903-a6e9-79496c8cb7c6" containerID="a6c282bf8790e0ea24efd543ae1638337f60cb3b9b080a78e131c495120300f0" exitCode=0 Jun 09 12:47:52.555527 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:52.555408 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" event={"ID":"aa12d639-1bc6-4903-a6e9-79496c8cb7c6","Type":"ContainerDied","Data":"a6c282bf8790e0ea24efd543ae1638337f60cb3b9b080a78e131c495120300f0"} Jun 09 12:47:52.555527 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:52.555447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" event={"ID":"aa12d639-1bc6-4903-a6e9-79496c8cb7c6","Type":"ContainerStarted","Data":"252c320753677db384fc9027f6a912fed6b9fea93a21909da1db709fea86c70b"} Jun 09 12:47:52.690743 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:52.690675 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" podStartSLOduration=1.387775314 podStartE2EDuration="4.690659757s" totalImagesPullingTime="3.302884443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:52.690258316 +0000 UTC m=+409.524464581" watchObservedRunningTime="2026-06-09 12:47:52.690659757 +0000 UTC m=+409.524866022" Jun 09 12:47:54.566750 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:54.566711 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa12d639-1bc6-4903-a6e9-79496c8cb7c6" containerID="5a748e86c0ed8fb7b30d89e7bc017dd07adecb1b9a958046f20f4d8da058860c" exitCode=0 Jun 09 12:47:54.567135 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:54.566803 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" event={"ID":"aa12d639-1bc6-4903-a6e9-79496c8cb7c6","Type":"ContainerDied","Data":"5a748e86c0ed8fb7b30d89e7bc017dd07adecb1b9a958046f20f4d8da058860c"} Jun 09 12:47:55.573959 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:55.573927 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa12d639-1bc6-4903-a6e9-79496c8cb7c6" containerID="f2e1d147c9a64430749ab98ed07cf5508e3c7fb5802926225d887c4892b7c136" exitCode=0 Jun 09 12:47:55.574346 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:55.573976 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" event={"ID":"aa12d639-1bc6-4903-a6e9-79496c8cb7c6","Type":"ContainerDied","Data":"f2e1d147c9a64430749ab98ed07cf5508e3c7fb5802926225d887c4892b7c136"} Jun 09 12:47:56.710607 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:56.710581 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:56.813146 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:56.813114 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5nvv\" (UniqueName: \"kubernetes.io/projected/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-kube-api-access-k5nvv\") pod \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " Jun 09 12:47:56.813319 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:56.813214 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-bundle\") pod \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " Jun 09 12:47:56.813319 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:56.813243 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-util\") pod \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\" (UID: \"aa12d639-1bc6-4903-a6e9-79496c8cb7c6\") " Jun 09 12:47:56.814210 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:56.814175 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-bundle" (OuterVolumeSpecName: "bundle") pod "aa12d639-1bc6-4903-a6e9-79496c8cb7c6" (UID: "aa12d639-1bc6-4903-a6e9-79496c8cb7c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:47:56.815591 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:56.815567 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-kube-api-access-k5nvv" (OuterVolumeSpecName: "kube-api-access-k5nvv") pod "aa12d639-1bc6-4903-a6e9-79496c8cb7c6" (UID: "aa12d639-1bc6-4903-a6e9-79496c8cb7c6"). InnerVolumeSpecName "kube-api-access-k5nvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:47:56.819049 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:56.819018 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-util" (OuterVolumeSpecName: "util") pod "aa12d639-1bc6-4903-a6e9-79496c8cb7c6" (UID: "aa12d639-1bc6-4903-a6e9-79496c8cb7c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:47:56.914226 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:56.914203 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5nvv\" (UniqueName: \"kubernetes.io/projected/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-kube-api-access-k5nvv\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:47:56.914226 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:56.914225 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:47:56.914372 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:56.914235 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa12d639-1bc6-4903-a6e9-79496c8cb7c6-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:47:57.585464 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:57.585425 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" event={"ID":"aa12d639-1bc6-4903-a6e9-79496c8cb7c6","Type":"ContainerDied","Data":"252c320753677db384fc9027f6a912fed6b9fea93a21909da1db709fea86c70b"} Jun 09 12:47:57.585642 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:57.585477 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akssbt" Jun 09 12:47:57.585642 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:57.585485 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="252c320753677db384fc9027f6a912fed6b9fea93a21909da1db709fea86c70b" Jun 09 12:47:59.514649 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.514609 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7"] Jun 09 12:47:59.515066 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.515041 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa12d639-1bc6-4903-a6e9-79496c8cb7c6" containerName="extract" Jun 09 12:47:59.515066 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.515054 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa12d639-1bc6-4903-a6e9-79496c8cb7c6" containerName="extract" Jun 09 12:47:59.515143 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.515074 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa12d639-1bc6-4903-a6e9-79496c8cb7c6" containerName="pull" Jun 09 12:47:59.515143 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.515080 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa12d639-1bc6-4903-a6e9-79496c8cb7c6" containerName="pull" Jun 09 12:47:59.515143 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.515094 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa12d639-1bc6-4903-a6e9-79496c8cb7c6" containerName="util" Jun 09 12:47:59.515143 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.515100 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa12d639-1bc6-4903-a6e9-79496c8cb7c6" containerName="util" Jun 09 12:47:59.515260 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.515157 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa12d639-1bc6-4903-a6e9-79496c8cb7c6" containerName="extract" Jun 09 12:47:59.518373 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.518357 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" Jun 09 12:47:59.528160 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.528141 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 12:47:59.530830 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.530815 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 12:47:59.530878 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.530819 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-64gfq\"" Jun 09 12:47:59.537679 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.537653 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7"] Jun 09 12:47:59.638068 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.638036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0198bca6-c4ed-4fd5-898e-e0dd34ef30cf-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8mcq7\" (UID: \"0198bca6-c4ed-4fd5-898e-e0dd34ef30cf\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" Jun 09 12:47:59.638221 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.638119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjfs6\" (UniqueName: \"kubernetes.io/projected/0198bca6-c4ed-4fd5-898e-e0dd34ef30cf-kube-api-access-kjfs6\") pod \"servicemesh-operator3-57f65f65fb-8mcq7\" (UID: \"0198bca6-c4ed-4fd5-898e-e0dd34ef30cf\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" Jun 09 12:47:59.738775 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.738748 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjfs6\" (UniqueName: \"kubernetes.io/projected/0198bca6-c4ed-4fd5-898e-e0dd34ef30cf-kube-api-access-kjfs6\") pod \"servicemesh-operator3-57f65f65fb-8mcq7\" (UID: \"0198bca6-c4ed-4fd5-898e-e0dd34ef30cf\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" Jun 09 12:47:59.738993 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.738792 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0198bca6-c4ed-4fd5-898e-e0dd34ef30cf-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8mcq7\" (UID: \"0198bca6-c4ed-4fd5-898e-e0dd34ef30cf\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" Jun 09 12:47:59.741395 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.741375 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0198bca6-c4ed-4fd5-898e-e0dd34ef30cf-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8mcq7\" (UID: \"0198bca6-c4ed-4fd5-898e-e0dd34ef30cf\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" Jun 09 12:47:59.751161 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.751139 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjfs6\" (UniqueName: \"kubernetes.io/projected/0198bca6-c4ed-4fd5-898e-e0dd34ef30cf-kube-api-access-kjfs6\") pod \"servicemesh-operator3-57f65f65fb-8mcq7\" (UID: \"0198bca6-c4ed-4fd5-898e-e0dd34ef30cf\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" Jun 09 12:47:59.827803 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.827728 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" Jun 09 12:47:59.997265 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:47:59.997241 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7"] Jun 09 12:47:59.998972 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:47:59.998945 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0198bca6_c4ed_4fd5_898e_e0dd34ef30cf.slice/crio-f07d8ec48182074052be9805828e9dee1079480ef5b0d2a203ebb9112c4bf686 WatchSource:0}: Error finding container f07d8ec48182074052be9805828e9dee1079480ef5b0d2a203ebb9112c4bf686: Status 404 returned error can't find the container with id f07d8ec48182074052be9805828e9dee1079480ef5b0d2a203ebb9112c4bf686 Jun 09 12:48:00.600343 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:00.600310 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" event={"ID":"0198bca6-c4ed-4fd5-898e-e0dd34ef30cf","Type":"ContainerStarted","Data":"f07d8ec48182074052be9805828e9dee1079480ef5b0d2a203ebb9112c4bf686"} Jun 09 12:48:03.617714 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:03.617678 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" event={"ID":"0198bca6-c4ed-4fd5-898e-e0dd34ef30cf","Type":"ContainerStarted","Data":"5c03ee1b3dab231d0a7ae1b5b7785f343fb21b4407bd3693c9c2f3798d453f0c"} Jun 09 12:48:03.618140 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:03.617749 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" Jun 09 12:48:03.786588 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:03.786530 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" podStartSLOduration=1.971040646 podStartE2EDuration="4.786515114s" totalImagesPullingTime="2.815474468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:48:03.774286905 +0000 UTC m=+420.608493171" watchObservedRunningTime="2026-06-09 12:48:03.786515114 +0000 UTC m=+420.620721379" Jun 09 12:48:05.435635 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.435600 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb"] Jun 09 12:48:05.440462 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.440442 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.450103 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.450084 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 12:48:05.450194 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.450118 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 12:48:05.451068 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.451051 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 12:48:05.451936 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.451923 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-t8d7d\"" Jun 09 12:48:05.457266 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.457250 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 12:48:05.488394 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.488364 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb"] Jun 09 12:48:05.594038 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.594005 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-574965d894-lkgj9"] Jun 09 12:48:05.596116 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.596095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.596174 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.596127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f8e431-ac23-430d-ba15-e33b130b592a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.596174 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.596161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c7f8e431-ac23-430d-ba15-e33b130b592a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.596290 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.596267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.596347 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.596326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.596398 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.596358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.596438 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.596417 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb9nq\" (UniqueName: \"kubernetes.io/projected/c7f8e431-ac23-430d-ba15-e33b130b592a-kube-api-access-wb9nq\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.597465 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.597451 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-574965d894-lkgj9" Jun 09 12:48:05.600335 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.600319 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5kp8r\"" Jun 09 12:48:05.600739 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.600724 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 12:48:05.679864 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.679834 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-574965d894-lkgj9"] Jun 09 12:48:05.697412 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.697339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.697412 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.697372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f8e431-ac23-430d-ba15-e33b130b592a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.697412 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.697397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq9nf\" (UniqueName: \"kubernetes.io/projected/ac3528f4-ea58-4581-8735-a7c2daac8da8-kube-api-access-nq9nf\") pod \"dashboard-redirect-574965d894-lkgj9\" (UID: \"ac3528f4-ea58-4581-8735-a7c2daac8da8\") " pod="opendatahub/dashboard-redirect-574965d894-lkgj9" Jun 09 12:48:05.697648 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.697461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c7f8e431-ac23-430d-ba15-e33b130b592a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.697648 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.697584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.697648 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.697619 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.697648 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.697640 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.697892 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.697720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb9nq\" (UniqueName: \"kubernetes.io/projected/c7f8e431-ac23-430d-ba15-e33b130b592a-kube-api-access-wb9nq\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.697892 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.697774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ac3528f4-ea58-4581-8735-a7c2daac8da8-redirect-config\") pod \"dashboard-redirect-574965d894-lkgj9\" (UID: \"ac3528f4-ea58-4581-8735-a7c2daac8da8\") " pod="opendatahub/dashboard-redirect-574965d894-lkgj9" Jun 09 12:48:05.698481 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.698456 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.700013 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.699990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c7f8e431-ac23-430d-ba15-e33b130b592a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.700117 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.699990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f8e431-ac23-430d-ba15-e33b130b592a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.700185 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.700171 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.700526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.700503 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.725397 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.725343 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb9nq\" (UniqueName: \"kubernetes.io/projected/c7f8e431-ac23-430d-ba15-e33b130b592a-kube-api-access-wb9nq\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.727565 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.727542 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7f8e431-ac23-430d-ba15-e33b130b592a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8hwmb\" (UID: \"c7f8e431-ac23-430d-ba15-e33b130b592a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.749620 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.749598 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:05.798328 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.798295 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ac3528f4-ea58-4581-8735-a7c2daac8da8-redirect-config\") pod \"dashboard-redirect-574965d894-lkgj9\" (UID: \"ac3528f4-ea58-4581-8735-a7c2daac8da8\") " pod="opendatahub/dashboard-redirect-574965d894-lkgj9" Jun 09 12:48:05.798627 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.798602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq9nf\" (UniqueName: \"kubernetes.io/projected/ac3528f4-ea58-4581-8735-a7c2daac8da8-kube-api-access-nq9nf\") pod \"dashboard-redirect-574965d894-lkgj9\" (UID: \"ac3528f4-ea58-4581-8735-a7c2daac8da8\") " pod="opendatahub/dashboard-redirect-574965d894-lkgj9" Jun 09 12:48:05.799148 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.799128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ac3528f4-ea58-4581-8735-a7c2daac8da8-redirect-config\") pod \"dashboard-redirect-574965d894-lkgj9\" (UID: \"ac3528f4-ea58-4581-8735-a7c2daac8da8\") " pod="opendatahub/dashboard-redirect-574965d894-lkgj9" Jun 09 12:48:05.812832 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.812797 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq9nf\" (UniqueName: \"kubernetes.io/projected/ac3528f4-ea58-4581-8735-a7c2daac8da8-kube-api-access-nq9nf\") pod \"dashboard-redirect-574965d894-lkgj9\" (UID: \"ac3528f4-ea58-4581-8735-a7c2daac8da8\") " pod="opendatahub/dashboard-redirect-574965d894-lkgj9" Jun 09 12:48:05.908148 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:05.908115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-574965d894-lkgj9" Jun 09 12:48:06.052242 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:06.052208 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb"] Jun 09 12:48:06.065814 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:48:06.065787 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f8e431_ac23_430d_ba15_e33b130b592a.slice/crio-c31a6cb5d9fae959941c9a434cc3b63902e868b5623265bf71cb6b888a6a8d39 WatchSource:0}: Error finding container c31a6cb5d9fae959941c9a434cc3b63902e868b5623265bf71cb6b888a6a8d39: Status 404 returned error can't find the container with id c31a6cb5d9fae959941c9a434cc3b63902e868b5623265bf71cb6b888a6a8d39 Jun 09 12:48:06.106645 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:06.106624 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-574965d894-lkgj9"] Jun 09 12:48:06.108540 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:48:06.108511 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3528f4_ea58_4581_8735_a7c2daac8da8.slice/crio-cea8ace199a9417d9f37de754458ea11376bdae7881eedc25bf0b26514fbcc03 WatchSource:0}: Error finding container cea8ace199a9417d9f37de754458ea11376bdae7881eedc25bf0b26514fbcc03: Status 404 returned error can't find the container with id cea8ace199a9417d9f37de754458ea11376bdae7881eedc25bf0b26514fbcc03 Jun 09 12:48:06.633950 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:06.633884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" event={"ID":"c7f8e431-ac23-430d-ba15-e33b130b592a","Type":"ContainerStarted","Data":"c31a6cb5d9fae959941c9a434cc3b63902e868b5623265bf71cb6b888a6a8d39"} Jun 09 12:48:06.635096 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:06.635071 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-574965d894-lkgj9" event={"ID":"ac3528f4-ea58-4581-8735-a7c2daac8da8","Type":"ContainerStarted","Data":"cea8ace199a9417d9f37de754458ea11376bdae7881eedc25bf0b26514fbcc03"} Jun 09 12:48:09.113185 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:09.113138 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 09 12:48:09.113540 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:09.113228 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 09 12:48:09.654750 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:09.654707 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" event={"ID":"c7f8e431-ac23-430d-ba15-e33b130b592a","Type":"ContainerStarted","Data":"c6747c466c5c57a5a68f6d80a67cad789c3cf0e7eff7597c307babd4f0e4b53d"} Jun 09 12:48:09.654957 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:09.654774 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:09.661539 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:09.661512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-574965d894-lkgj9" event={"ID":"ac3528f4-ea58-4581-8735-a7c2daac8da8","Type":"ContainerStarted","Data":"bcddcf7dad4e567f4df4e7d10cbdfc6e5160ef75f71b250289ed6f7f4007b05f"} Jun 09 12:48:09.719511 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:09.719458 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" podStartSLOduration=1.674436512 podStartE2EDuration="4.719439854s" totalImagesPullingTime="3.045003342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:48:09.712740352 +0000 UTC m=+426.546946618" watchObservedRunningTime="2026-06-09 12:48:09.719439854 +0000 UTC m=+426.553646121" Jun 09 12:48:09.763037 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:09.762996 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-574965d894-lkgj9" podStartSLOduration=1.763024915 podStartE2EDuration="4.762977492s" totalImagesPullingTime="2.999952577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:48:09.75970672 +0000 UTC m=+426.593912985" watchObservedRunningTime="2026-06-09 12:48:09.762977492 +0000 UTC m=+426.597183758" Jun 09 12:48:10.663220 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:10.663192 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8hwmb" Jun 09 12:48:14.624603 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:14.624571 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8mcq7" Jun 09 12:48:22.560781 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:22.560709 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-5zwsd" Jun 09 12:48:23.563394 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:23.563366 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mmkdz" Jun 09 12:48:51.015008 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.014958 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw"] Jun 09 12:48:51.023101 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.023072 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.026005 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.025963 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jjq7b\"" Jun 09 12:48:51.026005 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.025987 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:48:51.027023 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.027000 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:48:51.029351 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.029329 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw"] Jun 09 12:48:51.083451 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.083390 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.083451 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.083448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlhzc\" (UniqueName: \"kubernetes.io/projected/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-kube-api-access-qlhzc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.083664 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.083505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.184641 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.184605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.184829 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.184670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlhzc\" (UniqueName: \"kubernetes.io/projected/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-kube-api-access-qlhzc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.184829 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.184696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.185053 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.185035 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.185098 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.185059 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.199564 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.199536 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlhzc\" (UniqueName: \"kubernetes.io/projected/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-kube-api-access-qlhzc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.334645 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.334555 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:51.470361 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.470336 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw"] Jun 09 12:48:51.476965 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:48:51.476931 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364ec1ee_6a3f_419d_a113_b6cb002bd1fa.slice/crio-84e581bd7e46661fb670fa05a42cfbcf8e3fbc3abfd505e056ce37ccc4caaf44 WatchSource:0}: Error finding container 84e581bd7e46661fb670fa05a42cfbcf8e3fbc3abfd505e056ce37ccc4caaf44: Status 404 returned error can't find the container with id 84e581bd7e46661fb670fa05a42cfbcf8e3fbc3abfd505e056ce37ccc4caaf44 Jun 09 12:48:51.635533 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.635456 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq"] Jun 09 12:48:51.639140 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.639120 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:51.650597 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.650572 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq"] Jun 09 12:48:51.689858 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.689824 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf45c\" (UniqueName: \"kubernetes.io/projected/a7512463-aa6f-403d-82c2-0d3f29db4c3c-kube-api-access-sf45c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:51.690047 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.689885 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:51.690047 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.689982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:51.790846 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.790817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:51.791017 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.790879 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:51.791017 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.790959 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf45c\" (UniqueName: \"kubernetes.io/projected/a7512463-aa6f-403d-82c2-0d3f29db4c3c-kube-api-access-sf45c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:51.791267 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.791238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:51.791317 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.791296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:51.801731 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.801710 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf45c\" (UniqueName: \"kubernetes.io/projected/a7512463-aa6f-403d-82c2-0d3f29db4c3c-kube-api-access-sf45c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:51.873435 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.873404 2561 generic.go:356] "Generic (PLEG): container finished" podID="364ec1ee-6a3f-419d-a113-b6cb002bd1fa" containerID="a3322aae1cd2ddd0e2de199c8ea88ac49b8f9c7483498bc45195e142a67e3ed3" exitCode=0 Jun 09 12:48:51.873592 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.873492 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" event={"ID":"364ec1ee-6a3f-419d-a113-b6cb002bd1fa","Type":"ContainerDied","Data":"a3322aae1cd2ddd0e2de199c8ea88ac49b8f9c7483498bc45195e142a67e3ed3"} Jun 09 12:48:51.873592 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.873537 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" event={"ID":"364ec1ee-6a3f-419d-a113-b6cb002bd1fa","Type":"ContainerStarted","Data":"84e581bd7e46661fb670fa05a42cfbcf8e3fbc3abfd505e056ce37ccc4caaf44"} Jun 09 12:48:51.953088 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:51.953051 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:52.024213 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.024185 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d"] Jun 09 12:48:52.028089 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.028062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.040212 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.040183 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d"] Jun 09 12:48:52.093131 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.093095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.093448 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.093211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgk98\" (UniqueName: \"kubernetes.io/projected/5c033176-3118-4265-a229-6962e90d5e0e-kube-api-access-mgk98\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.093448 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.093235 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.097183 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.097161 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq"] Jun 09 12:48:52.099565 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:48:52.099538 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7512463_aa6f_403d_82c2_0d3f29db4c3c.slice/crio-63ab7a44d05591e007f21b9d9769146d689943819bdd98ff331bc218d6ad87fc WatchSource:0}: Error finding container 63ab7a44d05591e007f21b9d9769146d689943819bdd98ff331bc218d6ad87fc: Status 404 returned error can't find the container with id 63ab7a44d05591e007f21b9d9769146d689943819bdd98ff331bc218d6ad87fc Jun 09 12:48:52.194470 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.194434 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgk98\" (UniqueName: \"kubernetes.io/projected/5c033176-3118-4265-a229-6962e90d5e0e-kube-api-access-mgk98\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.194470 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.194474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.194684 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.194517 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.194884 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.194867 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.194996 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.194973 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.209223 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.209201 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgk98\" (UniqueName: \"kubernetes.io/projected/5c033176-3118-4265-a229-6962e90d5e0e-kube-api-access-mgk98\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.338666 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.338630 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:52.410617 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.410590 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6"] Jun 09 12:48:52.414252 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.414232 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.429512 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.429477 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6"] Jun 09 12:48:52.488428 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.488399 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d"] Jun 09 12:48:52.497351 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.497320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.497490 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.497472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85pdq\" (UniqueName: \"kubernetes.io/projected/50b280bf-88dd-4d35-a092-9fcd501cc792-kube-api-access-85pdq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.497544 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.497507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.563536 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:48:52.563506 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c033176_3118_4265_a229_6962e90d5e0e.slice/crio-96ca0ccfa832feed614032c0a2b62f50bf36d7c7dbcce9e6706cd4f4b479f642 WatchSource:0}: Error finding container 96ca0ccfa832feed614032c0a2b62f50bf36d7c7dbcce9e6706cd4f4b479f642: Status 404 returned error can't find the container with id 96ca0ccfa832feed614032c0a2b62f50bf36d7c7dbcce9e6706cd4f4b479f642 Jun 09 12:48:52.599028 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.599007 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.599138 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.599084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85pdq\" (UniqueName: \"kubernetes.io/projected/50b280bf-88dd-4d35-a092-9fcd501cc792-kube-api-access-85pdq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.599138 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.599119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.599394 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.599374 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.599458 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.599445 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.609250 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.609226 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85pdq\" (UniqueName: \"kubernetes.io/projected/50b280bf-88dd-4d35-a092-9fcd501cc792-kube-api-access-85pdq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.724679 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.724648 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:52.869249 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.869221 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6"] Jun 09 12:48:52.870621 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:48:52.870594 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b280bf_88dd_4d35_a092_9fcd501cc792.slice/crio-f7fe794041bbd830bf13eb0bfa7e7aba9ca07dd1a4439963fe5fbf77009edae4 WatchSource:0}: Error finding container f7fe794041bbd830bf13eb0bfa7e7aba9ca07dd1a4439963fe5fbf77009edae4: Status 404 returned error can't find the container with id f7fe794041bbd830bf13eb0bfa7e7aba9ca07dd1a4439963fe5fbf77009edae4 Jun 09 12:48:52.879648 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.879618 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" event={"ID":"50b280bf-88dd-4d35-a092-9fcd501cc792","Type":"ContainerStarted","Data":"f7fe794041bbd830bf13eb0bfa7e7aba9ca07dd1a4439963fe5fbf77009edae4"} Jun 09 12:48:52.881078 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.881054 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c033176-3118-4265-a229-6962e90d5e0e" containerID="07e9ce012b417bd6953b8e3e278abc07ef56884553433a09bc46a7a5961791b9" exitCode=0 Jun 09 12:48:52.881180 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.881132 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" event={"ID":"5c033176-3118-4265-a229-6962e90d5e0e","Type":"ContainerDied","Data":"07e9ce012b417bd6953b8e3e278abc07ef56884553433a09bc46a7a5961791b9"} Jun 09 12:48:52.881180 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.881175 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" event={"ID":"5c033176-3118-4265-a229-6962e90d5e0e","Type":"ContainerStarted","Data":"96ca0ccfa832feed614032c0a2b62f50bf36d7c7dbcce9e6706cd4f4b479f642"} Jun 09 12:48:52.882719 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.882697 2561 generic.go:356] "Generic (PLEG): container finished" podID="a7512463-aa6f-403d-82c2-0d3f29db4c3c" containerID="cf005c245be2b2515a9d2b1cab1e7f029803e64a4f9d87310e05e55b1bf9c97e" exitCode=0 Jun 09 12:48:52.882808 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.882787 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" event={"ID":"a7512463-aa6f-403d-82c2-0d3f29db4c3c","Type":"ContainerDied","Data":"cf005c245be2b2515a9d2b1cab1e7f029803e64a4f9d87310e05e55b1bf9c97e"} Jun 09 12:48:52.882877 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.882833 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" event={"ID":"a7512463-aa6f-403d-82c2-0d3f29db4c3c","Type":"ContainerStarted","Data":"63ab7a44d05591e007f21b9d9769146d689943819bdd98ff331bc218d6ad87fc"} Jun 09 12:48:52.885342 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.885323 2561 generic.go:356] "Generic (PLEG): container finished" podID="364ec1ee-6a3f-419d-a113-b6cb002bd1fa" containerID="41e0284a1f74e329df80f88b88a5a944fd3d08b7dca9ee80b9e7e128c8226ea4" exitCode=0 Jun 09 12:48:52.885445 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:52.885390 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" event={"ID":"364ec1ee-6a3f-419d-a113-b6cb002bd1fa","Type":"ContainerDied","Data":"41e0284a1f74e329df80f88b88a5a944fd3d08b7dca9ee80b9e7e128c8226ea4"} Jun 09 12:48:53.893673 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:53.893577 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c033176-3118-4265-a229-6962e90d5e0e" containerID="b71f07fa514262312dc9f9ac51da098156f30df16ea2c68c66e7ebf2bb9cf746" exitCode=0 Jun 09 12:48:53.894115 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:53.893668 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" event={"ID":"5c033176-3118-4265-a229-6962e90d5e0e","Type":"ContainerDied","Data":"b71f07fa514262312dc9f9ac51da098156f30df16ea2c68c66e7ebf2bb9cf746"} Jun 09 12:48:53.895632 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:53.895613 2561 generic.go:356] "Generic (PLEG): container finished" podID="a7512463-aa6f-403d-82c2-0d3f29db4c3c" containerID="1607860b90e914a0801b4b50ab8f1f249d6720f0a0e68e8715289c11ae930868" exitCode=0 Jun 09 12:48:53.895705 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:53.895687 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" event={"ID":"a7512463-aa6f-403d-82c2-0d3f29db4c3c","Type":"ContainerDied","Data":"1607860b90e914a0801b4b50ab8f1f249d6720f0a0e68e8715289c11ae930868"} Jun 09 12:48:53.897983 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:53.897964 2561 generic.go:356] "Generic (PLEG): container finished" podID="364ec1ee-6a3f-419d-a113-b6cb002bd1fa" containerID="4c584a1254f499f748f7e4f5d5445d40f2bd61a10f876498de28d494ec614ef0" exitCode=0 Jun 09 12:48:53.898069 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:53.898048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" event={"ID":"364ec1ee-6a3f-419d-a113-b6cb002bd1fa","Type":"ContainerDied","Data":"4c584a1254f499f748f7e4f5d5445d40f2bd61a10f876498de28d494ec614ef0"} Jun 09 12:48:53.899650 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:53.899630 2561 generic.go:356] "Generic (PLEG): container finished" podID="50b280bf-88dd-4d35-a092-9fcd501cc792" containerID="e217665b826d99aeb94666c78b76c2d37ac019c1fa57508f64c3017eabcb76da" exitCode=0 Jun 09 12:48:53.899732 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:53.899692 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" event={"ID":"50b280bf-88dd-4d35-a092-9fcd501cc792","Type":"ContainerDied","Data":"e217665b826d99aeb94666c78b76c2d37ac019c1fa57508f64c3017eabcb76da"} Jun 09 12:48:54.908456 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:54.908422 2561 generic.go:356] "Generic (PLEG): container finished" podID="a7512463-aa6f-403d-82c2-0d3f29db4c3c" containerID="8f5d2a4528bb652f698ffa6af188aaadb87296ad39de0a4e697a577fca05851b" exitCode=0 Jun 09 12:48:54.908877 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:54.908503 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" event={"ID":"a7512463-aa6f-403d-82c2-0d3f29db4c3c","Type":"ContainerDied","Data":"8f5d2a4528bb652f698ffa6af188aaadb87296ad39de0a4e697a577fca05851b"} Jun 09 12:48:54.910237 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:54.910215 2561 generic.go:356] "Generic (PLEG): container finished" podID="50b280bf-88dd-4d35-a092-9fcd501cc792" containerID="b95b24385a09a9c9cec3d7b534f4b5ffcc824ab59a04f523b5b9272533dc3f4a" exitCode=0 Jun 09 12:48:54.910320 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:54.910293 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" event={"ID":"50b280bf-88dd-4d35-a092-9fcd501cc792","Type":"ContainerDied","Data":"b95b24385a09a9c9cec3d7b534f4b5ffcc824ab59a04f523b5b9272533dc3f4a"} Jun 09 12:48:54.912425 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:54.912405 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c033176-3118-4265-a229-6962e90d5e0e" containerID="11540fe097832283c24acf61f3fd394854584df5efd4bba877ee5d5571a45563" exitCode=0 Jun 09 12:48:54.912538 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:54.912481 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" event={"ID":"5c033176-3118-4265-a229-6962e90d5e0e","Type":"ContainerDied","Data":"11540fe097832283c24acf61f3fd394854584df5efd4bba877ee5d5571a45563"} Jun 09 12:48:55.051346 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.051323 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:55.124947 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.124887 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-util\") pod \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " Jun 09 12:48:55.125104 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.124995 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-bundle\") pod \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " Jun 09 12:48:55.125104 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.125065 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlhzc\" (UniqueName: \"kubernetes.io/projected/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-kube-api-access-qlhzc\") pod \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\" (UID: \"364ec1ee-6a3f-419d-a113-b6cb002bd1fa\") " Jun 09 12:48:55.125458 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.125435 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-bundle" (OuterVolumeSpecName: "bundle") pod "364ec1ee-6a3f-419d-a113-b6cb002bd1fa" (UID: "364ec1ee-6a3f-419d-a113-b6cb002bd1fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:48:55.127381 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.127357 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-kube-api-access-qlhzc" (OuterVolumeSpecName: "kube-api-access-qlhzc") pod "364ec1ee-6a3f-419d-a113-b6cb002bd1fa" (UID: "364ec1ee-6a3f-419d-a113-b6cb002bd1fa"). InnerVolumeSpecName "kube-api-access-qlhzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:48:55.130401 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.130363 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-util" (OuterVolumeSpecName: "util") pod "364ec1ee-6a3f-419d-a113-b6cb002bd1fa" (UID: "364ec1ee-6a3f-419d-a113-b6cb002bd1fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:48:55.226745 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.226716 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlhzc\" (UniqueName: \"kubernetes.io/projected/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-kube-api-access-qlhzc\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:55.226745 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.226744 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:55.226940 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.226754 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/364ec1ee-6a3f-419d-a113-b6cb002bd1fa-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:55.919599 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.919511 2561 generic.go:356] "Generic (PLEG): container finished" podID="50b280bf-88dd-4d35-a092-9fcd501cc792" containerID="9e1d0235b25d3a0e08579e7540cf14b98bae47231297ace85f163b098bd33f07" exitCode=0 Jun 09 12:48:55.920068 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.919598 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" event={"ID":"50b280bf-88dd-4d35-a092-9fcd501cc792","Type":"ContainerDied","Data":"9e1d0235b25d3a0e08579e7540cf14b98bae47231297ace85f163b098bd33f07"} Jun 09 12:48:55.921368 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.921351 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" Jun 09 12:48:55.921466 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.921388 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw" event={"ID":"364ec1ee-6a3f-419d-a113-b6cb002bd1fa","Type":"ContainerDied","Data":"84e581bd7e46661fb670fa05a42cfbcf8e3fbc3abfd505e056ce37ccc4caaf44"} Jun 09 12:48:55.921466 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:55.921419 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84e581bd7e46661fb670fa05a42cfbcf8e3fbc3abfd505e056ce37ccc4caaf44" Jun 09 12:48:56.065358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.065330 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:56.098838 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.098811 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:56.135371 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.135344 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-util\") pod \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " Jun 09 12:48:56.135529 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.135434 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf45c\" (UniqueName: \"kubernetes.io/projected/a7512463-aa6f-403d-82c2-0d3f29db4c3c-kube-api-access-sf45c\") pod \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " Jun 09 12:48:56.135529 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.135460 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-bundle\") pod \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\" (UID: \"a7512463-aa6f-403d-82c2-0d3f29db4c3c\") " Jun 09 12:48:56.136223 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.136178 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-bundle" (OuterVolumeSpecName: "bundle") pod "a7512463-aa6f-403d-82c2-0d3f29db4c3c" (UID: "a7512463-aa6f-403d-82c2-0d3f29db4c3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:48:56.138211 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.138186 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7512463-aa6f-403d-82c2-0d3f29db4c3c-kube-api-access-sf45c" (OuterVolumeSpecName: "kube-api-access-sf45c") pod "a7512463-aa6f-403d-82c2-0d3f29db4c3c" (UID: "a7512463-aa6f-403d-82c2-0d3f29db4c3c"). InnerVolumeSpecName "kube-api-access-sf45c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:48:56.141748 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.141726 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-util" (OuterVolumeSpecName: "util") pod "a7512463-aa6f-403d-82c2-0d3f29db4c3c" (UID: "a7512463-aa6f-403d-82c2-0d3f29db4c3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:48:56.236526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.236501 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-bundle\") pod \"5c033176-3118-4265-a229-6962e90d5e0e\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " Jun 09 12:48:56.236633 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.236558 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-util\") pod \"5c033176-3118-4265-a229-6962e90d5e0e\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " Jun 09 12:48:56.236633 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.236606 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgk98\" (UniqueName: \"kubernetes.io/projected/5c033176-3118-4265-a229-6962e90d5e0e-kube-api-access-mgk98\") pod \"5c033176-3118-4265-a229-6962e90d5e0e\" (UID: \"5c033176-3118-4265-a229-6962e90d5e0e\") " Jun 09 12:48:56.236999 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.236978 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:56.237071 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.237007 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf45c\" (UniqueName: \"kubernetes.io/projected/a7512463-aa6f-403d-82c2-0d3f29db4c3c-kube-api-access-sf45c\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:56.237071 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.237024 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7512463-aa6f-403d-82c2-0d3f29db4c3c-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:56.237071 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.237058 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-bundle" (OuterVolumeSpecName: "bundle") pod "5c033176-3118-4265-a229-6962e90d5e0e" (UID: "5c033176-3118-4265-a229-6962e90d5e0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:48:56.239056 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.239031 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c033176-3118-4265-a229-6962e90d5e0e-kube-api-access-mgk98" (OuterVolumeSpecName: "kube-api-access-mgk98") pod "5c033176-3118-4265-a229-6962e90d5e0e" (UID: "5c033176-3118-4265-a229-6962e90d5e0e"). InnerVolumeSpecName "kube-api-access-mgk98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:48:56.241733 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.241711 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-util" (OuterVolumeSpecName: "util") pod "5c033176-3118-4265-a229-6962e90d5e0e" (UID: "5c033176-3118-4265-a229-6962e90d5e0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:48:56.337646 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.337610 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:56.337646 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.337645 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgk98\" (UniqueName: \"kubernetes.io/projected/5c033176-3118-4265-a229-6962e90d5e0e-kube-api-access-mgk98\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:56.337646 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.337654 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c033176-3118-4265-a229-6962e90d5e0e-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:56.929680 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.929650 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" Jun 09 12:48:56.930129 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.929676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq" event={"ID":"a7512463-aa6f-403d-82c2-0d3f29db4c3c","Type":"ContainerDied","Data":"63ab7a44d05591e007f21b9d9769146d689943819bdd98ff331bc218d6ad87fc"} Jun 09 12:48:56.930129 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.929725 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63ab7a44d05591e007f21b9d9769146d689943819bdd98ff331bc218d6ad87fc" Jun 09 12:48:56.931805 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.931786 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" Jun 09 12:48:56.931805 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.931799 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d" event={"ID":"5c033176-3118-4265-a229-6962e90d5e0e","Type":"ContainerDied","Data":"96ca0ccfa832feed614032c0a2b62f50bf36d7c7dbcce9e6706cd4f4b479f642"} Jun 09 12:48:56.931983 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:56.931844 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96ca0ccfa832feed614032c0a2b62f50bf36d7c7dbcce9e6706cd4f4b479f642" Jun 09 12:48:57.087361 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.087336 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:57.263089 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.262967 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-bundle\") pod \"50b280bf-88dd-4d35-a092-9fcd501cc792\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " Jun 09 12:48:57.263089 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.263090 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-util\") pod \"50b280bf-88dd-4d35-a092-9fcd501cc792\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " Jun 09 12:48:57.263349 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.263139 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85pdq\" (UniqueName: \"kubernetes.io/projected/50b280bf-88dd-4d35-a092-9fcd501cc792-kube-api-access-85pdq\") pod \"50b280bf-88dd-4d35-a092-9fcd501cc792\" (UID: \"50b280bf-88dd-4d35-a092-9fcd501cc792\") " Jun 09 12:48:57.263495 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.263469 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-bundle" (OuterVolumeSpecName: "bundle") pod "50b280bf-88dd-4d35-a092-9fcd501cc792" (UID: "50b280bf-88dd-4d35-a092-9fcd501cc792"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:48:57.265376 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.265340 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50b280bf-88dd-4d35-a092-9fcd501cc792-kube-api-access-85pdq" (OuterVolumeSpecName: "kube-api-access-85pdq") pod "50b280bf-88dd-4d35-a092-9fcd501cc792" (UID: "50b280bf-88dd-4d35-a092-9fcd501cc792"). InnerVolumeSpecName "kube-api-access-85pdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:48:57.268217 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.268189 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-util" (OuterVolumeSpecName: "util") pod "50b280bf-88dd-4d35-a092-9fcd501cc792" (UID: "50b280bf-88dd-4d35-a092-9fcd501cc792"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:48:57.364511 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.364455 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:57.364511 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.364507 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85pdq\" (UniqueName: \"kubernetes.io/projected/50b280bf-88dd-4d35-a092-9fcd501cc792-kube-api-access-85pdq\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:57.364511 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.364519 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50b280bf-88dd-4d35-a092-9fcd501cc792-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:48:57.939111 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.939034 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" Jun 09 12:48:57.939527 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.939033 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6" event={"ID":"50b280bf-88dd-4d35-a092-9fcd501cc792","Type":"ContainerDied","Data":"f7fe794041bbd830bf13eb0bfa7e7aba9ca07dd1a4439963fe5fbf77009edae4"} Jun 09 12:48:57.939527 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:48:57.939149 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7fe794041bbd830bf13eb0bfa7e7aba9ca07dd1a4439963fe5fbf77009edae4" Jun 09 12:49:12.610456 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610417 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw"] Jun 09 12:49:12.610831 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610775 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="364ec1ee-6a3f-419d-a113-b6cb002bd1fa" containerName="util" Jun 09 12:49:12.610831 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610786 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="364ec1ee-6a3f-419d-a113-b6cb002bd1fa" containerName="util" Jun 09 12:49:12.610831 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610795 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="364ec1ee-6a3f-419d-a113-b6cb002bd1fa" containerName="pull" Jun 09 12:49:12.610831 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610800 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="364ec1ee-6a3f-419d-a113-b6cb002bd1fa" containerName="pull" Jun 09 12:49:12.610831 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610810 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7512463-aa6f-403d-82c2-0d3f29db4c3c" containerName="util" Jun 09 12:49:12.610831 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610815 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7512463-aa6f-403d-82c2-0d3f29db4c3c" containerName="util" Jun 09 12:49:12.610831 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610821 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c033176-3118-4265-a229-6962e90d5e0e" containerName="util" Jun 09 12:49:12.610831 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610826 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c033176-3118-4265-a229-6962e90d5e0e" containerName="util" Jun 09 12:49:12.610831 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610833 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c033176-3118-4265-a229-6962e90d5e0e" containerName="pull" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610839 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c033176-3118-4265-a229-6962e90d5e0e" containerName="pull" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610845 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50b280bf-88dd-4d35-a092-9fcd501cc792" containerName="util" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610850 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="50b280bf-88dd-4d35-a092-9fcd501cc792" containerName="util" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610855 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7512463-aa6f-403d-82c2-0d3f29db4c3c" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610860 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7512463-aa6f-403d-82c2-0d3f29db4c3c" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610869 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="364ec1ee-6a3f-419d-a113-b6cb002bd1fa" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610874 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="364ec1ee-6a3f-419d-a113-b6cb002bd1fa" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610882 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50b280bf-88dd-4d35-a092-9fcd501cc792" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610887 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="50b280bf-88dd-4d35-a092-9fcd501cc792" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610910 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7512463-aa6f-403d-82c2-0d3f29db4c3c" containerName="pull" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610915 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7512463-aa6f-403d-82c2-0d3f29db4c3c" containerName="pull" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610927 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c033176-3118-4265-a229-6962e90d5e0e" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610932 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c033176-3118-4265-a229-6962e90d5e0e" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610938 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50b280bf-88dd-4d35-a092-9fcd501cc792" containerName="pull" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.610943 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="50b280bf-88dd-4d35-a092-9fcd501cc792" containerName="pull" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.611012 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="50b280bf-88dd-4d35-a092-9fcd501cc792" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.611020 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c033176-3118-4265-a229-6962e90d5e0e" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.611026 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="364ec1ee-6a3f-419d-a113-b6cb002bd1fa" containerName="extract" Jun 09 12:49:12.611122 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.611032 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7512463-aa6f-403d-82c2-0d3f29db4c3c" containerName="extract" Jun 09 12:49:12.615264 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.615248 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:12.618868 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.618845 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:49:12.619049 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.618979 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gss86\"" Jun 09 12:49:12.620014 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.619999 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:49:12.631039 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.631018 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw"] Jun 09 12:49:12.699777 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.699745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6q6m\" (UniqueName: \"kubernetes.io/projected/a31e3851-0a4b-4723-85b8-665e7ec66174-kube-api-access-z6q6m\") pod \"limitador-operator-controller-manager-859d7b78bd-lf5mw\" (UID: \"a31e3851-0a4b-4723-85b8-665e7ec66174\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:12.801161 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.801119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6q6m\" (UniqueName: \"kubernetes.io/projected/a31e3851-0a4b-4723-85b8-665e7ec66174-kube-api-access-z6q6m\") pod \"limitador-operator-controller-manager-859d7b78bd-lf5mw\" (UID: \"a31e3851-0a4b-4723-85b8-665e7ec66174\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:12.813588 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.813558 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6q6m\" (UniqueName: \"kubernetes.io/projected/a31e3851-0a4b-4723-85b8-665e7ec66174-kube-api-access-z6q6m\") pod \"limitador-operator-controller-manager-859d7b78bd-lf5mw\" (UID: \"a31e3851-0a4b-4723-85b8-665e7ec66174\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:12.925630 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:12.925592 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:13.074366 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:13.074306 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw"] Jun 09 12:49:13.076682 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:49:13.076649 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31e3851_0a4b_4723_85b8_665e7ec66174.slice/crio-660cf7b72c2e4131132bcdb5578f4ec89d1f94cee5fd18a089d1b889fb1f1ef1 WatchSource:0}: Error finding container 660cf7b72c2e4131132bcdb5578f4ec89d1f94cee5fd18a089d1b889fb1f1ef1: Status 404 returned error can't find the container with id 660cf7b72c2e4131132bcdb5578f4ec89d1f94cee5fd18a089d1b889fb1f1ef1 Jun 09 12:49:14.030021 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.029987 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" event={"ID":"a31e3851-0a4b-4723-85b8-665e7ec66174","Type":"ContainerStarted","Data":"660cf7b72c2e4131132bcdb5578f4ec89d1f94cee5fd18a089d1b889fb1f1ef1"} Jun 09 12:49:14.849774 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.849746 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b45dd8fb5-vs9h7"] Jun 09 12:49:14.853515 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.853494 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:14.883479 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.883446 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b45dd8fb5-vs9h7"] Jun 09 12:49:14.919528 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.919496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5967e55d-815d-43ed-8275-48a6d56e0086-console-serving-cert\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:14.919709 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.919578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5967e55d-815d-43ed-8275-48a6d56e0086-console-oauth-config\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:14.919709 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.919611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-service-ca\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:14.919709 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.919653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-trusted-ca-bundle\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:14.919709 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.919704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-console-config\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:14.919942 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.919726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spmm7\" (UniqueName: \"kubernetes.io/projected/5967e55d-815d-43ed-8275-48a6d56e0086-kube-api-access-spmm7\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:14.919942 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:14.919779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-oauth-serving-cert\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.020889 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.020851 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5967e55d-815d-43ed-8275-48a6d56e0086-console-serving-cert\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.021111 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.020930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5967e55d-815d-43ed-8275-48a6d56e0086-console-oauth-config\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.021111 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.020963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-service-ca\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.021111 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.020995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-trusted-ca-bundle\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.021111 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.021052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-console-config\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.021111 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.021083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spmm7\" (UniqueName: \"kubernetes.io/projected/5967e55d-815d-43ed-8275-48a6d56e0086-kube-api-access-spmm7\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.021416 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.021134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-oauth-serving-cert\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.022111 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.022057 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-oauth-serving-cert\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.022301 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.022272 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-service-ca\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.022430 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.022337 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-console-config\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.022430 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.022361 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5967e55d-815d-43ed-8275-48a6d56e0086-trusted-ca-bundle\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.023849 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.023825 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5967e55d-815d-43ed-8275-48a6d56e0086-console-serving-cert\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.024024 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.023998 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5967e55d-815d-43ed-8275-48a6d56e0086-console-oauth-config\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.038139 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.038116 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spmm7\" (UniqueName: \"kubernetes.io/projected/5967e55d-815d-43ed-8275-48a6d56e0086-kube-api-access-spmm7\") pod \"console-7b45dd8fb5-vs9h7\" (UID: \"5967e55d-815d-43ed-8275-48a6d56e0086\") " pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.164794 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.164771 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:15.326315 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:15.326279 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b45dd8fb5-vs9h7"] Jun 09 12:49:15.328354 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:49:15.328332 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5967e55d_815d_43ed_8275_48a6d56e0086.slice/crio-cabfe93dbcef6b17307211fd42f29a5ea3301b7c8eb1a852dbc39093a11c747a WatchSource:0}: Error finding container cabfe93dbcef6b17307211fd42f29a5ea3301b7c8eb1a852dbc39093a11c747a: Status 404 returned error can't find the container with id cabfe93dbcef6b17307211fd42f29a5ea3301b7c8eb1a852dbc39093a11c747a Jun 09 12:49:16.047800 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:16.047761 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" event={"ID":"a31e3851-0a4b-4723-85b8-665e7ec66174","Type":"ContainerStarted","Data":"d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12"} Jun 09 12:49:16.048242 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:16.047823 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:16.049231 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:16.049208 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b45dd8fb5-vs9h7" event={"ID":"5967e55d-815d-43ed-8275-48a6d56e0086","Type":"ContainerStarted","Data":"90c37cdd0d1d99b72872f30a73beb1f5bfe6a5e7a9696d83f099286d0eda20d7"} Jun 09 12:49:16.049338 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:16.049249 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b45dd8fb5-vs9h7" event={"ID":"5967e55d-815d-43ed-8275-48a6d56e0086","Type":"ContainerStarted","Data":"cabfe93dbcef6b17307211fd42f29a5ea3301b7c8eb1a852dbc39093a11c747a"} Jun 09 12:49:16.069851 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:16.069804 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" podStartSLOduration=1.98659434 podStartE2EDuration="4.069790287s" totalImagesPullingTime="2.083195947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:49:16.069214527 +0000 UTC m=+492.903420794" watchObservedRunningTime="2026-06-09 12:49:16.069790287 +0000 UTC m=+492.903996552" Jun 09 12:49:16.114123 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:16.114070 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b45dd8fb5-vs9h7" podStartSLOduration=2.114052618 podStartE2EDuration="2.114052618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:49:16.112863599 +0000 UTC m=+492.947069865" watchObservedRunningTime="2026-06-09 12:49:16.114052618 +0000 UTC m=+492.948258884" Jun 09 12:49:18.888151 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:18.888099 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z"] Jun 09 12:49:18.891622 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:18.891601 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z" Jun 09 12:49:18.896024 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:18.896000 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 12:49:18.896156 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:18.896072 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-rdkr7\"" Jun 09 12:49:18.902560 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:18.902536 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z"] Jun 09 12:49:18.957570 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:18.957530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkdmv\" (UniqueName: \"kubernetes.io/projected/a5fd38e1-32aa-487e-b989-b24d99267a51-kube-api-access-rkdmv\") pod \"dns-operator-controller-manager-864dd78c4c-tvc2z\" (UID: \"a5fd38e1-32aa-487e-b989-b24d99267a51\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z" Jun 09 12:49:19.058043 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:19.058013 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkdmv\" (UniqueName: \"kubernetes.io/projected/a5fd38e1-32aa-487e-b989-b24d99267a51-kube-api-access-rkdmv\") pod \"dns-operator-controller-manager-864dd78c4c-tvc2z\" (UID: \"a5fd38e1-32aa-487e-b989-b24d99267a51\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z" Jun 09 12:49:19.068561 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:19.068530 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkdmv\" (UniqueName: \"kubernetes.io/projected/a5fd38e1-32aa-487e-b989-b24d99267a51-kube-api-access-rkdmv\") pod \"dns-operator-controller-manager-864dd78c4c-tvc2z\" (UID: \"a5fd38e1-32aa-487e-b989-b24d99267a51\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z" Jun 09 12:49:19.202995 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:19.202952 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z" Jun 09 12:49:19.339883 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:19.339856 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z"] Jun 09 12:49:19.341634 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:49:19.341609 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fd38e1_32aa_487e_b989_b24d99267a51.slice/crio-44690f74c0be583f17f1b74cfd66672b68e16d1ed105f3393c6643c606834dea WatchSource:0}: Error finding container 44690f74c0be583f17f1b74cfd66672b68e16d1ed105f3393c6643c606834dea: Status 404 returned error can't find the container with id 44690f74c0be583f17f1b74cfd66672b68e16d1ed105f3393c6643c606834dea Jun 09 12:49:20.073421 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:20.073376 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z" event={"ID":"a5fd38e1-32aa-487e-b989-b24d99267a51","Type":"ContainerStarted","Data":"44690f74c0be583f17f1b74cfd66672b68e16d1ed105f3393c6643c606834dea"} Jun 09 12:49:22.085996 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:22.085959 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z" event={"ID":"a5fd38e1-32aa-487e-b989-b24d99267a51","Type":"ContainerStarted","Data":"f22a9d51eff5a184027557c0bed7c2f2dae3ef52c7e27a9f84da50d5aaa78501"} Jun 09 12:49:22.086449 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:22.086087 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z" Jun 09 12:49:22.118973 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:22.118878 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z" podStartSLOduration=2.09365127 podStartE2EDuration="4.118837271s" totalImagesPullingTime="2.025186001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:49:22.117544635 +0000 UTC m=+498.951750923" watchObservedRunningTime="2026-06-09 12:49:22.118837271 +0000 UTC m=+498.953043537" Jun 09 12:49:25.165804 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:25.165764 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:25.166254 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:25.166090 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:25.170998 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:25.170975 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:26.112039 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:26.112008 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b45dd8fb5-vs9h7" Jun 09 12:49:26.210233 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:26.210197 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-847f55bf4f-df7xd"] Jun 09 12:49:27.056751 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:27.056721 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:30.832397 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:30.832363 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw"] Jun 09 12:49:30.832786 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:30.832534 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" podUID="a31e3851-0a4b-4723-85b8-665e7ec66174" containerName="manager" containerID="cri-o://d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12" gracePeriod=2 Jun 09 12:49:30.855217 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:49:30.855178 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a31e3851-0a4b-4723-85b8-665e7ec66174\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-lf5mw\": pods \"limitador-operator-controller-manager-859d7b78bd-lf5mw\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:30.857972 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:30.857948 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw"] Jun 09 12:49:30.958147 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:30.958112 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6"] Jun 09 12:49:30.958531 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:30.958506 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31e3851-0a4b-4723-85b8-665e7ec66174" containerName="manager" Jun 09 12:49:30.958531 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:30.958526 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31e3851-0a4b-4723-85b8-665e7ec66174" containerName="manager" Jun 09 12:49:30.958676 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:30.958609 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a31e3851-0a4b-4723-85b8-665e7ec66174" containerName="manager" Jun 09 12:49:30.961745 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:30.961727 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6" Jun 09 12:49:30.965046 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:49:30.965020 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lf5mw\" is forbidden: User \"system:node:ip-10-0-141-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-159.ec2.internal' and this object" podUID="a31e3851-0a4b-4723-85b8-665e7ec66174" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:30.981350 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:30.981322 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6"] Jun 09 12:49:31.066672 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.066645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9727v\" (UniqueName: \"kubernetes.io/projected/bf16a922-074d-4c28-8513-77485a770ebd-kube-api-access-9727v\") pod \"limitador-operator-controller-manager-859d7b78bd-pz6l6\" (UID: \"bf16a922-074d-4c28-8513-77485a770ebd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6" Jun 09 12:49:31.083833 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.083772 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:31.094127 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:49:31.094103 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lf5mw\" is forbidden: User \"system:node:ip-10-0-141-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-159.ec2.internal' and this object" podUID="a31e3851-0a4b-4723-85b8-665e7ec66174" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:31.137078 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.137045 2561 generic.go:356] "Generic (PLEG): container finished" podID="a31e3851-0a4b-4723-85b8-665e7ec66174" containerID="d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12" exitCode=0 Jun 09 12:49:31.137260 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.137094 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:31.137260 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.137125 2561 scope.go:117] "RemoveContainer" containerID="d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12" Jun 09 12:49:31.142844 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:49:31.142805 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lf5mw\" is forbidden: User \"system:node:ip-10-0-141-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-159.ec2.internal' and this object" podUID="a31e3851-0a4b-4723-85b8-665e7ec66174" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:31.146790 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.146771 2561 scope.go:117] "RemoveContainer" containerID="d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12" Jun 09 12:49:31.147128 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:49:31.147099 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12\": container with ID starting with d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12 not found: ID does not exist" containerID="d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12" Jun 09 12:49:31.147220 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.147135 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12"} err="failed to get container status \"d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12\": rpc error: code = NotFound desc = could not find container \"d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12\": container with ID starting with d076cecaa40256293365932316143ad35fc39c4ca923dee3a92ae2156e7b6a12 not found: ID does not exist" Jun 09 12:49:31.167530 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.167505 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6q6m\" (UniqueName: \"kubernetes.io/projected/a31e3851-0a4b-4723-85b8-665e7ec66174-kube-api-access-z6q6m\") pod \"a31e3851-0a4b-4723-85b8-665e7ec66174\" (UID: \"a31e3851-0a4b-4723-85b8-665e7ec66174\") " Jun 09 12:49:31.167647 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.167632 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9727v\" (UniqueName: \"kubernetes.io/projected/bf16a922-074d-4c28-8513-77485a770ebd-kube-api-access-9727v\") pod \"limitador-operator-controller-manager-859d7b78bd-pz6l6\" (UID: \"bf16a922-074d-4c28-8513-77485a770ebd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6" Jun 09 12:49:31.169781 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.169761 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31e3851-0a4b-4723-85b8-665e7ec66174-kube-api-access-z6q6m" (OuterVolumeSpecName: "kube-api-access-z6q6m") pod "a31e3851-0a4b-4723-85b8-665e7ec66174" (UID: "a31e3851-0a4b-4723-85b8-665e7ec66174"). InnerVolumeSpecName "kube-api-access-z6q6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:49:31.182399 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.182362 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9727v\" (UniqueName: \"kubernetes.io/projected/bf16a922-074d-4c28-8513-77485a770ebd-kube-api-access-9727v\") pod \"limitador-operator-controller-manager-859d7b78bd-pz6l6\" (UID: \"bf16a922-074d-4c28-8513-77485a770ebd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6" Jun 09 12:49:31.268714 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.268675 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6q6m\" (UniqueName: \"kubernetes.io/projected/a31e3851-0a4b-4723-85b8-665e7ec66174-kube-api-access-z6q6m\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:49:31.273521 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.273501 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6" Jun 09 12:49:31.419658 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.419633 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6"] Jun 09 12:49:31.420442 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:49:31.420419 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf16a922_074d_4c28_8513_77485a770ebd.slice/crio-a41756b8c31ec964186d4e493724cda31bde89c355a5e41e7bf1d902bd132866 WatchSource:0}: Error finding container a41756b8c31ec964186d4e493724cda31bde89c355a5e41e7bf1d902bd132866: Status 404 returned error can't find the container with id a41756b8c31ec964186d4e493724cda31bde89c355a5e41e7bf1d902bd132866 Jun 09 12:49:31.466061 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:49:31.466035 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lf5mw\" is forbidden: User \"system:node:ip-10-0-141-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-159.ec2.internal' and this object" podUID="a31e3851-0a4b-4723-85b8-665e7ec66174" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lf5mw" Jun 09 12:49:31.662583 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:31.662548 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a31e3851-0a4b-4723-85b8-665e7ec66174" path="/var/lib/kubelet/pods/a31e3851-0a4b-4723-85b8-665e7ec66174/volumes" Jun 09 12:49:32.151544 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:32.151514 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6" event={"ID":"bf16a922-074d-4c28-8513-77485a770ebd","Type":"ContainerStarted","Data":"8bf1c2d96d07a80c5e679c8fd940d0c002be17bc234393199919bf3084aa7992"} Jun 09 12:49:32.151953 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:32.151595 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6" event={"ID":"bf16a922-074d-4c28-8513-77485a770ebd","Type":"ContainerStarted","Data":"a41756b8c31ec964186d4e493724cda31bde89c355a5e41e7bf1d902bd132866"} Jun 09 12:49:32.151953 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:32.151624 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6" Jun 09 12:49:32.180473 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:32.180416 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6" podStartSLOduration=2.180401807 podStartE2EDuration="2.180401807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:49:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:49:32.178309665 +0000 UTC m=+509.012515932" watchObservedRunningTime="2026-06-09 12:49:32.180401807 +0000 UTC m=+509.014608072" Jun 09 12:49:33.094007 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:33.093980 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tvc2z" Jun 09 12:49:43.159363 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:43.159332 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pz6l6" Jun 09 12:49:51.232021 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.231930 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-847f55bf4f-df7xd" podUID="b12989fc-0b4a-4ea0-8994-4e46a71d896c" containerName="console" containerID="cri-o://5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f" gracePeriod=15 Jun 09 12:49:51.486493 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.486436 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:49:51.555222 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555194 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-trusted-ca-bundle\") pod \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " Jun 09 12:49:51.555222 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555225 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-service-ca\") pod \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " Jun 09 12:49:51.555437 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555263 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-config\") pod \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " Jun 09 12:49:51.555437 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555300 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-oauth-serving-cert\") pod \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " Jun 09 12:49:51.555437 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555331 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-serving-cert\") pod \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " Jun 09 12:49:51.555437 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555355 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-oauth-config\") pod \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " Jun 09 12:49:51.555437 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555382 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx9mp\" (UniqueName: \"kubernetes.io/projected/b12989fc-0b4a-4ea0-8994-4e46a71d896c-kube-api-access-hx9mp\") pod \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\" (UID: \"b12989fc-0b4a-4ea0-8994-4e46a71d896c\") " Jun 09 12:49:51.555703 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555666 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b12989fc-0b4a-4ea0-8994-4e46a71d896c" (UID: "b12989fc-0b4a-4ea0-8994-4e46a71d896c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:49:51.555792 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555765 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b12989fc-0b4a-4ea0-8994-4e46a71d896c" (UID: "b12989fc-0b4a-4ea0-8994-4e46a71d896c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:49:51.555792 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555777 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-config" (OuterVolumeSpecName: "console-config") pod "b12989fc-0b4a-4ea0-8994-4e46a71d896c" (UID: "b12989fc-0b4a-4ea0-8994-4e46a71d896c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:49:51.555981 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.555868 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-service-ca" (OuterVolumeSpecName: "service-ca") pod "b12989fc-0b4a-4ea0-8994-4e46a71d896c" (UID: "b12989fc-0b4a-4ea0-8994-4e46a71d896c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:49:51.557733 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.557698 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b12989fc-0b4a-4ea0-8994-4e46a71d896c" (UID: "b12989fc-0b4a-4ea0-8994-4e46a71d896c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:49:51.557848 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.557726 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b12989fc-0b4a-4ea0-8994-4e46a71d896c" (UID: "b12989fc-0b4a-4ea0-8994-4e46a71d896c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:49:51.557848 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.557798 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b12989fc-0b4a-4ea0-8994-4e46a71d896c-kube-api-access-hx9mp" (OuterVolumeSpecName: "kube-api-access-hx9mp") pod "b12989fc-0b4a-4ea0-8994-4e46a71d896c" (UID: "b12989fc-0b4a-4ea0-8994-4e46a71d896c"). InnerVolumeSpecName "kube-api-access-hx9mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:49:51.656359 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.656316 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:49:51.656359 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.656345 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-oauth-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:49:51.656359 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.656355 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-serving-cert\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:49:51.656359 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.656365 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12989fc-0b4a-4ea0-8994-4e46a71d896c-console-oauth-config\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:49:51.656616 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.656375 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx9mp\" (UniqueName: \"kubernetes.io/projected/b12989fc-0b4a-4ea0-8994-4e46a71d896c-kube-api-access-hx9mp\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:49:51.656616 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.656383 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-trusted-ca-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:49:51.656616 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:51.656391 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12989fc-0b4a-4ea0-8994-4e46a71d896c-service-ca\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:49:52.262320 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:52.262284 2561 generic.go:356] "Generic (PLEG): container finished" podID="b12989fc-0b4a-4ea0-8994-4e46a71d896c" containerID="5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f" exitCode=0 Jun 09 12:49:52.262731 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:52.262351 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847f55bf4f-df7xd" Jun 09 12:49:52.262731 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:52.262373 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847f55bf4f-df7xd" event={"ID":"b12989fc-0b4a-4ea0-8994-4e46a71d896c","Type":"ContainerDied","Data":"5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f"} Jun 09 12:49:52.262731 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:52.262422 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847f55bf4f-df7xd" event={"ID":"b12989fc-0b4a-4ea0-8994-4e46a71d896c","Type":"ContainerDied","Data":"8aa421b35bfcb17083bddd298d3480cb7baed40b8f491b42a1849a84384b330a"} Jun 09 12:49:52.262731 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:52.262443 2561 scope.go:117] "RemoveContainer" containerID="5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f" Jun 09 12:49:52.271645 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:52.271630 2561 scope.go:117] "RemoveContainer" containerID="5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f" Jun 09 12:49:52.271928 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:49:52.271888 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f\": container with ID starting with 5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f not found: ID does not exist" containerID="5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f" Jun 09 12:49:52.272001 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:52.271939 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f"} err="failed to get container status \"5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f\": rpc error: code = NotFound desc = could not find container \"5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f\": container with ID starting with 5146e2c52b23bd81621841f62ff05ee36e7569b422ba40344d3bbfef539f9d9f not found: ID does not exist" Jun 09 12:49:52.285781 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:52.285754 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-847f55bf4f-df7xd"] Jun 09 12:49:52.290851 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:52.290831 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-847f55bf4f-df7xd"] Jun 09 12:49:53.662370 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:49:53.662335 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b12989fc-0b4a-4ea0-8994-4e46a71d896c" path="/var/lib/kubelet/pods/b12989fc-0b4a-4ea0-8994-4e46a71d896c/volumes" Jun 09 12:50:04.094796 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.094713 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dq56w"] Jun 09 12:50:04.095182 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.095103 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b12989fc-0b4a-4ea0-8994-4e46a71d896c" containerName="console" Jun 09 12:50:04.095182 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.095115 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b12989fc-0b4a-4ea0-8994-4e46a71d896c" containerName="console" Jun 09 12:50:04.095255 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.095194 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b12989fc-0b4a-4ea0-8994-4e46a71d896c" containerName="console" Jun 09 12:50:04.100907 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.100877 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:04.103620 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.103596 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jjq7b\"" Jun 09 12:50:04.104472 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.104451 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 12:50:04.106926 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.106868 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dq56w"] Jun 09 12:50:04.175499 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.175467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-config-file\") pod \"limitador-limitador-64c94fd64f-dq56w\" (UID: \"1ab5bd06-c7a1-4bf9-af58-46fea58df72d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:04.175743 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.175509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r9vp\" (UniqueName: \"kubernetes.io/projected/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-kube-api-access-5r9vp\") pod \"limitador-limitador-64c94fd64f-dq56w\" (UID: \"1ab5bd06-c7a1-4bf9-af58-46fea58df72d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:04.191348 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.191315 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dq56w"] Jun 09 12:50:04.276308 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.276277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-config-file\") pod \"limitador-limitador-64c94fd64f-dq56w\" (UID: \"1ab5bd06-c7a1-4bf9-af58-46fea58df72d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:04.276500 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.276321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r9vp\" (UniqueName: \"kubernetes.io/projected/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-kube-api-access-5r9vp\") pod \"limitador-limitador-64c94fd64f-dq56w\" (UID: \"1ab5bd06-c7a1-4bf9-af58-46fea58df72d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:04.277095 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.277074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-config-file\") pod \"limitador-limitador-64c94fd64f-dq56w\" (UID: \"1ab5bd06-c7a1-4bf9-af58-46fea58df72d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:04.287037 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.287013 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r9vp\" (UniqueName: \"kubernetes.io/projected/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-kube-api-access-5r9vp\") pod \"limitador-limitador-64c94fd64f-dq56w\" (UID: \"1ab5bd06-c7a1-4bf9-af58-46fea58df72d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:04.412272 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.412238 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:04.556512 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:04.556487 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dq56w"] Jun 09 12:50:04.558548 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:50:04.558519 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab5bd06_c7a1_4bf9_af58_46fea58df72d.slice/crio-93728c52d485a9feba3108c6fa51e701e0d38592a3dd278362ff77e37a59124a WatchSource:0}: Error finding container 93728c52d485a9feba3108c6fa51e701e0d38592a3dd278362ff77e37a59124a: Status 404 returned error can't find the container with id 93728c52d485a9feba3108c6fa51e701e0d38592a3dd278362ff77e37a59124a Jun 09 12:50:05.349496 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:05.349386 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" event={"ID":"1ab5bd06-c7a1-4bf9-af58-46fea58df72d","Type":"ContainerStarted","Data":"93728c52d485a9feba3108c6fa51e701e0d38592a3dd278362ff77e37a59124a"} Jun 09 12:50:07.364910 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:07.364862 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" event={"ID":"1ab5bd06-c7a1-4bf9-af58-46fea58df72d","Type":"ContainerStarted","Data":"c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0"} Jun 09 12:50:07.365217 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:07.364959 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:07.385232 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:07.385180 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" podStartSLOduration=0.688779458 podStartE2EDuration="3.385165804s" totalImagesPullingTime="2.696386346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:50:07.384215856 +0000 UTC m=+544.218422139" watchObservedRunningTime="2026-06-09 12:50:07.385165804 +0000 UTC m=+544.219372069" Jun 09 12:50:18.372841 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:18.372809 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:19.253625 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:19.253590 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dq56w"] Jun 09 12:50:19.253809 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:19.253776 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" podUID="1ab5bd06-c7a1-4bf9-af58-46fea58df72d" containerName="limitador" containerID="cri-o://c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0" gracePeriod=30 Jun 09 12:50:19.807765 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:19.807739 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:19.929571 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:19.929536 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-config-file\") pod \"1ab5bd06-c7a1-4bf9-af58-46fea58df72d\" (UID: \"1ab5bd06-c7a1-4bf9-af58-46fea58df72d\") " Jun 09 12:50:19.929744 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:19.929576 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r9vp\" (UniqueName: \"kubernetes.io/projected/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-kube-api-access-5r9vp\") pod \"1ab5bd06-c7a1-4bf9-af58-46fea58df72d\" (UID: \"1ab5bd06-c7a1-4bf9-af58-46fea58df72d\") " Jun 09 12:50:19.929966 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:19.929935 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-config-file" (OuterVolumeSpecName: "config-file") pod "1ab5bd06-c7a1-4bf9-af58-46fea58df72d" (UID: "1ab5bd06-c7a1-4bf9-af58-46fea58df72d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:50:19.931672 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:19.931652 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-kube-api-access-5r9vp" (OuterVolumeSpecName: "kube-api-access-5r9vp") pod "1ab5bd06-c7a1-4bf9-af58-46fea58df72d" (UID: "1ab5bd06-c7a1-4bf9-af58-46fea58df72d"). InnerVolumeSpecName "kube-api-access-5r9vp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:50:20.030914 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.030878 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-config-file\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:50:20.031082 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.030928 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r9vp\" (UniqueName: \"kubernetes.io/projected/1ab5bd06-c7a1-4bf9-af58-46fea58df72d-kube-api-access-5r9vp\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:50:20.437823 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.437786 2561 generic.go:356] "Generic (PLEG): container finished" podID="1ab5bd06-c7a1-4bf9-af58-46fea58df72d" containerID="c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0" exitCode=0 Jun 09 12:50:20.438009 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.437831 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" Jun 09 12:50:20.438009 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.437859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" event={"ID":"1ab5bd06-c7a1-4bf9-af58-46fea58df72d","Type":"ContainerDied","Data":"c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0"} Jun 09 12:50:20.438009 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.437933 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dq56w" event={"ID":"1ab5bd06-c7a1-4bf9-af58-46fea58df72d","Type":"ContainerDied","Data":"93728c52d485a9feba3108c6fa51e701e0d38592a3dd278362ff77e37a59124a"} Jun 09 12:50:20.438009 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.437972 2561 scope.go:117] "RemoveContainer" containerID="c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0" Jun 09 12:50:20.447584 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.447566 2561 scope.go:117] "RemoveContainer" containerID="c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0" Jun 09 12:50:20.447839 ip-10-0-141-159 kubenswrapper[2561]: E0609 12:50:20.447822 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0\": container with ID starting with c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0 not found: ID does not exist" containerID="c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0" Jun 09 12:50:20.447925 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.447851 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0"} err="failed to get container status \"c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0\": rpc error: code = NotFound desc = could not find container \"c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0\": container with ID starting with c4cc7167fcea274abd67daecc33bd8802103c730a43353280dae0663907118a0 not found: ID does not exist" Jun 09 12:50:20.462546 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.462516 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dq56w"] Jun 09 12:50:20.464872 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:20.464852 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dq56w"] Jun 09 12:50:21.662517 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:21.662479 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ab5bd06-c7a1-4bf9-af58-46fea58df72d" path="/var/lib/kubelet/pods/1ab5bd06-c7a1-4bf9-af58-46fea58df72d/volumes" Jun 09 12:50:25.772317 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.772287 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj"] Jun 09 12:50:25.772928 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.772889 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ab5bd06-c7a1-4bf9-af58-46fea58df72d" containerName="limitador" Jun 09 12:50:25.772988 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.772933 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ab5bd06-c7a1-4bf9-af58-46fea58df72d" containerName="limitador" Jun 09 12:50:25.773061 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.773049 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ab5bd06-c7a1-4bf9-af58-46fea58df72d" containerName="limitador" Jun 09 12:50:25.777962 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.777932 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" Jun 09 12:50:25.780700 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.780672 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 09 12:50:25.780823 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.780742 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-69kfj\"" Jun 09 12:50:25.781694 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.781674 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 12:50:25.781817 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.781680 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 12:50:25.785395 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.785373 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj"] Jun 09 12:50:25.885559 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.885528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmf98\" (UniqueName: \"kubernetes.io/projected/5aa0da34-334a-444b-b087-fc543a03819b-kube-api-access-qmf98\") pod \"postgres-69fb4594cf-v5vtj\" (UID: \"5aa0da34-334a-444b-b087-fc543a03819b\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" Jun 09 12:50:25.885717 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.885570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5aa0da34-334a-444b-b087-fc543a03819b-data\") pod \"postgres-69fb4594cf-v5vtj\" (UID: \"5aa0da34-334a-444b-b087-fc543a03819b\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" Jun 09 12:50:25.986351 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.986319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmf98\" (UniqueName: \"kubernetes.io/projected/5aa0da34-334a-444b-b087-fc543a03819b-kube-api-access-qmf98\") pod \"postgres-69fb4594cf-v5vtj\" (UID: \"5aa0da34-334a-444b-b087-fc543a03819b\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" Jun 09 12:50:25.986351 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.986357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5aa0da34-334a-444b-b087-fc543a03819b-data\") pod \"postgres-69fb4594cf-v5vtj\" (UID: \"5aa0da34-334a-444b-b087-fc543a03819b\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" Jun 09 12:50:25.986684 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.986669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5aa0da34-334a-444b-b087-fc543a03819b-data\") pod \"postgres-69fb4594cf-v5vtj\" (UID: \"5aa0da34-334a-444b-b087-fc543a03819b\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" Jun 09 12:50:25.995213 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:25.995183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmf98\" (UniqueName: \"kubernetes.io/projected/5aa0da34-334a-444b-b087-fc543a03819b-kube-api-access-qmf98\") pod \"postgres-69fb4594cf-v5vtj\" (UID: \"5aa0da34-334a-444b-b087-fc543a03819b\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" Jun 09 12:50:26.090669 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:26.090571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" Jun 09 12:50:26.228205 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:26.228025 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj"] Jun 09 12:50:26.230988 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:50:26.230948 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa0da34_334a_444b_b087_fc543a03819b.slice/crio-5e3b93ee2567de43ed47202c44719478a93fe3888a7ee851dcbeb28b8fb3fd4f WatchSource:0}: Error finding container 5e3b93ee2567de43ed47202c44719478a93fe3888a7ee851dcbeb28b8fb3fd4f: Status 404 returned error can't find the container with id 5e3b93ee2567de43ed47202c44719478a93fe3888a7ee851dcbeb28b8fb3fd4f Jun 09 12:50:26.479661 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:26.479603 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" event={"ID":"5aa0da34-334a-444b-b087-fc543a03819b","Type":"ContainerStarted","Data":"5e3b93ee2567de43ed47202c44719478a93fe3888a7ee851dcbeb28b8fb3fd4f"} Jun 09 12:50:29.501098 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:29.501053 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" event={"ID":"5aa0da34-334a-444b-b087-fc543a03819b","Type":"ContainerStarted","Data":"78fd6aea2825a6f5f7eb7dd6e723a95f3dae4ff3e61c361c8befeebe3cc6575e"} Jun 09 12:50:29.501480 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:29.501173 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" Jun 09 12:50:29.522856 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:29.522805 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" podStartSLOduration=2.015859954 podStartE2EDuration="4.522790398s" totalImagesPullingTime="2.506930444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:50:29.5211922 +0000 UTC m=+566.355398468" watchObservedRunningTime="2026-06-09 12:50:29.522790398 +0000 UTC m=+566.356996663" Jun 09 12:50:35.543523 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:35.543493 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-v5vtj" Jun 09 12:50:37.224526 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.224492 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k"] Jun 09 12:50:37.230850 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.230828 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.234257 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.234236 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dbrkp\"" Jun 09 12:50:37.234417 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.234400 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:50:37.235244 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.235227 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:50:37.239381 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.239361 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k"] Jun 09 12:50:37.289658 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.289624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpdhq\" (UniqueName: \"kubernetes.io/projected/19a54f1e-3657-4a2a-8bde-01d6edba05bb-kube-api-access-qpdhq\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.289658 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.289663 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.289880 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.289683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.391306 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.391268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpdhq\" (UniqueName: \"kubernetes.io/projected/19a54f1e-3657-4a2a-8bde-01d6edba05bb-kube-api-access-qpdhq\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.391306 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.391305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.391544 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.391326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.391694 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.391675 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.391731 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.391684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.401614 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.401586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpdhq\" (UniqueName: \"kubernetes.io/projected/19a54f1e-3657-4a2a-8bde-01d6edba05bb-kube-api-access-qpdhq\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.541527 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.541442 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:37.711471 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:37.711445 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k"] Jun 09 12:50:37.712810 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:50:37.712781 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a54f1e_3657_4a2a_8bde_01d6edba05bb.slice/crio-ca9ec20f711821760b889a22d5549f5af1c20830997ddc80f67e3b6b817e696e WatchSource:0}: Error finding container ca9ec20f711821760b889a22d5549f5af1c20830997ddc80f67e3b6b817e696e: Status 404 returned error can't find the container with id ca9ec20f711821760b889a22d5549f5af1c20830997ddc80f67e3b6b817e696e Jun 09 12:50:38.554758 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:38.554719 2561 generic.go:356] "Generic (PLEG): container finished" podID="19a54f1e-3657-4a2a-8bde-01d6edba05bb" containerID="62db79078c21e559d860fccbf1415866acfee198e47af0217af4fa1e6f0186bc" exitCode=0 Jun 09 12:50:38.555243 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:38.554798 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" event={"ID":"19a54f1e-3657-4a2a-8bde-01d6edba05bb","Type":"ContainerDied","Data":"62db79078c21e559d860fccbf1415866acfee198e47af0217af4fa1e6f0186bc"} Jun 09 12:50:38.555243 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:38.554875 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" event={"ID":"19a54f1e-3657-4a2a-8bde-01d6edba05bb","Type":"ContainerStarted","Data":"ca9ec20f711821760b889a22d5549f5af1c20830997ddc80f67e3b6b817e696e"} Jun 09 12:50:39.561890 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:39.561857 2561 generic.go:356] "Generic (PLEG): container finished" podID="19a54f1e-3657-4a2a-8bde-01d6edba05bb" containerID="0ab9e3505e9fc80503f9faa4c5ed0017650aadcdec222db5fd7ab85f36b1b02e" exitCode=0 Jun 09 12:50:39.562323 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:39.561954 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" event={"ID":"19a54f1e-3657-4a2a-8bde-01d6edba05bb","Type":"ContainerDied","Data":"0ab9e3505e9fc80503f9faa4c5ed0017650aadcdec222db5fd7ab85f36b1b02e"} Jun 09 12:50:40.569850 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:40.569818 2561 generic.go:356] "Generic (PLEG): container finished" podID="19a54f1e-3657-4a2a-8bde-01d6edba05bb" containerID="a6fc8f8717f743adba5cb67e77f8ab2e8bd7d224c764008ad9dcab8140aa93a6" exitCode=0 Jun 09 12:50:40.570289 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:40.569914 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" event={"ID":"19a54f1e-3657-4a2a-8bde-01d6edba05bb","Type":"ContainerDied","Data":"a6fc8f8717f743adba5cb67e77f8ab2e8bd7d224c764008ad9dcab8140aa93a6"} Jun 09 12:50:41.722254 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:41.722228 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:41.833866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:41.833768 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-util\") pod \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " Jun 09 12:50:41.833866 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:41.833854 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-bundle\") pod \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " Jun 09 12:50:41.834145 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:41.833916 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpdhq\" (UniqueName: \"kubernetes.io/projected/19a54f1e-3657-4a2a-8bde-01d6edba05bb-kube-api-access-qpdhq\") pod \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\" (UID: \"19a54f1e-3657-4a2a-8bde-01d6edba05bb\") " Jun 09 12:50:41.834358 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:41.834323 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-bundle" (OuterVolumeSpecName: "bundle") pod "19a54f1e-3657-4a2a-8bde-01d6edba05bb" (UID: "19a54f1e-3657-4a2a-8bde-01d6edba05bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:50:41.836202 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:41.836179 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a54f1e-3657-4a2a-8bde-01d6edba05bb-kube-api-access-qpdhq" (OuterVolumeSpecName: "kube-api-access-qpdhq") pod "19a54f1e-3657-4a2a-8bde-01d6edba05bb" (UID: "19a54f1e-3657-4a2a-8bde-01d6edba05bb"). InnerVolumeSpecName "kube-api-access-qpdhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:50:41.839119 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:41.839095 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-util" (OuterVolumeSpecName: "util") pod "19a54f1e-3657-4a2a-8bde-01d6edba05bb" (UID: "19a54f1e-3657-4a2a-8bde-01d6edba05bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:50:41.935091 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:41.935051 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-bundle\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:50:41.935091 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:41.935084 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpdhq\" (UniqueName: \"kubernetes.io/projected/19a54f1e-3657-4a2a-8bde-01d6edba05bb-kube-api-access-qpdhq\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:50:41.935091 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:41.935096 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a54f1e-3657-4a2a-8bde-01d6edba05bb-util\") on node \"ip-10-0-141-159.ec2.internal\" DevicePath \"\"" Jun 09 12:50:42.583026 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:42.582994 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" Jun 09 12:50:42.583026 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:42.583007 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c4w7k" event={"ID":"19a54f1e-3657-4a2a-8bde-01d6edba05bb","Type":"ContainerDied","Data":"ca9ec20f711821760b889a22d5549f5af1c20830997ddc80f67e3b6b817e696e"} Jun 09 12:50:42.583229 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:50:42.583052 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca9ec20f711821760b889a22d5549f5af1c20830997ddc80f67e3b6b817e696e" Jun 09 12:51:02.136596 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.136557 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-g4cxj"] Jun 09 12:51:02.137014 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.136993 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a54f1e-3657-4a2a-8bde-01d6edba05bb" containerName="extract" Jun 09 12:51:02.137014 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.137006 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a54f1e-3657-4a2a-8bde-01d6edba05bb" containerName="extract" Jun 09 12:51:02.137014 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.137014 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a54f1e-3657-4a2a-8bde-01d6edba05bb" containerName="util" Jun 09 12:51:02.137123 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.137019 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a54f1e-3657-4a2a-8bde-01d6edba05bb" containerName="util" Jun 09 12:51:02.137123 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.137031 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a54f1e-3657-4a2a-8bde-01d6edba05bb" containerName="pull" Jun 09 12:51:02.137123 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.137036 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a54f1e-3657-4a2a-8bde-01d6edba05bb" containerName="pull" Jun 09 12:51:02.137123 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.137116 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a54f1e-3657-4a2a-8bde-01d6edba05bb" containerName="extract" Jun 09 12:51:02.140287 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.140267 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-g4cxj" Jun 09 12:51:02.142979 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.142959 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 12:51:02.143953 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.143935 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-5z2xz\"" Jun 09 12:51:02.144052 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.143936 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 12:51:02.153046 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.153023 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-g4cxj"] Jun 09 12:51:02.224973 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.224939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbfq2\" (UniqueName: \"kubernetes.io/projected/6edfaf64-c04e-4993-9190-9b77c3c1f346-kube-api-access-rbfq2\") pod \"keycloak-operator-d67dbbb48-g4cxj\" (UID: \"6edfaf64-c04e-4993-9190-9b77c3c1f346\") " pod="keycloak-system/keycloak-operator-d67dbbb48-g4cxj" Jun 09 12:51:02.325615 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.325579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbfq2\" (UniqueName: \"kubernetes.io/projected/6edfaf64-c04e-4993-9190-9b77c3c1f346-kube-api-access-rbfq2\") pod \"keycloak-operator-d67dbbb48-g4cxj\" (UID: \"6edfaf64-c04e-4993-9190-9b77c3c1f346\") " pod="keycloak-system/keycloak-operator-d67dbbb48-g4cxj" Jun 09 12:51:02.335459 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.335433 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbfq2\" (UniqueName: \"kubernetes.io/projected/6edfaf64-c04e-4993-9190-9b77c3c1f346-kube-api-access-rbfq2\") pod \"keycloak-operator-d67dbbb48-g4cxj\" (UID: \"6edfaf64-c04e-4993-9190-9b77c3c1f346\") " pod="keycloak-system/keycloak-operator-d67dbbb48-g4cxj" Jun 09 12:51:02.450752 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.450726 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-g4cxj" Jun 09 12:51:02.589227 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.589192 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-g4cxj"] Jun 09 12:51:02.591073 ip-10-0-141-159 kubenswrapper[2561]: W0609 12:51:02.591048 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6edfaf64_c04e_4993_9190_9b77c3c1f346.slice/crio-db691eb6cfefe9f74c75c9516ed85c1b2c680d9c918ba203362736bdfed342be WatchSource:0}: Error finding container db691eb6cfefe9f74c75c9516ed85c1b2c680d9c918ba203362736bdfed342be: Status 404 returned error can't find the container with id db691eb6cfefe9f74c75c9516ed85c1b2c680d9c918ba203362736bdfed342be Jun 09 12:51:02.695847 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:02.695802 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-g4cxj" event={"ID":"6edfaf64-c04e-4993-9190-9b77c3c1f346","Type":"ContainerStarted","Data":"db691eb6cfefe9f74c75c9516ed85c1b2c680d9c918ba203362736bdfed342be"} Jun 09 12:51:04.957405 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:04.957378 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9t7r9_06b10c0b-e96e-4be9-929a-247411e5eec3/ovn-acl-logging/0.log" Jun 09 12:51:04.959584 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:04.959559 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9t7r9_06b10c0b-e96e-4be9-929a-247411e5eec3/ovn-acl-logging/0.log" Jun 09 12:51:08.738958 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:08.738757 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-g4cxj" event={"ID":"6edfaf64-c04e-4993-9190-9b77c3c1f346","Type":"ContainerStarted","Data":"93dadc2f67d23927ee3086d359dee42e6bb0af097b6652ffc1d2407b87982999"} Jun 09 12:51:08.764937 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:51:08.764861 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-g4cxj" podStartSLOduration=0.887400709 podStartE2EDuration="6.764839232s" totalImagesPullingTime="5.877438523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:51:08.760189914 +0000 UTC m=+605.594396181" watchObservedRunningTime="2026-06-09 12:51:08.764839232 +0000 UTC m=+605.599045500" Jun 09 12:56:05.005729 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:56:05.005611 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9t7r9_06b10c0b-e96e-4be9-929a-247411e5eec3/ovn-acl-logging/0.log" Jun 09 12:56:05.009941 ip-10-0-141-159 kubenswrapper[2561]: I0609 12:56:05.007911 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9t7r9_06b10c0b-e96e-4be9-929a-247411e5eec3/ovn-acl-logging/0.log" Jun 09 13:00:00.178774 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.178735 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr"] Jun 09 13:00:00.182325 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.182309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr" Jun 09 13:00:00.186371 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.186351 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-9xzbx\"" Jun 09 13:00:00.194117 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.194094 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr"] Jun 09 13:00:00.240722 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.240693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25wz4\" (UniqueName: \"kubernetes.io/projected/d7234280-8944-4a35-b078-53945760a2ca-kube-api-access-25wz4\") pod \"maas-api-key-cleanup-29683500-nkkrr\" (UID: \"d7234280-8944-4a35-b078-53945760a2ca\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr" Jun 09 13:00:00.341270 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.341240 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25wz4\" (UniqueName: \"kubernetes.io/projected/d7234280-8944-4a35-b078-53945760a2ca-kube-api-access-25wz4\") pod \"maas-api-key-cleanup-29683500-nkkrr\" (UID: \"d7234280-8944-4a35-b078-53945760a2ca\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr" Jun 09 13:00:00.353552 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.353526 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25wz4\" (UniqueName: \"kubernetes.io/projected/d7234280-8944-4a35-b078-53945760a2ca-kube-api-access-25wz4\") pod \"maas-api-key-cleanup-29683500-nkkrr\" (UID: \"d7234280-8944-4a35-b078-53945760a2ca\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr" Jun 09 13:00:00.493440 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.493336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr" Jun 09 13:00:00.630332 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.630301 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr"] Jun 09 13:00:00.632089 ip-10-0-141-159 kubenswrapper[2561]: W0609 13:00:00.632058 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7234280_8944_4a35_b078_53945760a2ca.slice/crio-5ccdc6c935c841551cda7d282169e0da4f2b77b59353426a4cb81195238b2063 WatchSource:0}: Error finding container 5ccdc6c935c841551cda7d282169e0da4f2b77b59353426a4cb81195238b2063: Status 404 returned error can't find the container with id 5ccdc6c935c841551cda7d282169e0da4f2b77b59353426a4cb81195238b2063 Jun 09 13:00:00.634048 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.634030 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:00:00.742062 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:00.742020 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr" event={"ID":"d7234280-8944-4a35-b078-53945760a2ca","Type":"ContainerStarted","Data":"5ccdc6c935c841551cda7d282169e0da4f2b77b59353426a4cb81195238b2063"} Jun 09 13:00:07.786792 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:07.786753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr" event={"ID":"d7234280-8944-4a35-b078-53945760a2ca","Type":"ContainerStarted","Data":"24a2a813417c889407874ea69053c0a7003fbb84cecd3b49cd637d76ff812233"} Jun 09 13:00:07.811800 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:07.811749 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29683500-nkkrr" podStartSLOduration=1.8522121139999999 podStartE2EDuration="7.811734006s" totalImagesPullingTime="5.959521892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:00:07.808916259 +0000 UTC m=+1144.643122515" watchObservedRunningTime="2026-06-09 13:00:07.811734006 +0000 UTC m=+1144.645940273" Jun 09 13:00:16.627757 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:16.627721 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-574965d894-lkgj9_ac3528f4-ea58-4581-8735-a7c2daac8da8/nginx/0.log" Jun 09 13:00:16.756019 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:16.755985 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-5zwsd_2ce00ab7-5794-4ff1-bff8-b601b1bcf156/manager/0.log" Jun 09 13:00:16.882664 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:16.882573 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-mmkdz_977506c0-4d7d-4700-8ee6-a667e7c162bc/manager/0.log" Jun 09 13:00:17.773847 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:17.773813 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54544cfb76-kf5sx_c895a74d-9e5a-4a28-909a-35bdcfb2fccf/copy-manifests/0.log" Jun 09 13:00:17.788528 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:17.788480 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54544cfb76-kf5sx_c895a74d-9e5a-4a28-909a-35bdcfb2fccf/manager/0.log" Jun 09 13:00:18.582109 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:18.582080 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw_364ec1ee-6a3f-419d-a113-b6cb002bd1fa/pull/0.log" Jun 09 13:00:18.593591 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:18.593551 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw_364ec1ee-6a3f-419d-a113-b6cb002bd1fa/extract/0.log" Jun 09 13:00:18.602813 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:18.602790 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw_364ec1ee-6a3f-419d-a113-b6cb002bd1fa/util/0.log" Jun 09 13:00:18.722389 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:18.722362 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6_50b280bf-88dd-4d35-a092-9fcd501cc792/util/0.log" Jun 09 13:00:18.733741 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:18.733716 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6_50b280bf-88dd-4d35-a092-9fcd501cc792/pull/0.log" Jun 09 13:00:18.743523 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:18.743479 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6_50b280bf-88dd-4d35-a092-9fcd501cc792/extract/0.log" Jun 09 13:00:18.860299 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:18.860226 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq_a7512463-aa6f-403d-82c2-0d3f29db4c3c/util/0.log" Jun 09 13:00:18.872308 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:18.872289 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq_a7512463-aa6f-403d-82c2-0d3f29db4c3c/pull/0.log" Jun 09 13:00:18.881803 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:18.881780 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq_a7512463-aa6f-403d-82c2-0d3f29db4c3c/extract/0.log" Jun 09 13:00:19.008513 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:19.008488 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d_5c033176-3118-4265-a229-6962e90d5e0e/util/0.log" Jun 09 13:00:19.017488 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:19.017467 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d_5c033176-3118-4265-a229-6962e90d5e0e/pull/0.log" Jun 09 13:00:19.027151 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:19.027133 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d_5c033176-3118-4265-a229-6962e90d5e0e/extract/0.log" Jun 09 13:00:19.401760 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:19.401733 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tvc2z_a5fd38e1-32aa-487e-b989-b24d99267a51/manager/0.log" Jun 09 13:00:20.035530 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:20.035496 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pz6l6_bf16a922-074d-4c28-8513-77485a770ebd/manager/0.log" Jun 09 13:00:20.544109 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:20.544084 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8hwmb_c7f8e431-ac23-430d-ba15-e33b130b592a/discovery/0.log" Jun 09 13:00:20.787445 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:20.787411 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccb5f5468-m2qp5_e5b1a282-6765-4e19-a38f-0bdbeec908e1/kube-auth-proxy/0.log" Jun 09 13:00:21.267884 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:21.267854 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64486c75f5-wp64w_3663e150-f4a6-42c6-af57-df1fbd8df6f9/router/0.log" Jun 09 13:00:26.578959 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.578922 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m6d7h/must-gather-9k9lb"] Jun 09 13:00:26.582527 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.582509 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6d7h/must-gather-9k9lb" Jun 09 13:00:26.590124 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.590103 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6d7h\"/\"kube-root-ca.crt\"" Jun 09 13:00:26.590233 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.590167 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m6d7h\"/\"default-dockercfg-9hjpv\"" Jun 09 13:00:26.590233 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.590168 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6d7h\"/\"openshift-service-ca.crt\"" Jun 09 13:00:26.619159 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.619132 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6d7h/must-gather-9k9lb"] Jun 09 13:00:26.688588 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.688556 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e06b28e5-17c7-48a4-80c6-fe0288ffdf90-must-gather-output\") pod \"must-gather-9k9lb\" (UID: \"e06b28e5-17c7-48a4-80c6-fe0288ffdf90\") " pod="openshift-must-gather-m6d7h/must-gather-9k9lb" Jun 09 13:00:26.688750 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.688648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxbtj\" (UniqueName: \"kubernetes.io/projected/e06b28e5-17c7-48a4-80c6-fe0288ffdf90-kube-api-access-bxbtj\") pod \"must-gather-9k9lb\" (UID: \"e06b28e5-17c7-48a4-80c6-fe0288ffdf90\") " pod="openshift-must-gather-m6d7h/must-gather-9k9lb" Jun 09 13:00:26.789249 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.789217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e06b28e5-17c7-48a4-80c6-fe0288ffdf90-must-gather-output\") pod \"must-gather-9k9lb\" (UID: \"e06b28e5-17c7-48a4-80c6-fe0288ffdf90\") " pod="openshift-must-gather-m6d7h/must-gather-9k9lb" Jun 09 13:00:26.789456 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.789311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxbtj\" (UniqueName: \"kubernetes.io/projected/e06b28e5-17c7-48a4-80c6-fe0288ffdf90-kube-api-access-bxbtj\") pod \"must-gather-9k9lb\" (UID: \"e06b28e5-17c7-48a4-80c6-fe0288ffdf90\") " pod="openshift-must-gather-m6d7h/must-gather-9k9lb" Jun 09 13:00:26.789576 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.789552 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e06b28e5-17c7-48a4-80c6-fe0288ffdf90-must-gather-output\") pod \"must-gather-9k9lb\" (UID: \"e06b28e5-17c7-48a4-80c6-fe0288ffdf90\") " pod="openshift-must-gather-m6d7h/must-gather-9k9lb" Jun 09 13:00:26.801513 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.801482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxbtj\" (UniqueName: \"kubernetes.io/projected/e06b28e5-17c7-48a4-80c6-fe0288ffdf90-kube-api-access-bxbtj\") pod \"must-gather-9k9lb\" (UID: \"e06b28e5-17c7-48a4-80c6-fe0288ffdf90\") " pod="openshift-must-gather-m6d7h/must-gather-9k9lb" Jun 09 13:00:26.891692 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:26.891596 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6d7h/must-gather-9k9lb" Jun 09 13:00:27.045042 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:27.045021 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6d7h/must-gather-9k9lb"] Jun 09 13:00:27.047100 ip-10-0-141-159 kubenswrapper[2561]: W0609 13:00:27.047075 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode06b28e5_17c7_48a4_80c6_fe0288ffdf90.slice/crio-1d972f2cd39e47d4bd4175a0e795cd67c7dcf70112b6bfab9c6002dac041ee43 WatchSource:0}: Error finding container 1d972f2cd39e47d4bd4175a0e795cd67c7dcf70112b6bfab9c6002dac041ee43: Status 404 returned error can't find the container with id 1d972f2cd39e47d4bd4175a0e795cd67c7dcf70112b6bfab9c6002dac041ee43 Jun 09 13:00:27.902314 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:27.902254 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6d7h/must-gather-9k9lb" event={"ID":"e06b28e5-17c7-48a4-80c6-fe0288ffdf90","Type":"ContainerStarted","Data":"1d972f2cd39e47d4bd4175a0e795cd67c7dcf70112b6bfab9c6002dac041ee43"} Jun 09 13:00:28.909546 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:28.909511 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6d7h/must-gather-9k9lb" event={"ID":"e06b28e5-17c7-48a4-80c6-fe0288ffdf90","Type":"ContainerStarted","Data":"cea896bc3cb2dfb0b9929477a85fdcb413d4940445775ab71449a9fd3e1231d4"} Jun 09 13:00:28.910161 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:28.909595 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6d7h/must-gather-9k9lb" event={"ID":"e06b28e5-17c7-48a4-80c6-fe0288ffdf90","Type":"ContainerStarted","Data":"7e56695607754f074d92835332d44753c8280d7bbc7d21d7ac925daf5f598267"} Jun 09 13:00:28.948476 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:28.948421 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m6d7h/must-gather-9k9lb" podStartSLOduration=2.144688539 podStartE2EDuration="2.948404912s" totalImagesPullingTime="803.716373ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:00:28.942733043 +0000 UTC m=+1165.776939309" watchObservedRunningTime="2026-06-09 13:00:28.948404912 +0000 UTC m=+1165.782611226" Jun 09 13:00:29.833431 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:29.833397 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6mrv2_041086e4-a8c7-4333-a3d2-c02129f0370e/global-pull-secret-syncer/0.log" Jun 09 13:00:30.112457 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:30.112365 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kr72z_7f1e7bb4-8c89-4769-bee9-949a59fa4d6e/konnectivity-agent/0.log" Jun 09 13:00:30.221984 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:30.221958 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-159.ec2.internal_88c7314f7fb6629a9e73aba1ffec2ed4/haproxy/0.log" Jun 09 13:00:33.036127 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:33.036091 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-8mcq7_0198bca6-c4ed-4fd5-898e-e0dd34ef30cf/sail-operator/0.log" Jun 09 13:00:34.552183 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.552151 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw_364ec1ee-6a3f-419d-a113-b6cb002bd1fa/extract/0.log" Jun 09 13:00:34.582834 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.582804 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw_364ec1ee-6a3f-419d-a113-b6cb002bd1fa/util/0.log" Jun 09 13:00:34.610696 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.610664 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvpw_364ec1ee-6a3f-419d-a113-b6cb002bd1fa/pull/0.log" Jun 09 13:00:34.646416 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.646391 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6_50b280bf-88dd-4d35-a092-9fcd501cc792/extract/0.log" Jun 09 13:00:34.708392 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.708365 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6_50b280bf-88dd-4d35-a092-9fcd501cc792/util/0.log" Jun 09 13:00:34.739351 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.739326 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zldr6_50b280bf-88dd-4d35-a092-9fcd501cc792/pull/0.log" Jun 09 13:00:34.776252 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.776193 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq_a7512463-aa6f-403d-82c2-0d3f29db4c3c/extract/0.log" Jun 09 13:00:34.806781 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.806701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq_a7512463-aa6f-403d-82c2-0d3f29db4c3c/util/0.log" Jun 09 13:00:34.866444 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.866395 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739t8pq_a7512463-aa6f-403d-82c2-0d3f29db4c3c/pull/0.log" Jun 09 13:00:34.917110 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.917078 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d_5c033176-3118-4265-a229-6962e90d5e0e/extract/0.log" Jun 09 13:00:34.957257 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.957229 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d_5c033176-3118-4265-a229-6962e90d5e0e/util/0.log" Jun 09 13:00:34.993300 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:34.993260 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tfc9d_5c033176-3118-4265-a229-6962e90d5e0e/pull/0.log" Jun 09 13:00:35.105356 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:35.105270 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tvc2z_a5fd38e1-32aa-487e-b989-b24d99267a51/manager/0.log" Jun 09 13:00:35.317769 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:35.317695 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pz6l6_bf16a922-074d-4c28-8513-77485a770ebd/manager/0.log" Jun 09 13:00:37.072681 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.072655 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a28f63b-5744-4f95-87af-878710ab0981/alertmanager/0.log" Jun 09 13:00:37.130918 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.130838 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a28f63b-5744-4f95-87af-878710ab0981/config-reloader/0.log" Jun 09 13:00:37.192130 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.192024 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a28f63b-5744-4f95-87af-878710ab0981/kube-rbac-proxy-web/0.log" Jun 09 13:00:37.238777 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.238735 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a28f63b-5744-4f95-87af-878710ab0981/kube-rbac-proxy/0.log" Jun 09 13:00:37.276130 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.276101 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a28f63b-5744-4f95-87af-878710ab0981/kube-rbac-proxy-metric/0.log" Jun 09 13:00:37.307385 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.307354 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a28f63b-5744-4f95-87af-878710ab0981/prom-label-proxy/0.log" Jun 09 13:00:37.338243 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.338164 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4a28f63b-5744-4f95-87af-878710ab0981/init-config-reloader/0.log" Jun 09 13:00:37.388612 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.388577 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-hf6wl_cc35f9df-7c82-464e-b8bf-249067b49220/cluster-monitoring-operator/0.log" Jun 09 13:00:37.714688 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.714654 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxn6t_aaed2e0c-c35f-4805-8f37-b12b130a4fbb/node-exporter/0.log" Jun 09 13:00:37.745022 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.744988 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxn6t_aaed2e0c-c35f-4805-8f37-b12b130a4fbb/kube-rbac-proxy/0.log" Jun 09 13:00:37.774449 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.774410 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxn6t_aaed2e0c-c35f-4805-8f37-b12b130a4fbb/init-textfile/0.log" Jun 09 13:00:37.936789 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.936753 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ncrdj_31bcde57-4048-4466-ad74-47c6f8a57773/kube-rbac-proxy-main/0.log" Jun 09 13:00:37.968126 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:37.968031 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ncrdj_31bcde57-4048-4466-ad74-47c6f8a57773/kube-rbac-proxy-self/0.log" Jun 09 13:00:38.005939 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.005825 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ncrdj_31bcde57-4048-4466-ad74-47c6f8a57773/openshift-state-metrics/0.log" Jun 09 13:00:38.312031 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.311957 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-vg47r_02a84e2f-e32c-48df-bb09-eb3c56227bf5/prometheus-operator/0.log" Jun 09 13:00:38.349872 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.349819 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-vg47r_02a84e2f-e32c-48df-bb09-eb3c56227bf5/kube-rbac-proxy/0.log" Jun 09 13:00:38.387624 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.387599 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-kt59z_2fa240c8-5c4a-4742-87af-6b4b3aef35e3/prometheus-operator-admission-webhook/0.log" Jun 09 13:00:38.444023 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.443990 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75b7b654cb-f8gf2_79e5de4a-7f1c-4816-bf5e-a7cdc38da512/telemeter-client/0.log" Jun 09 13:00:38.488099 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.488069 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75b7b654cb-f8gf2_79e5de4a-7f1c-4816-bf5e-a7cdc38da512/reload/0.log" Jun 09 13:00:38.529412 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.529341 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75b7b654cb-f8gf2_79e5de4a-7f1c-4816-bf5e-a7cdc38da512/kube-rbac-proxy/0.log" Jun 09 13:00:38.575365 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.575286 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847759ffd7-tdlmg_3395edd9-e3d4-40f5-8e80-bd205205da71/thanos-query/0.log" Jun 09 13:00:38.639988 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.639957 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847759ffd7-tdlmg_3395edd9-e3d4-40f5-8e80-bd205205da71/kube-rbac-proxy-web/0.log" Jun 09 13:00:38.674403 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.674373 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847759ffd7-tdlmg_3395edd9-e3d4-40f5-8e80-bd205205da71/kube-rbac-proxy/0.log" Jun 09 13:00:38.708177 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.708144 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847759ffd7-tdlmg_3395edd9-e3d4-40f5-8e80-bd205205da71/prom-label-proxy/0.log" Jun 09 13:00:38.739805 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.739778 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847759ffd7-tdlmg_3395edd9-e3d4-40f5-8e80-bd205205da71/kube-rbac-proxy-rules/0.log" Jun 09 13:00:38.769968 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:38.769940 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847759ffd7-tdlmg_3395edd9-e3d4-40f5-8e80-bd205205da71/kube-rbac-proxy-metrics/0.log" Jun 09 13:00:40.358817 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.358775 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9"] Jun 09 13:00:40.363693 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.363667 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.374578 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.374549 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9"] Jun 09 13:00:40.446247 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.446199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-lib-modules\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.446460 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.446276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-proc\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.446460 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.446313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-sys\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.446460 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.446419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zcmt\" (UniqueName: \"kubernetes.io/projected/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-kube-api-access-8zcmt\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.446643 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.446518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-podres\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.547951 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.547265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zcmt\" (UniqueName: \"kubernetes.io/projected/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-kube-api-access-8zcmt\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.547951 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.547359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-podres\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.547951 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.547432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-lib-modules\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.547951 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.547473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-proc\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.547951 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.547505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-sys\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.547951 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.547615 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-sys\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.547951 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.547879 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-proc\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.547951 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.547928 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-lib-modules\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.547951 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.547949 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-podres\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.558089 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.558055 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zcmt\" (UniqueName: \"kubernetes.io/projected/998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c-kube-api-access-8zcmt\") pod \"perf-node-gather-daemonset-k4pp9\" (UID: \"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.678538 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.678282 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:40.901690 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:40.901642 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9"] Jun 09 13:00:40.906545 ip-10-0-141-159 kubenswrapper[2561]: W0609 13:00:40.906516 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod998f7f6e_a9a2_4c9d_9ae7_6fe1c5e18a3c.slice/crio-9a26bfddfbc508eac2d711a507b582eb8bce49daf1e0d23943dd73d3ac3dd87b WatchSource:0}: Error finding container 9a26bfddfbc508eac2d711a507b582eb8bce49daf1e0d23943dd73d3ac3dd87b: Status 404 returned error can't find the container with id 9a26bfddfbc508eac2d711a507b582eb8bce49daf1e0d23943dd73d3ac3dd87b Jun 09 13:00:41.026988 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:41.026872 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" event={"ID":"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c","Type":"ContainerStarted","Data":"9a26bfddfbc508eac2d711a507b582eb8bce49daf1e0d23943dd73d3ac3dd87b"} Jun 09 13:00:41.328056 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:41.327966 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b45dd8fb5-vs9h7_5967e55d-815d-43ed-8275-48a6d56e0086/console/0.log" Jun 09 13:00:41.370273 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:41.370243 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-gg8wk_5c1b105f-36bc-4329-9818-345645c301d7/download-server/0.log" Jun 09 13:00:42.037492 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:42.037454 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" event={"ID":"998f7f6e-a9a2-4c9d-9ae7-6fe1c5e18a3c","Type":"ContainerStarted","Data":"377874d262a15717191bc6b9cba2ccb213e7b2c72e7fc9b42e8b2918b2c67231"} Jun 09 13:00:42.038173 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:42.038143 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:42.058578 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:42.058509 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" podStartSLOduration=2.058489112 podStartE2EDuration="2.058489112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:00:42.055870247 +0000 UTC m=+1178.890076526" watchObservedRunningTime="2026-06-09 13:00:42.058489112 +0000 UTC m=+1178.892695379" Jun 09 13:00:43.251717 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:43.251684 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bqfl_34381811-6e19-40e6-8df5-247b4d109693/dns/0.log" Jun 09 13:00:43.285557 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:43.285512 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bqfl_34381811-6e19-40e6-8df5-247b4d109693/kube-rbac-proxy/0.log" Jun 09 13:00:43.386548 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:43.386518 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lclj7_88b63d7d-8180-44f1-9019-975a3d9ee716/dns-node-resolver/0.log" Jun 09 13:00:44.109390 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:44.109351 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fd4c9ddcb-bczwf_99309390-c91d-44b4-90b0-4c7f51b1d767/registry/0.log" Jun 09 13:00:44.202533 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:44.202504 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vr7cj_3a4cba33-4421-435a-b171-dad3b72060aa/node-ca/0.log" Jun 09 13:00:45.313106 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:45.313077 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8hwmb_c7f8e431-ac23-430d-ba15-e33b130b592a/discovery/0.log" Jun 09 13:00:45.376381 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:45.376351 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccb5f5468-m2qp5_e5b1a282-6765-4e19-a38f-0bdbeec908e1/kube-auth-proxy/0.log" Jun 09 13:00:45.499247 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:45.499213 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64486c75f5-wp64w_3663e150-f4a6-42c6-af57-df1fbd8df6f9/router/0.log" Jun 09 13:00:46.229496 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:46.229464 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6v7kd_c4440e5b-c9b4-4bbd-ab07-eb8ea1ae644a/serve-healthcheck-canary/0.log" Jun 09 13:00:47.086086 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:47.086059 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qxbwv_f357859a-df1c-43ab-8f28-86e3fd612051/kube-rbac-proxy/0.log" Jun 09 13:00:47.225012 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:47.224983 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qxbwv_f357859a-df1c-43ab-8f28-86e3fd612051/exporter/0.log" Jun 09 13:00:47.289388 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:47.289355 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qxbwv_f357859a-df1c-43ab-8f28-86e3fd612051/extractor/0.log" Jun 09 13:00:49.064862 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:49.064835 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-k4pp9" Jun 09 13:00:49.749196 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:49.749173 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-574965d894-lkgj9_ac3528f4-ea58-4581-8735-a7c2daac8da8/nginx/0.log" Jun 09 13:00:49.781165 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:49.781124 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-5zwsd_2ce00ab7-5794-4ff1-bff8-b601b1bcf156/manager/0.log" Jun 09 13:00:49.823972 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:49.823883 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-mmkdz_977506c0-4d7d-4700-8ee6-a667e7c162bc/manager/0.log" Jun 09 13:00:50.117786 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:50.117684 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54544cfb76-kf5sx_c895a74d-9e5a-4a28-909a-35bdcfb2fccf/manager/0.log" Jun 09 13:00:50.145750 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:50.145717 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54544cfb76-kf5sx_c895a74d-9e5a-4a28-909a-35bdcfb2fccf/copy-manifests/0.log" Jun 09 13:00:54.270238 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:54.270204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8hwmb_c7f8e431-ac23-430d-ba15-e33b130b592a/discovery/0.log" Jun 09 13:00:54.310462 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:54.310424 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccb5f5468-m2qp5_e5b1a282-6765-4e19-a38f-0bdbeec908e1/kube-auth-proxy/0.log" Jun 09 13:00:54.387461 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:54.387415 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64486c75f5-wp64w_3663e150-f4a6-42c6-af57-df1fbd8df6f9/router/0.log" Jun 09 13:00:55.591658 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:55.591610 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8hwmb_c7f8e431-ac23-430d-ba15-e33b130b592a/discovery/0.log" Jun 09 13:00:55.627144 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:55.627118 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccb5f5468-m2qp5_e5b1a282-6765-4e19-a38f-0bdbeec908e1/kube-auth-proxy/0.log" Jun 09 13:00:55.709951 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:55.709922 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64486c75f5-wp64w_3663e150-f4a6-42c6-af57-df1fbd8df6f9/router/0.log" Jun 09 13:00:57.629659 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:57.629629 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8hwmb_c7f8e431-ac23-430d-ba15-e33b130b592a/discovery/0.log" Jun 09 13:00:57.659754 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:57.659726 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccb5f5468-m2qp5_e5b1a282-6765-4e19-a38f-0bdbeec908e1/kube-auth-proxy/0.log" Jun 09 13:00:57.736089 ip-10-0-141-159 kubenswrapper[2561]: I0609 13:00:57.736060 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64486c75f5-wp64w_3663e150-f4a6-42c6-af57-df1fbd8df6f9/router/0.log"