Jun 13 01:58:14.455786 ip-10-0-141-22 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 13 01:58:14.455797 ip-10-0-141-22 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 13 01:58:14.455807 ip-10-0-141-22 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 13 01:58:14.456113 ip-10-0-141-22 systemd[1]: Failed to start Kubernetes Kubelet. Jun 13 01:58:24.527255 ip-10-0-141-22 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 13 01:58:24.527273 ip-10-0-141-22 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4c0ed7f813624ac69779375c23093e34 -- Jun 13 02:00:38.414284 ip-10-0-141-22 systemd[1]: Starting Kubernetes Kubelet... Jun 13 02:00:38.829792 ip-10-0-141-22 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 02:00:38.829792 ip-10-0-141-22 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 02:00:38.829792 ip-10-0-141-22 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 02:00:38.829792 ip-10-0-141-22 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 02:00:38.829792 ip-10-0-141-22 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 02:00:38.830939 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.830854 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 02:00:38.835117 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835103 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:38.835117 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835116 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835120 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835123 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835125 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835128 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835132 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835134 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835138 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835140 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835143 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835146 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835150 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835153 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835156 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835159 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835162 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835165 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835168 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835171 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835173 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:38.835182 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835176 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835178 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835181 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835184 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835186 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835189 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835194 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835198 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835201 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835204 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835206 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835211 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835215 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835218 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835221 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835224 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835227 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835229 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835232 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:38.835694 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835235 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835237 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835240 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835243 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835245 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835248 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835250 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835253 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835255 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835258 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835260 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835263 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835265 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835268 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835270 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835274 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835277 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835280 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835283 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835285 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:38.836186 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835288 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835291 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835293 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835296 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835299 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835301 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835304 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835307 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835309 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835312 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835315 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835318 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835320 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835323 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835325 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835328 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835331 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835333 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835336 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835338 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:38.836671 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835341 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835343 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835346 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835348 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835352 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835355 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835359 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835363 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835366 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835369 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835372 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835375 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835378 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835381 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835383 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835386 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835389 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835391 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.835394 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:38.837162 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836099 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836106 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836109 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836112 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836115 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836118 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836121 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836124 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836126 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836129 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836132 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836135 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836137 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836140 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836143 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836145 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836148 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836150 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836153 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836157 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:38.837625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836160 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836162 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836165 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836168 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836171 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836174 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836176 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836179 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836181 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836184 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836186 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836189 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836192 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836194 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836197 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836199 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836202 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836204 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836207 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:38.838174 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836211 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836213 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836216 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836218 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836221 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836223 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836226 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836230 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836234 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836237 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836240 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836242 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836247 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836250 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836253 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836256 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836259 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836261 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836264 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:38.838639 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836266 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836269 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836271 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836274 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836276 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836279 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836281 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836284 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836286 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836290 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836292 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836295 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836297 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836300 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836303 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836306 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836308 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836311 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836314 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:38.839124 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836316 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836319 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836321 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836324 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836327 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836330 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836334 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836336 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836339 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836342 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836344 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836347 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836350 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836353 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836355 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836358 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836360 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836363 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836366 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836368 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:38.839621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836371 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836373 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836736 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836741 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836744 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836747 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836751 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836753 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836756 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836758 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836761 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836768 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836770 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836773 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836776 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836779 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836783 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836786 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836788 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836791 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836793 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:38.840126 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836796 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836799 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836801 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836804 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836806 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836809 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836811 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836814 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836816 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836819 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836821 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836824 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836827 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836830 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836832 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836835 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836837 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836840 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836843 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836845 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:38.840645 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836848 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836850 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836854 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836857 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836860 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836862 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836865 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836870 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836873 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836877 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836880 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836884 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836887 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836890 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836893 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836897 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836900 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836902 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:38.841156 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836905 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836907 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836910 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836912 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836915 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836917 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836920 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836922 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836925 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836927 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836930 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836932 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836935 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836938 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836940 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836943 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836960 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836963 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836966 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:38.841593 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836968 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836972 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836976 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836979 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836981 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836984 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836986 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836989 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836991 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836994 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.836997 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837000 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837004 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837007 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837010 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837012 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837015 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837018 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837020 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837022 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:38.842067 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837025 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837027 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837030 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837097 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837103 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837109 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837113 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837117 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837120 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837127 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837131 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837135 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837138 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837141 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837146 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837149 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837151 2557 flags.go:64] FLAG: --cgroup-root="" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837154 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837157 2557 flags.go:64] FLAG: --client-ca-file="" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837160 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837163 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837168 2557 flags.go:64] FLAG: --cluster-domain="" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837171 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837175 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 02:00:38.842549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837178 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837181 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837185 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837188 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837190 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837194 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837196 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837199 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837202 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837205 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837208 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837212 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837215 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837218 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837221 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837224 2557 flags.go:64] FLAG: --enable-server="true" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837227 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837232 2557 flags.go:64] FLAG: --event-burst="100" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837235 2557 flags.go:64] FLAG: --event-qps="50" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837238 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837241 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837244 2557 flags.go:64] FLAG: --eviction-hard="" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837250 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837252 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837255 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 02:00:38.843145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837258 2557 flags.go:64] FLAG: --eviction-soft="" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837261 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837264 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837267 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837270 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837273 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837276 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837278 2557 flags.go:64] FLAG: --feature-gates="" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837282 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837285 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837288 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837291 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837294 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837296 2557 flags.go:64] FLAG: --help="false" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837300 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-141-22.ec2.internal" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837303 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837306 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837309 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837312 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837315 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837318 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837321 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837324 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 02:00:38.843769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837326 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837330 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837333 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837337 2557 flags.go:64] FLAG: --kube-reserved="" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837340 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837342 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837348 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837351 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837353 2557 flags.go:64] FLAG: --lock-file="" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837356 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837359 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837362 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837372 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837375 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837378 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837381 2557 flags.go:64] FLAG: --logging-format="text" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837384 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837387 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837390 2557 flags.go:64] FLAG: --manifest-url="" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837393 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837397 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837400 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837404 2557 flags.go:64] FLAG: --max-pods="110" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837407 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837410 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 02:00:38.844357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837413 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837416 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837419 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837422 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837425 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837432 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837435 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837438 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837441 2557 flags.go:64] FLAG: --pod-cidr="" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837445 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837451 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837454 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837457 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837461 2557 flags.go:64] FLAG: --port="10250" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837465 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837468 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01a6378e5dc5fd8e1" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837471 2557 flags.go:64] FLAG: --qos-reserved="" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837474 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837477 2557 flags.go:64] FLAG: --register-node="true" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837479 2557 flags.go:64] FLAG: --register-with-taints="" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837490 2557 flags.go:64] FLAG: --registry-burst="10" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837492 2557 flags.go:64] FLAG: --registry-qps="5" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837495 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837498 2557 flags.go:64] FLAG: --reserved-memory="" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837502 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 02:00:38.844958 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837505 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837508 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837510 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837513 2557 flags.go:64] FLAG: --runonce="false" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837516 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837519 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837522 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837524 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837527 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837530 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837533 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837537 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837540 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837543 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837545 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837548 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837551 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837555 2557 flags.go:64] FLAG: --system-cgroups="" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837557 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837563 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837567 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837570 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837574 2557 flags.go:64] FLAG: --tls-min-version="" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837576 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837579 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 02:00:38.845573 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837582 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837585 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837588 2557 flags.go:64] FLAG: --v="2" Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837592 2557 flags.go:64] FLAG: --version="false" Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837595 2557 flags.go:64] FLAG: --vmodule="" Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837599 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.837602 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837711 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837715 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837718 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837721 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837723 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837725 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837728 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837731 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837733 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837736 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837738 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837741 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837743 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837746 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:38.846191 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837748 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837751 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837754 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837757 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837760 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837763 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837766 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837769 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837772 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837774 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837777 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837780 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837783 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837785 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837788 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837790 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837793 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837795 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837798 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837801 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:38.846710 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837803 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837807 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837811 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837814 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837817 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837819 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837822 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837824 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837827 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837829 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837832 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837835 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837837 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837840 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837844 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837847 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837849 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837852 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837855 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:38.847348 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837858 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837861 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837863 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837866 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837870 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837873 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837877 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837880 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837882 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837885 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837888 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837891 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837894 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837896 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837899 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837901 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837904 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837908 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837911 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:38.847810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837915 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837918 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837920 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837923 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837925 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837928 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837930 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837933 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837938 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837941 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837943 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837959 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837963 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837965 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837968 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837971 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837973 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837976 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837979 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837981 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:38.848283 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837984 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837986 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837989 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837991 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837994 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837997 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.837999 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.839005 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.846111 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.846127 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.846147 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.846153 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846210 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846215 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846218 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:38.848760 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846221 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846224 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846227 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846230 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846233 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846237 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846241 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846244 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846247 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846250 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846253 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846255 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846258 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846261 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846263 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846266 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846269 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846271 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846274 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:38.849140 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846276 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846279 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846282 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846285 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846288 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846290 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846293 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846301 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846304 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846307 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846310 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846313 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846317 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846320 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846324 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846326 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846329 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846332 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846335 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:38.849606 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846338 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846340 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846343 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846346 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846349 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846352 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846355 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846357 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846360 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846362 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846365 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846367 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846370 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846372 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846375 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846377 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846380 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846382 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846385 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846388 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:38.850084 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846391 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846394 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846397 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846400 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846402 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846405 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846407 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846410 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846413 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846415 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846417 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846420 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846422 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846425 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846428 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846430 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846433 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846435 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846438 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846440 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:38.850570 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846443 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846445 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846448 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846451 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846453 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846456 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846458 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846461 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846464 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846467 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846469 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846472 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846474 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846477 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846480 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846483 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846486 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:38.851103 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846490 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.846495 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846608 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846614 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846617 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846620 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846623 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846626 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846628 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846631 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846633 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846636 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846638 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846641 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:38.851526 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846644 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846648 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846651 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846653 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846656 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846659 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846661 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846675 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846678 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846681 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846684 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846687 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846689 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846693 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846696 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846699 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846702 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846705 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846707 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846710 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:38.851868 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846713 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846715 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846718 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846721 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846723 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846727 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846731 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846734 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846737 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846740 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846742 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846745 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846748 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846751 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846753 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846756 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846759 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846761 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846764 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846767 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:38.852360 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846770 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846773 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846775 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846778 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846781 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846783 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846786 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846788 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846791 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846794 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846797 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846799 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846802 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846804 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846807 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846809 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846811 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846814 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846816 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:38.852835 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846819 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846821 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846824 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846826 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846829 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846831 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846834 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846836 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846839 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846841 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846844 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846846 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846849 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846852 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846854 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846856 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846859 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846861 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846864 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846866 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:38.853305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846869 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:38.853774 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846871 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:38.853774 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846873 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:38.853774 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846876 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:38.853774 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846879 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:38.853774 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846881 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:38.853774 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846884 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:38.853774 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:38.846886 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:38.853774 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.846891 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 02:00:38.853774 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.847037 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 02:00:38.853774 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.851873 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 02:00:38.854546 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.854533 2557 server.go:1019] "Starting client certificate rotation" Jun 13 02:00:38.854652 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.854637 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 02:00:38.854713 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.854703 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 02:00:38.857647 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.857632 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 02:00:38.862719 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.862695 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 02:00:38.874061 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.874044 2557 log.go:25] "Validated CRI v1 runtime API" Jun 13 02:00:38.877512 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.877495 2557 log.go:25] "Validated CRI v1 image API" Jun 13 02:00:38.878289 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.878274 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 02:00:38.881816 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.881794 2557 fs.go:135] Filesystem UUIDs: map[5ad1e58b-2f2f-4c01-9c45-b5609ec5067a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f4454ccd-dbbb-462e-a802-4f328672f973:/dev/nvme0n1p3] Jun 13 02:00:38.881907 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.881815 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 02:00:38.883518 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.883498 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 02:00:38.886989 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.886860 2557 manager.go:216] Machine: {Timestamp:2026-06-13 02:00:38.885532038 +0000 UTC m=+0.364682301 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100729 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec203f7b0e88b6493d635352a5b0ba11 SystemUUID:ec203f7b-0e88-b649-3d63-5352a5b0ba11 BootID:4c0ed7f8-1362-4ac6-9779-375c23093e34 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:fd:76:50:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:fd:76:50:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:29:1e:15:aa:79 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 02:00:38.886989 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.886983 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 02:00:38.887147 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.887121 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 02:00:38.890522 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.890499 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 02:00:38.890660 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.890525 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 02:00:38.891357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.891347 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 02:00:38.891388 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.891360 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 02:00:38.891388 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.891367 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 02:00:38.891450 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.891389 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 02:00:38.893257 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.893247 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 02:00:38.897778 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.897766 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 13 02:00:38.898054 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.898044 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 02:00:38.898099 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.898075 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 13 02:00:38.898099 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.898085 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 02:00:38.898170 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.898114 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 02:00:38.898170 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.898123 2557 kubelet.go:398] "Adding apiserver pod source" Jun 13 02:00:38.898170 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.898137 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 02:00:38.898670 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.898648 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 02:00:38.898705 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.898686 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 02:00:38.901916 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.901899 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 02:00:38.902086 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.902061 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xbws4" Jun 13 02:00:38.904016 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904003 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 02:00:38.904068 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904033 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 02:00:38.904183 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904173 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 02:00:38.904214 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904192 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 02:00:38.904214 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904200 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 02:00:38.904214 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904206 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 02:00:38.904214 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904214 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 02:00:38.904319 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904219 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 02:00:38.904944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904935 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 02:00:38.904994 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904944 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 02:00:38.904994 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904966 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 02:00:38.904994 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904972 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 02:00:38.904994 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904986 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 02:00:38.904994 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.904994 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 02:00:38.905793 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.905783 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 02:00:38.905793 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.905793 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 02:00:38.907695 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.907665 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-22.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 02:00:38.907746 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:38.907705 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 02:00:38.907839 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:38.907824 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 02:00:38.909047 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.909034 2557 server.go:1268] "Started kubelet" Jun 13 02:00:38.909156 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.909136 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 02:00:38.913603 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.913577 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xbws4" Jun 13 02:00:38.913734 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.909130 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 02:00:38.913734 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.913684 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 02:00:38.914148 ip-10-0-141-22 systemd[1]: Started Kubernetes Kubelet. Jun 13 02:00:38.916377 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.916358 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 13 02:00:38.916638 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.916381 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 02:00:38.922525 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:38.922507 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 02:00:38.925473 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.925460 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 02:00:38.925567 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.925551 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 02:00:38.925625 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:38.925582 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:38.926275 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926258 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 02:00:38.926275 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926277 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 02:00:38.926418 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926258 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 02:00:38.926418 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926407 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 13 02:00:38.926418 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926417 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 13 02:00:38.926525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926423 2557 factory.go:153] Registering CRI-O factory Jun 13 02:00:38.926525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926438 2557 factory.go:223] Registration of the crio container factory successfully Jun 13 02:00:38.926525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926477 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 02:00:38.926525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926485 2557 factory.go:55] Registering systemd factory Jun 13 02:00:38.926525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926491 2557 factory.go:223] Registration of the systemd container factory successfully Jun 13 02:00:38.926525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926509 2557 factory.go:103] Registering Raw factory Jun 13 02:00:38.926525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926522 2557 manager.go:1196] Started watching for new ooms in manager Jun 13 02:00:38.926975 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.926963 2557 manager.go:349] Starting recovery of all containers Jun 13 02:00:38.928160 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.928142 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:38.929981 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:38.929939 2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-22.ec2.internal\" not found" node="ip-10-0-141-22.ec2.internal" Jun 13 02:00:38.937773 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.937602 2557 manager.go:354] Recovery completed Jun 13 02:00:38.942165 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.942153 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:38.944080 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.944062 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:38.944138 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.944093 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:38.944138 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.944106 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:38.944602 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.944592 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:38.944638 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.944592 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 02:00:38.944638 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.944618 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 02:00:38.944638 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.944633 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 13 02:00:38.945283 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.945271 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:38.945339 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.945296 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:38.945339 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.945307 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:38.946753 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.946741 2557 policy_none.go:49] "None policy: Start" Jun 13 02:00:38.946793 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.946758 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 02:00:38.946793 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.946768 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 02:00:38.948638 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.948627 2557 policy_none.go:47] "Start" Jun 13 02:00:38.990550 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.990535 2557 manager.go:337] "Starting Device Plugin manager" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:38.990566 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.990579 2557 server.go:87] "Starting device plugin registration server" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.991027 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.991042 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.991184 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.991306 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:38.991318 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:38.993335 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:38.993410 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.000191 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.001233 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.001269 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.001292 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.001327 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 02:00:39.010886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.002764 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:39.091258 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.091186 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:39.092436 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.092419 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:39.092490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.092454 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:39.092490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.092466 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:39.092552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.092496 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.100900 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.100885 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.100945 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.100907 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-22.ec2.internal\": node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.102054 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.102036 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"] Jun 13 02:00:39.102101 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.102092 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:39.102945 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.102923 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:39.103066 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.102968 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:39.103066 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.102979 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:39.105208 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.105194 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:39.105328 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.105316 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.105367 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.105341 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:39.105853 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.105837 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:39.105853 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.105845 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:39.105965 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.105863 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:39.105965 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.105874 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:39.105965 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.105865 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:39.106061 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.105966 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:39.108018 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.108002 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.108090 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.108033 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:39.108227 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.108211 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.108668 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.108651 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:39.108727 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.108683 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:39.108727 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.108695 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:39.124491 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.124472 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-22.ec2.internal\" not found" node="ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.127747 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.127729 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7071f2b508a5b112d7ba4951ff65924d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-22.ec2.internal\" (UID: \"7071f2b508a5b112d7ba4951ff65924d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.127824 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.127756 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81823f7379209b6097c379f58127e624-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"81823f7379209b6097c379f58127e624\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.127824 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.127774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81823f7379209b6097c379f58127e624-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"81823f7379209b6097c379f58127e624\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.127904 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.127845 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-22.ec2.internal\" not found" node="ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.208663 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.208631 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.228528 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.228507 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7071f2b508a5b112d7ba4951ff65924d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-22.ec2.internal\" (UID: \"7071f2b508a5b112d7ba4951ff65924d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.228576 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.228536 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81823f7379209b6097c379f58127e624-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"81823f7379209b6097c379f58127e624\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.228576 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.228554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81823f7379209b6097c379f58127e624-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"81823f7379209b6097c379f58127e624\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.228675 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.228592 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81823f7379209b6097c379f58127e624-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"81823f7379209b6097c379f58127e624\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.228675 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.228597 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7071f2b508a5b112d7ba4951ff65924d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-22.ec2.internal\" (UID: \"7071f2b508a5b112d7ba4951ff65924d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.228675 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.228632 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81823f7379209b6097c379f58127e624-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"81823f7379209b6097c379f58127e624\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.309403 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.309368 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.410058 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.409983 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.427226 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.427201 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.432183 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.432167 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" Jun 13 02:00:39.511127 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.511098 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.611666 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.611638 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.712226 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.712156 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.812713 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.812683 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.853230 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.853205 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 02:00:39.853763 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.853338 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 02:00:39.853763 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.853358 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 02:00:39.913525 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:39.913496 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:39.921504 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.921470 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 01:55:38 +0000 UTC" deadline="2027-12-09 00:53:07.271557899 +0000 UTC" Jun 13 02:00:39.921504 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:39.921501 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13054h52m27.350059775s" Jun 13 02:00:40.014530 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:40.014462 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:40.077164 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:40.077130 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7071f2b508a5b112d7ba4951ff65924d.slice/crio-e1386d16361215cdf3fb59e85f8aa1fd87d43dbc2c1bda4c2243237366bd5666 WatchSource:0}: Error finding container e1386d16361215cdf3fb59e85f8aa1fd87d43dbc2c1bda4c2243237366bd5666: Status 404 returned error can't find the container with id e1386d16361215cdf3fb59e85f8aa1fd87d43dbc2c1bda4c2243237366bd5666 Jun 13 02:00:40.077380 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:40.077354 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81823f7379209b6097c379f58127e624.slice/crio-b05f80badc923a85b6fd191baee3933a29c8e4c969a0a8085a9493127ef625db WatchSource:0}: Error finding container b05f80badc923a85b6fd191baee3933a29c8e4c969a0a8085a9493127ef625db: Status 404 returned error can't find the container with id b05f80badc923a85b6fd191baee3933a29c8e4c969a0a8085a9493127ef625db Jun 13 02:00:40.081133 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.081114 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:00:40.114700 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:40.114678 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found" Jun 13 02:00:40.128143 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.128123 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:40.226387 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.226359 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" Jun 13 02:00:40.236345 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.236327 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 02:00:40.238321 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.238308 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" Jun 13 02:00:40.247259 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.247242 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 02:00:40.391444 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.391364 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:40.730102 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.730027 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:40.899601 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.899566 2557 apiserver.go:52] "Watching apiserver" Jun 13 02:00:40.907026 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.907000 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 02:00:40.909314 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.909276 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kjxpz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd","openshift-cluster-node-tuning-operator/tuned-lr2gx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal","openshift-multus/multus-8ckbb","openshift-multus/multus-additional-cni-plugins-t9phd","openshift-multus/network-metrics-daemon-5977q","openshift-ovn-kubernetes/ovnkube-node-9hg7w","kube-system/konnectivity-agent-qwmt8","kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal","openshift-dns/node-resolver-q9k7s","openshift-image-registry/node-ca-5np24","openshift-network-diagnostics/network-check-target-4qw44","openshift-network-operator/iptables-alerter-ttnkk"] Jun 13 02:00:40.911807 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.911785 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:40.911898 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:40.911854 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:00:40.914469 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.914452 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:40.918503 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.918479 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.918738 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.918716 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 02:00:40.919131 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.918881 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 02:00:40.919131 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.918989 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4s6kg\"" Jun 13 02:00:40.919280 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.919159 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 02:00:40.920793 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.920723 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:40.920793 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:40.920782 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:00:40.921070 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.921055 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ml7hz\"" Jun 13 02:00:40.921407 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.921351 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 02:00:40.921608 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.921592 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:00:40.923145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.923032 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.925250 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.925223 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 02:00:40.925368 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.925255 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:40.925368 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.925305 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 02:00:40.925522 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.925495 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 02:00:40.925876 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.925858 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x765p\"" Jun 13 02:00:40.925990 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.925913 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 02:00:40.926196 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.926173 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 02:00:40.927354 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.927338 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 02:00:40.927643 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.927625 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:40.927745 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:40.927692 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:00:40.928007 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.927986 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sdgbc\"" Jun 13 02:00:40.928214 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.928198 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 02:00:40.930019 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.930003 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:40.932469 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.932450 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 02:00:40.932567 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.932535 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z72bg\"" Jun 13 02:00:40.932567 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.932553 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 02:00:40.932677 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.932567 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 02:00:40.932751 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.932731 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 02:00:40.932935 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.932915 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 02:00:40.933029 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.932960 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 02:00:40.933437 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.933416 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:00:40.935497 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.935480 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5nprx\"" Jun 13 02:00:40.935632 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.935575 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 02:00:40.935733 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.935593 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 02:00:40.936228 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.936208 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 02:00:40.936353 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.936334 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:40.938333 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938311 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-device-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:40.938426 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938347 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f629165-2355-472e-990b-37bf4c1c13a7-kubelet-config\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:40.938426 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938375 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:40.938426 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938411 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fps67\" (UniqueName: \"kubernetes.io/projected/13cd278d-3a38-407f-8232-12187088b070-kube-api-access-fps67\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:40.938586 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938436 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-socket-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:40.938586 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938480 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-var-lib-kubelet\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.938586 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938512 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:00:40.938586 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938527 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-cni-dir\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.938586 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938537 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tdmj2\"" Jun 13 02:00:40.938586 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938553 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-cnibin\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.938586 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938585 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fa59b85-a03f-4aae-b8de-bffcf5f45275-cni-binary-copy\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.938921 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938607 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-run-k8s-cni-cncf-io\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.938921 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938646 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-run-multus-certs\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.938921 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938671 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13cd278d-3a38-407f-8232-12187088b070-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:40.938921 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938699 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/654567a0-4936-4f5d-ad8c-2df727933058-etc-tuned\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.938921 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/654567a0-4936-4f5d-ad8c-2df727933058-tmp\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.938921 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938746 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 02:00:40.938921 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938781 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 02:00:40.938921 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938782 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-sys-fs\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:40.938921 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938811 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-modprobe-d\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.938921 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-sysctl-d\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-os-release\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938981 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-var-lib-kubelet\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.938993 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939001 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-system-cni-dir\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939018 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-sysconfig\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-sysctl-conf\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-systemd\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939102 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czfbh\" (UniqueName: \"kubernetes.io/projected/654567a0-4936-4f5d-ad8c-2df727933058-kube-api-access-czfbh\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939134 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-socket-dir-parent\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939172 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-var-lib-cni-bin\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939201 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-var-lib-cni-multus\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939236 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-lib-modules\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939260 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-conf-dir\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp67r\" (UniqueName: \"kubernetes.io/projected/6fa59b85-a03f-4aae-b8de-bffcf5f45275-kube-api-access-mp67r\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939307 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-cnibin\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939352 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13cd278d-3a38-407f-8232-12187088b070-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:40.939398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939378 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939400 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thj7z\" (UniqueName: \"kubernetes.io/projected/c0366e70-4c1a-496c-9928-ac65525e6b37-kube-api-access-thj7z\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939426 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-registration-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939450 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939472 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-kubernetes\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939495 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f629165-2355-472e-990b-37bf4c1c13a7-dbus\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939522 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-system-cni-dir\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939546 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-run-netns\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939580 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-host\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939615 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-767bd\" (UniqueName: \"kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd\") pod \"network-check-target-4qw44\" (UID: \"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2\") " pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939645 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939671 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljq6x\" (UniqueName: \"kubernetes.io/projected/33678e6e-9c07-41fd-ba45-20b9a64517bc-kube-api-access-ljq6x\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939694 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-run\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939719 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-hostroot\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939741 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-daemon-config\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939772 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-sys\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:40.940081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939794 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-etc-kubernetes\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:40.940607 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939816 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-os-release\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:40.940607 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939838 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:40.940607 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.939863 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13cd278d-3a38-407f-8232-12187088b070-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:40.941317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.941266 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 02:00:40.941317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.941310 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dk2b6\"" Jun 13 02:00:40.941695 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.941673 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 02:00:40.942508 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.942489 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:40.945424 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.945086 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 02:00:40.945424 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.945091 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 02:00:40.945424 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.945169 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-whkfq\"" Jun 13 02:00:40.945424 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.945338 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 02:00:40.956492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.956473 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z4lk6" Jun 13 02:00:40.963659 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:40.963637 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z4lk6" Jun 13 02:00:41.006106 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.006023 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" event={"ID":"7071f2b508a5b112d7ba4951ff65924d","Type":"ContainerStarted","Data":"e1386d16361215cdf3fb59e85f8aa1fd87d43dbc2c1bda4c2243237366bd5666"} Jun 13 02:00:41.007315 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.007294 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" event={"ID":"81823f7379209b6097c379f58127e624","Type":"ContainerStarted","Data":"b05f80badc923a85b6fd191baee3933a29c8e4c969a0a8085a9493127ef625db"} Jun 13 02:00:41.027022 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.026996 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 02:00:41.040489 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040460 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91af975a-6f6a-42a4-89a1-5515884b1ff8-ovnkube-config\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.040623 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040503 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-registration-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.040623 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.040623 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-system-cni-dir\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.040778 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040673 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.040778 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040673 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-system-cni-dir\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.040778 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040695 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-registration-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.040778 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040748 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-run-netns\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040789 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6180dba6-1f27-479e-9a60-2e77d9399dbf-serviceca\") pod \"node-ca-5np24\" (UID: \"6180dba6-1f27-479e-9a60-2e77d9399dbf\") " pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040817 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-host\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040843 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767bd\" (UniqueName: \"kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd\") pod \"network-check-target-4qw44\" (UID: \"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2\") " pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040870 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040892 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-hostroot\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040791 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-run-netns\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040905 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-host\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040916 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-daemon-config\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040964 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.040989 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-hostroot\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.041028 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041001 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-os-release\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041072 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-os-release\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041074 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-sys\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041101 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041118 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-sys\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-var-lib-openvswitch\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041163 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-node-log\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041184 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-device-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041212 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fps67\" (UniqueName: \"kubernetes.io/projected/13cd278d-3a38-407f-8232-12187088b070-kube-api-access-fps67\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041234 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-systemd-units\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041262 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041267 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-device-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-socket-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041275 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.041368 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041393 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fa59b85-a03f-4aae-b8de-bffcf5f45275-cni-binary-copy\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.041523 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041398 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-socket-dir\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.041432 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs podName:c0366e70-4c1a-496c-9928-ac65525e6b37 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:41.54141138 +0000 UTC m=+3.020561649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs") pod "network-metrics-daemon-5977q" (UID: "c0366e70-4c1a-496c-9928-ac65525e6b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-run-multus-certs\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041496 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-run-multus-certs\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041516 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6180dba6-1f27-479e-9a60-2e77d9399dbf-host\") pod \"node-ca-5np24\" (UID: \"6180dba6-1f27-479e-9a60-2e77d9399dbf\") " pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-sys-fs\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041570 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-os-release\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041588 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-daemon-config\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041625 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33678e6e-9c07-41fd-ba45-20b9a64517bc-sys-fs\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041635 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-os-release\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041652 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-var-lib-kubelet\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-system-cni-dir\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041726 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-kubelet\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041753 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-sysconfig\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041763 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-system-cni-dir\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041727 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-var-lib-kubelet\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-systemd\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.042244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041831 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-sysconfig\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041835 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-systemd\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041845 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czfbh\" (UniqueName: \"kubernetes.io/projected/654567a0-4936-4f5d-ad8c-2df727933058-kube-api-access-czfbh\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041883 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-socket-dir-parent\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041899 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fa59b85-a03f-4aae-b8de-bffcf5f45275-cni-binary-copy\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041907 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-var-lib-cni-multus\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041939 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbkrn\" (UniqueName: \"kubernetes.io/projected/aa14882d-ac61-40d0-94f3-22037f5816ce-kube-api-access-gbkrn\") pod \"node-resolver-q9k7s\" (UID: \"aa14882d-ac61-40d0-94f3-22037f5816ce\") " pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041964 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-var-lib-cni-multus\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041971 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-socket-dir-parent\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.041981 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpvd2\" (UniqueName: \"kubernetes.io/projected/eae3be70-43ac-4d3f-b846-6401c8e66a41-kube-api-access-jpvd2\") pod \"iptables-alerter-ttnkk\" (UID: \"eae3be70-43ac-4d3f-b846-6401c8e66a41\") " pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042011 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-cni-bin\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eae3be70-43ac-4d3f-b846-6401c8e66a41-host-slash\") pod \"iptables-alerter-ttnkk\" (UID: \"eae3be70-43ac-4d3f-b846-6401c8e66a41\") " pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042076 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-run-netns\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-cni-netd\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042128 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-kubernetes\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042165 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f629165-2355-472e-990b-37bf4c1c13a7-dbus\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042188 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-kubernetes\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.043035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042203 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljq6x\" (UniqueName: \"kubernetes.io/projected/33678e6e-9c07-41fd-ba45-20b9a64517bc-kube-api-access-ljq6x\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-run\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042247 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa14882d-ac61-40d0-94f3-22037f5816ce-tmp-dir\") pod \"node-resolver-q9k7s\" (UID: \"aa14882d-ac61-40d0-94f3-22037f5816ce\") " pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042267 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eae3be70-43ac-4d3f-b846-6401c8e66a41-iptables-alerter-script\") pod \"iptables-alerter-ttnkk\" (UID: \"eae3be70-43ac-4d3f-b846-6401c8e66a41\") " pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042294 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-run-ovn\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042311 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f629165-2355-472e-990b-37bf4c1c13a7-dbus\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042317 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042336 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-run\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042347 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91af975a-6f6a-42a4-89a1-5515884b1ff8-ovnkube-script-lib\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042418 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-etc-kubernetes\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13cd278d-3a38-407f-8232-12187088b070-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042483 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzpgh\" (UniqueName: \"kubernetes.io/projected/6180dba6-1f27-479e-9a60-2e77d9399dbf-kube-api-access-nzpgh\") pod \"node-ca-5np24\" (UID: \"6180dba6-1f27-479e-9a60-2e77d9399dbf\") " pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042505 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-slash\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042532 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-log-socket\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042529 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-etc-kubernetes\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042567 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zrrf\" (UniqueName: \"kubernetes.io/projected/91af975a-6f6a-42a4-89a1-5515884b1ff8-kube-api-access-7zrrf\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042593 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f629165-2355-472e-990b-37bf4c1c13a7-kubelet-config\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:41.043757 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042618 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042650 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f8c7669-65bb-4d98-9e2d-01b933948394-konnectivity-ca\") pod \"konnectivity-agent-qwmt8\" (UID: \"9f8c7669-65bb-4d98-9e2d-01b933948394\") " pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042670 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f629165-2355-472e-990b-37bf4c1c13a7-kubelet-config\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042690 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa14882d-ac61-40d0-94f3-22037f5816ce-hosts-file\") pod \"node-resolver-q9k7s\" (UID: \"aa14882d-ac61-40d0-94f3-22037f5816ce\") " pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.042710 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042714 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-run-systemd\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91af975a-6f6a-42a4-89a1-5515884b1ff8-env-overrides\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.042756 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret podName:8f629165-2355-472e-990b-37bf4c1c13a7 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:41.542739666 +0000 UTC m=+3.021889920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret") pod "global-pull-secret-syncer-kjxpz" (UID: "8f629165-2355-472e-990b-37bf4c1c13a7") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042790 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thj7z\" (UniqueName: \"kubernetes.io/projected/c0366e70-4c1a-496c-9928-ac65525e6b37-kube-api-access-thj7z\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042817 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f8c7669-65bb-4d98-9e2d-01b933948394-agent-certs\") pod \"konnectivity-agent-qwmt8\" (UID: \"9f8c7669-65bb-4d98-9e2d-01b933948394\") " pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042842 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-var-lib-kubelet\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042865 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-cni-dir\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042892 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-cnibin\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042915 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-run-k8s-cni-cncf-io\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042932 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13cd278d-3a38-407f-8232-12187088b070-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042935 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-var-lib-kubelet\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13cd278d-3a38-407f-8232-12187088b070-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.044490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042998 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-cni-dir\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043012 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-cnibin\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.042999 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/654567a0-4936-4f5d-ad8c-2df727933058-etc-tuned\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043090 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/654567a0-4936-4f5d-ad8c-2df727933058-tmp\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043118 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-modprobe-d\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043141 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-sysctl-d\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-run-openvswitch\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043202 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91af975a-6f6a-42a4-89a1-5515884b1ff8-ovn-node-metrics-cert\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043275 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043317 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-run-k8s-cni-cncf-io\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043361 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-modprobe-d\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043430 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-sysctl-conf\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-var-lib-cni-bin\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043503 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-sysctl-d\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043513 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp67r\" (UniqueName: \"kubernetes.io/projected/6fa59b85-a03f-4aae-b8de-bffcf5f45275-kube-api-access-mp67r\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043538 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-cnibin\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043577 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-host-var-lib-cni-bin\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13cd278d-3a38-407f-8232-12187088b070-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.045370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043619 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-lib-modules\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.046221 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043650 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-conf-dir\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.046221 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043694 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13cd278d-3a38-407f-8232-12187088b070-cnibin\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.046221 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043700 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-etc-sysctl-conf\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.046221 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043511 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13cd278d-3a38-407f-8232-12187088b070-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.046221 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043756 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/654567a0-4936-4f5d-ad8c-2df727933058-lib-modules\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.046221 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.043804 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fa59b85-a03f-4aae-b8de-bffcf5f45275-multus-conf-dir\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.046221 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.044216 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13cd278d-3a38-407f-8232-12187088b070-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.046221 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.044268 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-etc-openvswitch\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.046659 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.046636 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/654567a0-4936-4f5d-ad8c-2df727933058-etc-tuned\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.046725 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.046680 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/654567a0-4936-4f5d-ad8c-2df727933058-tmp\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.050911 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.050873 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czfbh\" (UniqueName: \"kubernetes.io/projected/654567a0-4936-4f5d-ad8c-2df727933058-kube-api-access-czfbh\") pod \"tuned-lr2gx\" (UID: \"654567a0-4936-4f5d-ad8c-2df727933058\") " pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.051510 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.051489 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fps67\" (UniqueName: \"kubernetes.io/projected/13cd278d-3a38-407f-8232-12187088b070-kube-api-access-fps67\") pod \"multus-additional-cni-plugins-t9phd\" (UID: \"13cd278d-3a38-407f-8232-12187088b070\") " pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.051873 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.051839 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp67r\" (UniqueName: \"kubernetes.io/projected/6fa59b85-a03f-4aae-b8de-bffcf5f45275-kube-api-access-mp67r\") pod \"multus-8ckbb\" (UID: \"6fa59b85-a03f-4aae-b8de-bffcf5f45275\") " pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.052139 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.052112 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thj7z\" (UniqueName: \"kubernetes.io/projected/c0366e70-4c1a-496c-9928-ac65525e6b37-kube-api-access-thj7z\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:41.052347 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.052324 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljq6x\" (UniqueName: \"kubernetes.io/projected/33678e6e-9c07-41fd-ba45-20b9a64517bc-kube-api-access-ljq6x\") pod \"aws-ebs-csi-driver-node-4npxd\" (UID: \"33678e6e-9c07-41fd-ba45-20b9a64517bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.062468 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.062452 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:41.062546 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.062473 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:41.062546 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.062482 2557 projected.go:196] Error preparing data for projected volume kube-api-access-767bd for pod openshift-network-diagnostics/network-check-target-4qw44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:41.062546 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.062543 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd podName:e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:41.562523116 +0000 UTC m=+3.041673382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-767bd" (UniqueName: "kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd") pod "network-check-target-4qw44" (UID: "e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:41.144835 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.144799 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-var-lib-openvswitch\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.144835 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.144841 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-node-log\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.144870 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-systemd-units\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.144909 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6180dba6-1f27-479e-9a60-2e77d9399dbf-host\") pod \"node-ca-5np24\" (UID: \"6180dba6-1f27-479e-9a60-2e77d9399dbf\") " pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.144914 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-var-lib-openvswitch\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.144914 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-node-log\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.144936 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-kubelet\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.144980 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbkrn\" (UniqueName: \"kubernetes.io/projected/aa14882d-ac61-40d0-94f3-22037f5816ce-kube-api-access-gbkrn\") pod \"node-resolver-q9k7s\" (UID: \"aa14882d-ac61-40d0-94f3-22037f5816ce\") " pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.144984 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-systemd-units\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.144984 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6180dba6-1f27-479e-9a60-2e77d9399dbf-host\") pod \"node-ca-5np24\" (UID: \"6180dba6-1f27-479e-9a60-2e77d9399dbf\") " pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145006 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpvd2\" (UniqueName: \"kubernetes.io/projected/eae3be70-43ac-4d3f-b846-6401c8e66a41-kube-api-access-jpvd2\") pod \"iptables-alerter-ttnkk\" (UID: \"eae3be70-43ac-4d3f-b846-6401c8e66a41\") " pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145034 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-kubelet\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145049 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-cni-bin\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eae3be70-43ac-4d3f-b846-6401c8e66a41-host-slash\") pod \"iptables-alerter-ttnkk\" (UID: \"eae3be70-43ac-4d3f-b846-6401c8e66a41\") " pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145099 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-run-netns\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145122 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-cni-netd\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145149 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa14882d-ac61-40d0-94f3-22037f5816ce-tmp-dir\") pod \"node-resolver-q9k7s\" (UID: \"aa14882d-ac61-40d0-94f3-22037f5816ce\") " pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145172 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eae3be70-43ac-4d3f-b846-6401c8e66a41-iptables-alerter-script\") pod \"iptables-alerter-ttnkk\" (UID: \"eae3be70-43ac-4d3f-b846-6401c8e66a41\") " pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145191 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-run-netns\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145228 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-cni-netd\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145260 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-cni-bin\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145194 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-run-ovn\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145292 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eae3be70-43ac-4d3f-b846-6401c8e66a41-host-slash\") pod \"iptables-alerter-ttnkk\" (UID: \"eae3be70-43ac-4d3f-b846-6401c8e66a41\") " pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145322 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-run-ovn\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145337 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91af975a-6f6a-42a4-89a1-5515884b1ff8-ovnkube-script-lib\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzpgh\" (UniqueName: \"kubernetes.io/projected/6180dba6-1f27-479e-9a60-2e77d9399dbf-kube-api-access-nzpgh\") pod \"node-ca-5np24\" (UID: \"6180dba6-1f27-479e-9a60-2e77d9399dbf\") " pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145389 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-slash\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145394 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145412 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-log-socket\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.145597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145436 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zrrf\" (UniqueName: \"kubernetes.io/projected/91af975a-6f6a-42a4-89a1-5515884b1ff8-kube-api-access-7zrrf\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145473 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f8c7669-65bb-4d98-9e2d-01b933948394-konnectivity-ca\") pod \"konnectivity-agent-qwmt8\" (UID: \"9f8c7669-65bb-4d98-9e2d-01b933948394\") " pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145500 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa14882d-ac61-40d0-94f3-22037f5816ce-hosts-file\") pod \"node-resolver-q9k7s\" (UID: \"aa14882d-ac61-40d0-94f3-22037f5816ce\") " pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145522 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-run-systemd\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145545 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91af975a-6f6a-42a4-89a1-5515884b1ff8-env-overrides\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145569 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f8c7669-65bb-4d98-9e2d-01b933948394-agent-certs\") pod \"konnectivity-agent-qwmt8\" (UID: \"9f8c7669-65bb-4d98-9e2d-01b933948394\") " pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-run-openvswitch\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145628 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91af975a-6f6a-42a4-89a1-5515884b1ff8-ovn-node-metrics-cert\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145629 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-slash\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145523 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa14882d-ac61-40d0-94f3-22037f5816ce-tmp-dir\") pod \"node-resolver-q9k7s\" (UID: \"aa14882d-ac61-40d0-94f3-22037f5816ce\") " pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145651 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-log-socket\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145703 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-etc-openvswitch\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145659 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-etc-openvswitch\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145722 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa14882d-ac61-40d0-94f3-22037f5816ce-hosts-file\") pod \"node-resolver-q9k7s\" (UID: \"aa14882d-ac61-40d0-94f3-22037f5816ce\") " pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145745 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91af975a-6f6a-42a4-89a1-5515884b1ff8-ovnkube-config\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145748 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-run-systemd\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145764 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-run-openvswitch\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145775 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6180dba6-1f27-479e-9a60-2e77d9399dbf-serviceca\") pod \"node-ca-5np24\" (UID: \"6180dba6-1f27-479e-9a60-2e77d9399dbf\") " pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:41.146212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145824 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.147115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145882 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91af975a-6f6a-42a4-89a1-5515884b1ff8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.147115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.145883 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eae3be70-43ac-4d3f-b846-6401c8e66a41-iptables-alerter-script\") pod \"iptables-alerter-ttnkk\" (UID: \"eae3be70-43ac-4d3f-b846-6401c8e66a41\") " pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:41.147115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.146234 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6180dba6-1f27-479e-9a60-2e77d9399dbf-serviceca\") pod \"node-ca-5np24\" (UID: \"6180dba6-1f27-479e-9a60-2e77d9399dbf\") " pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:41.147115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.146257 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/91af975a-6f6a-42a4-89a1-5515884b1ff8-ovnkube-script-lib\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.147115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.146281 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f8c7669-65bb-4d98-9e2d-01b933948394-konnectivity-ca\") pod \"konnectivity-agent-qwmt8\" (UID: \"9f8c7669-65bb-4d98-9e2d-01b933948394\") " pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:00:41.147115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.146527 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/91af975a-6f6a-42a4-89a1-5515884b1ff8-env-overrides\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.147115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.146707 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/91af975a-6f6a-42a4-89a1-5515884b1ff8-ovnkube-config\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.148492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.148470 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/91af975a-6f6a-42a4-89a1-5515884b1ff8-ovn-node-metrics-cert\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.148585 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.148504 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f8c7669-65bb-4d98-9e2d-01b933948394-agent-certs\") pod \"konnectivity-agent-qwmt8\" (UID: \"9f8c7669-65bb-4d98-9e2d-01b933948394\") " pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:00:41.153359 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.153335 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpvd2\" (UniqueName: \"kubernetes.io/projected/eae3be70-43ac-4d3f-b846-6401c8e66a41-kube-api-access-jpvd2\") pod \"iptables-alerter-ttnkk\" (UID: \"eae3be70-43ac-4d3f-b846-6401c8e66a41\") " pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:41.153477 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.153336 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zrrf\" (UniqueName: \"kubernetes.io/projected/91af975a-6f6a-42a4-89a1-5515884b1ff8-kube-api-access-7zrrf\") pod \"ovnkube-node-9hg7w\" (UID: \"91af975a-6f6a-42a4-89a1-5515884b1ff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.153763 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.153742 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbkrn\" (UniqueName: \"kubernetes.io/projected/aa14882d-ac61-40d0-94f3-22037f5816ce-kube-api-access-gbkrn\") pod \"node-resolver-q9k7s\" (UID: \"aa14882d-ac61-40d0-94f3-22037f5816ce\") " pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:41.154441 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.154420 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzpgh\" (UniqueName: \"kubernetes.io/projected/6180dba6-1f27-479e-9a60-2e77d9399dbf-kube-api-access-nzpgh\") pod \"node-ca-5np24\" (UID: \"6180dba6-1f27-479e-9a60-2e77d9399dbf\") " pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:41.227446 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.227414 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" Jun 13 02:00:41.232776 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.232756 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" Jun 13 02:00:41.244360 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.244339 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8ckbb" Jun 13 02:00:41.249061 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.249045 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:00:41.254545 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.254527 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9phd" Jun 13 02:00:41.261130 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.261114 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:00:41.269637 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.269618 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ttnkk" Jun 13 02:00:41.275219 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.275195 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q9k7s" Jun 13 02:00:41.279661 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.279645 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5np24" Jun 13 02:00:41.294433 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.294413 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:41.549001 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.548923 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:41.549124 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.549046 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:41.549124 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.549051 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:41.549188 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.549088 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:41.549223 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.549161 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret podName:8f629165-2355-472e-990b-37bf4c1c13a7 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:42.54913954 +0000 UTC m=+4.028289801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret") pod "global-pull-secret-syncer-kjxpz" (UID: "8f629165-2355-472e-990b-37bf4c1c13a7") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:41.549223 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.549210 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs podName:c0366e70-4c1a-496c-9928-ac65525e6b37 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:42.549196015 +0000 UTC m=+4.028346265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs") pod "network-metrics-daemon-5977q" (UID: "c0366e70-4c1a-496c-9928-ac65525e6b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:41.650207 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.650175 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767bd\" (UniqueName: \"kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd\") pod \"network-check-target-4qw44\" (UID: \"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2\") " pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:41.650385 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.650335 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:41.650385 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.650359 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:41.650385 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.650372 2557 projected.go:196] Error preparing data for projected volume kube-api-access-767bd for pod openshift-network-diagnostics/network-check-target-4qw44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:41.650510 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:41.650431 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd podName:e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:42.650414848 +0000 UTC m=+4.129565120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-767bd" (UniqueName: "kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd") pod "network-check-target-4qw44" (UID: "e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:41.966670 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.966638 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:55:40 +0000 UTC" deadline="2028-02-22 00:06:13.183338222 +0000 UTC" Jun 13 02:00:41.966670 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:41.966671 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14854h5m31.21667206s" Jun 13 02:00:41.967777 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:41.967745 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33678e6e_9c07_41fd_ba45_20b9a64517bc.slice/crio-22c83bf6dd1dac8e2acdcb73dffa93ed6c958859aa32a23dc5c15ec2f45729b0 WatchSource:0}: Error finding container 22c83bf6dd1dac8e2acdcb73dffa93ed6c958859aa32a23dc5c15ec2f45729b0: Status 404 returned error can't find the container with id 22c83bf6dd1dac8e2acdcb73dffa93ed6c958859aa32a23dc5c15ec2f45729b0 Jun 13 02:00:41.970340 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:41.970318 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91af975a_6f6a_42a4_89a1_5515884b1ff8.slice/crio-d8dc809fe38a71c182357e37d85cde0551a5355b7400e9c6b4d8ab2e39b16b1b WatchSource:0}: Error finding container d8dc809fe38a71c182357e37d85cde0551a5355b7400e9c6b4d8ab2e39b16b1b: Status 404 returned error can't find the container with id d8dc809fe38a71c182357e37d85cde0551a5355b7400e9c6b4d8ab2e39b16b1b Jun 13 02:00:41.990652 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:41.990622 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8c7669_65bb_4d98_9e2d_01b933948394.slice/crio-2939d68a0f7b9cf65bbc500966052a1f5cf34bc1063db7dbc0dc96e62d115a78 WatchSource:0}: Error finding container 2939d68a0f7b9cf65bbc500966052a1f5cf34bc1063db7dbc0dc96e62d115a78: Status 404 returned error can't find the container with id 2939d68a0f7b9cf65bbc500966052a1f5cf34bc1063db7dbc0dc96e62d115a78 Jun 13 02:00:41.991361 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:41.991343 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa59b85_a03f_4aae_b8de_bffcf5f45275.slice/crio-f3bcf87f5ed0223ab70389ca748fa0c43527c77b888be1f968c000dd4f662734 WatchSource:0}: Error finding container f3bcf87f5ed0223ab70389ca748fa0c43527c77b888be1f968c000dd4f662734: Status 404 returned error can't find the container with id f3bcf87f5ed0223ab70389ca748fa0c43527c77b888be1f968c000dd4f662734 Jun 13 02:00:41.992246 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:41.992166 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae3be70_43ac_4d3f_b846_6401c8e66a41.slice/crio-b3cc65e59db97cf6f00049689f27f7d7ef3f9851c71db705b9d72582176f5e8c WatchSource:0}: Error finding container b3cc65e59db97cf6f00049689f27f7d7ef3f9851c71db705b9d72582176f5e8c: Status 404 returned error can't find the container with id b3cc65e59db97cf6f00049689f27f7d7ef3f9851c71db705b9d72582176f5e8c Jun 13 02:00:41.994237 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:41.994193 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa14882d_ac61_40d0_94f3_22037f5816ce.slice/crio-0969268597e89ab904aab8098ef8fde34e4d346fd636f147384dbeed8d4f32a4 WatchSource:0}: Error finding container 0969268597e89ab904aab8098ef8fde34e4d346fd636f147384dbeed8d4f32a4: Status 404 returned error can't find the container with id 0969268597e89ab904aab8098ef8fde34e4d346fd636f147384dbeed8d4f32a4 Jun 13 02:00:41.995056 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:41.995027 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654567a0_4936_4f5d_ad8c_2df727933058.slice/crio-bb20906d1f03309aeb3606d8e9860f7e34e9561c85d79c8c789899d3fc2aa1be WatchSource:0}: Error finding container bb20906d1f03309aeb3606d8e9860f7e34e9561c85d79c8c789899d3fc2aa1be: Status 404 returned error can't find the container with id bb20906d1f03309aeb3606d8e9860f7e34e9561c85d79c8c789899d3fc2aa1be Jun 13 02:00:41.995279 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:41.995236 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13cd278d_3a38_407f_8232_12187088b070.slice/crio-03985b130950787ab5b0a5eeae9a715e5a94ecd87ec1e639e9a67e4f9c20ee9b WatchSource:0}: Error finding container 03985b130950787ab5b0a5eeae9a715e5a94ecd87ec1e639e9a67e4f9c20ee9b: Status 404 returned error can't find the container with id 03985b130950787ab5b0a5eeae9a715e5a94ecd87ec1e639e9a67e4f9c20ee9b Jun 13 02:00:41.996026 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:00:41.995997 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6180dba6_1f27_479e_9a60_2e77d9399dbf.slice/crio-170b26fd70256ddaa28649745a73d480f4c7f7d1adf9b8c32f823431a8c6a182 WatchSource:0}: Error finding container 170b26fd70256ddaa28649745a73d480f4c7f7d1adf9b8c32f823431a8c6a182: Status 404 returned error can't find the container with id 170b26fd70256ddaa28649745a73d480f4c7f7d1adf9b8c32f823431a8c6a182 Jun 13 02:00:42.002230 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.002197 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:42.002230 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.002211 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:42.002365 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:42.002310 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:00:42.002459 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:42.002420 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:00:42.010221 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.010197 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" event={"ID":"654567a0-4936-4f5d-ad8c-2df727933058","Type":"ContainerStarted","Data":"bb20906d1f03309aeb3606d8e9860f7e34e9561c85d79c8c789899d3fc2aa1be"} Jun 13 02:00:42.011205 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.011184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q9k7s" event={"ID":"aa14882d-ac61-40d0-94f3-22037f5816ce","Type":"ContainerStarted","Data":"0969268597e89ab904aab8098ef8fde34e4d346fd636f147384dbeed8d4f32a4"} Jun 13 02:00:42.012440 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.012418 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8ckbb" event={"ID":"6fa59b85-a03f-4aae-b8de-bffcf5f45275","Type":"ContainerStarted","Data":"f3bcf87f5ed0223ab70389ca748fa0c43527c77b888be1f968c000dd4f662734"} Jun 13 02:00:42.013704 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.013530 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qwmt8" event={"ID":"9f8c7669-65bb-4d98-9e2d-01b933948394","Type":"ContainerStarted","Data":"2939d68a0f7b9cf65bbc500966052a1f5cf34bc1063db7dbc0dc96e62d115a78"} Jun 13 02:00:42.014708 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.014622 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" event={"ID":"91af975a-6f6a-42a4-89a1-5515884b1ff8","Type":"ContainerStarted","Data":"d8dc809fe38a71c182357e37d85cde0551a5355b7400e9c6b4d8ab2e39b16b1b"} Jun 13 02:00:42.015681 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.015662 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" event={"ID":"33678e6e-9c07-41fd-ba45-20b9a64517bc","Type":"ContainerStarted","Data":"22c83bf6dd1dac8e2acdcb73dffa93ed6c958859aa32a23dc5c15ec2f45729b0"} Jun 13 02:00:42.016597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.016580 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5np24" event={"ID":"6180dba6-1f27-479e-9a60-2e77d9399dbf","Type":"ContainerStarted","Data":"170b26fd70256ddaa28649745a73d480f4c7f7d1adf9b8c32f823431a8c6a182"} Jun 13 02:00:42.017546 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.017530 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9phd" event={"ID":"13cd278d-3a38-407f-8232-12187088b070","Type":"ContainerStarted","Data":"03985b130950787ab5b0a5eeae9a715e5a94ecd87ec1e639e9a67e4f9c20ee9b"} Jun 13 02:00:42.018557 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.018537 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ttnkk" event={"ID":"eae3be70-43ac-4d3f-b846-6401c8e66a41","Type":"ContainerStarted","Data":"b3cc65e59db97cf6f00049689f27f7d7ef3f9851c71db705b9d72582176f5e8c"} Jun 13 02:00:42.557019 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.556928 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:42.557178 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.557131 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:42.557243 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:42.557071 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:42.557307 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:42.557262 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs podName:c0366e70-4c1a-496c-9928-ac65525e6b37 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:44.55724318 +0000 UTC m=+6.036393434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs") pod "network-metrics-daemon-5977q" (UID: "c0366e70-4c1a-496c-9928-ac65525e6b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:42.557576 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:42.557208 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:42.557646 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:42.557619 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret podName:8f629165-2355-472e-990b-37bf4c1c13a7 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:44.557602794 +0000 UTC m=+6.036753049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret") pod "global-pull-secret-syncer-kjxpz" (UID: "8f629165-2355-472e-990b-37bf4c1c13a7") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:42.659012 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.658434 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767bd\" (UniqueName: \"kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd\") pod \"network-check-target-4qw44\" (UID: \"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2\") " pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:42.659012 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:42.658588 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:42.659012 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:42.658608 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:42.659012 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:42.658621 2557 projected.go:196] Error preparing data for projected volume kube-api-access-767bd for pod openshift-network-diagnostics/network-check-target-4qw44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:42.659012 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:42.658681 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd podName:e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:44.658663797 +0000 UTC m=+6.137814053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-767bd" (UniqueName: "kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd") pod "network-check-target-4qw44" (UID: "e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:42.968262 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.968159 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:55:40 +0000 UTC" deadline="2028-02-15 07:33:27.240046499 +0000 UTC" Jun 13 02:00:42.968262 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:42.968211 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14693h32m44.271839095s" Jun 13 02:00:43.004535 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:43.004475 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:43.004726 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:43.004597 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:00:43.026703 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:43.026667 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" event={"ID":"7071f2b508a5b112d7ba4951ff65924d","Type":"ContainerStarted","Data":"adbb0f48994c47a3e29364121bdc219a1ab714d62c47e78c1a11e435e4295310"} Jun 13 02:00:43.039108 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:43.039076 2557 generic.go:356] "Generic (PLEG): container finished" podID="81823f7379209b6097c379f58127e624" containerID="3c8df2482992f433ae5965c91de172c26f9cd00ed84fe369954e1b58e5471c61" exitCode=0 Jun 13 02:00:43.039270 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:43.039123 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" event={"ID":"81823f7379209b6097c379f58127e624","Type":"ContainerDied","Data":"3c8df2482992f433ae5965c91de172c26f9cd00ed84fe369954e1b58e5471c61"} Jun 13 02:00:43.041416 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:43.040330 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" podStartSLOduration=3.040313009 podStartE2EDuration="3.040313009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:43.040103502 +0000 UTC m=+4.519253780" watchObservedRunningTime="2026-06-13 02:00:43.040313009 +0000 UTC m=+4.519463282" Jun 13 02:00:44.002088 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:44.002058 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:44.002524 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:44.002192 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:00:44.002524 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:44.002267 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:44.002524 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:44.002343 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:00:44.073978 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:44.073895 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" event={"ID":"81823f7379209b6097c379f58127e624","Type":"ContainerStarted","Data":"f7256a9aa41854841c33ef23d56745190f113ac480636005ef1e9e500d705385"} Jun 13 02:00:44.577536 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:44.577490 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:44.577731 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:44.577546 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:44.577731 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:44.577675 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:44.577731 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:44.577730 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret podName:8f629165-2355-472e-990b-37bf4c1c13a7 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:48.577713829 +0000 UTC m=+10.056864087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret") pod "global-pull-secret-syncer-kjxpz" (UID: "8f629165-2355-472e-990b-37bf4c1c13a7") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:44.578080 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:44.578003 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:44.578080 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:44.578058 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs podName:c0366e70-4c1a-496c-9928-ac65525e6b37 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:48.578042723 +0000 UTC m=+10.057192977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs") pod "network-metrics-daemon-5977q" (UID: "c0366e70-4c1a-496c-9928-ac65525e6b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:44.678531 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:44.678465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767bd\" (UniqueName: \"kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd\") pod \"network-check-target-4qw44\" (UID: \"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2\") " pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:44.678699 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:44.678653 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:44.678699 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:44.678675 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:44.678699 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:44.678687 2557 projected.go:196] Error preparing data for projected volume kube-api-access-767bd for pod openshift-network-diagnostics/network-check-target-4qw44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:44.678860 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:44.678738 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd podName:e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:48.67872128 +0000 UTC m=+10.157871533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-767bd" (UniqueName: "kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd") pod "network-check-target-4qw44" (UID: "e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:45.004496 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:45.004414 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:45.004926 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:45.004540 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:00:46.002314 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:46.002258 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:46.002508 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:46.002401 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:00:46.002925 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:46.002776 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:46.002925 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:46.002878 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:00:47.002258 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:47.002216 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:47.002666 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:47.002361 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:00:48.002087 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:48.002051 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:48.002087 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:48.002076 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:48.002342 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:48.002186 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:00:48.002601 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:48.002555 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:00:48.610845 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:48.610801 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:48.611056 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:48.610874 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:48.611056 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:48.611001 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:48.611175 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:48.611002 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:48.611175 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:48.611077 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret podName:8f629165-2355-472e-990b-37bf4c1c13a7 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:56.611056887 +0000 UTC m=+18.090207138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret") pod "global-pull-secret-syncer-kjxpz" (UID: "8f629165-2355-472e-990b-37bf4c1c13a7") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:48.611175 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:48.611133 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs podName:c0366e70-4c1a-496c-9928-ac65525e6b37 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:56.611104367 +0000 UTC m=+18.090254619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs") pod "network-metrics-daemon-5977q" (UID: "c0366e70-4c1a-496c-9928-ac65525e6b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:48.711366 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:48.711288 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767bd\" (UniqueName: \"kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd\") pod \"network-check-target-4qw44\" (UID: \"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2\") " pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:48.711542 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:48.711431 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:48.711542 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:48.711452 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:48.711542 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:48.711463 2557 projected.go:196] Error preparing data for projected volume kube-api-access-767bd for pod openshift-network-diagnostics/network-check-target-4qw44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:48.711542 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:48.711526 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd podName:e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:56.711509528 +0000 UTC m=+18.190659778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-767bd" (UniqueName: "kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd") pod "network-check-target-4qw44" (UID: "e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:49.002819 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:49.002735 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:49.003702 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:49.003673 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:00:50.002198 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:50.002170 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:50.002375 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:50.002273 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:00:50.002375 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:50.002326 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:50.002487 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:50.002381 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:00:51.001847 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:51.001815 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:51.002360 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:51.001966 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:00:52.002051 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:52.002020 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:52.002465 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:52.002020 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:52.002465 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:52.002145 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:00:52.002465 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:52.002194 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:00:53.001649 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:53.001605 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:53.001826 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:53.001744 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:00:54.002085 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:54.002052 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:54.002085 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:54.002092 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:54.002528 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:54.002190 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:00:54.002528 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:54.002267 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:00:55.001961 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:55.001920 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:55.002143 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:55.002106 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:00:56.001677 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:56.001638 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:56.001677 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:56.001665 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:56.001983 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:56.001757 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:00:56.001983 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:56.001895 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:00:56.671453 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:56.671410 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:56.671932 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:56.671493 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:56.671932 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:56.671586 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:56.671932 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:56.671642 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs podName:c0366e70-4c1a-496c-9928-ac65525e6b37 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:12.671626759 +0000 UTC m=+34.150777010 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs") pod "network-metrics-daemon-5977q" (UID: "c0366e70-4c1a-496c-9928-ac65525e6b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:56.671932 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:56.671585 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:56.671932 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:56.671731 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret podName:8f629165-2355-472e-990b-37bf4c1c13a7 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:12.671710759 +0000 UTC m=+34.150861014 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret") pod "global-pull-secret-syncer-kjxpz" (UID: "8f629165-2355-472e-990b-37bf4c1c13a7") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:56.772008 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:56.771958 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767bd\" (UniqueName: \"kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd\") pod \"network-check-target-4qw44\" (UID: \"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2\") " pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:56.772185 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:56.772143 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:56.772185 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:56.772170 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:56.772185 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:56.772181 2557 projected.go:196] Error preparing data for projected volume kube-api-access-767bd for pod openshift-network-diagnostics/network-check-target-4qw44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:56.772341 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:56.772240 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd podName:e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:12.772223244 +0000 UTC m=+34.251373494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-767bd" (UniqueName: "kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd") pod "network-check-target-4qw44" (UID: "e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:57.002375 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:57.002298 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:57.002525 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:57.002414 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:00:58.002112 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:58.002086 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:00:58.002554 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:58.002124 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:00:58.002554 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:58.002218 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:00:58.002554 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:58.002350 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:00:59.002866 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:00:59.002832 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:00:59.003317 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:00:59.002942 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:01:00.002005 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:00.001971 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:00.002193 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:00.002025 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:00.002193 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:00.002131 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:01:00.002365 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:00.002291 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:01:01.002492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.001908 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:01.002492 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:01.002336 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:01:01.107544 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.107517 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" event={"ID":"654567a0-4936-4f5d-ad8c-2df727933058","Type":"ContainerStarted","Data":"0a45174a6451a074b349bca5491b52e4756ed8ebc478b3435893ccd754dd1d7b"} Jun 13 02:01:01.108889 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.108864 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q9k7s" event={"ID":"aa14882d-ac61-40d0-94f3-22037f5816ce","Type":"ContainerStarted","Data":"2ffd1cd230e135d72fccc1fa89a603adce1c9fc5dd4cbe666ef48f11c7e8b114"} Jun 13 02:01:01.110226 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.110200 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8ckbb" event={"ID":"6fa59b85-a03f-4aae-b8de-bffcf5f45275","Type":"ContainerStarted","Data":"72e545db1d57d990c59d8f32d419b53b77e5476f8e85bc22ad0d99cedd515d52"} Jun 13 02:01:01.111742 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.111720 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qwmt8" event={"ID":"9f8c7669-65bb-4d98-9e2d-01b933948394","Type":"ContainerStarted","Data":"64136620c274077a294dd5c5f0f6dafcf90f08d6df5544e229bf5b6cc2c2c808"} Jun 13 02:01:01.114089 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.114068 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" event={"ID":"91af975a-6f6a-42a4-89a1-5515884b1ff8","Type":"ContainerStarted","Data":"38f25da0d8ba66a715c793c57fa8f5b714f9d712f674a9ceb5d9f3f4f2413195"} Jun 13 02:01:01.114199 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.114139 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" event={"ID":"91af975a-6f6a-42a4-89a1-5515884b1ff8","Type":"ContainerStarted","Data":"b5b701d3f185cca63567d07a029e5728b9e2ff8bea326249b5f99d2a32eafe5e"} Jun 13 02:01:01.114199 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.114193 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" event={"ID":"91af975a-6f6a-42a4-89a1-5515884b1ff8","Type":"ContainerStarted","Data":"2e2571f9b3553d9756d555c100ac1f61fd34bddd91ca086bd189d418247df0c7"} Jun 13 02:01:01.114308 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.114239 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" event={"ID":"91af975a-6f6a-42a4-89a1-5515884b1ff8","Type":"ContainerStarted","Data":"aa0630f77f0367786d302a4ccb9fb7a456bcde3382f176e56219604e9ee1df7c"} Jun 13 02:01:01.115496 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.115477 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" event={"ID":"33678e6e-9c07-41fd-ba45-20b9a64517bc","Type":"ContainerStarted","Data":"3dc04324855badb4b06525da30b2e24af6d075b0fb3c8dca2e3f55630a814a91"} Jun 13 02:01:01.116876 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.116850 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5np24" event={"ID":"6180dba6-1f27-479e-9a60-2e77d9399dbf","Type":"ContainerStarted","Data":"c871f931709e356c04cec074e3a297fb437673db04892d81027a3fa435ccadc2"} Jun 13 02:01:01.118289 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.118267 2557 generic.go:356] "Generic (PLEG): container finished" podID="13cd278d-3a38-407f-8232-12187088b070" containerID="7e06a208554fc44f74d033e7f625169b06d5164440d5b7af4518ad2690941e54" exitCode=0 Jun 13 02:01:01.118365 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.118301 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9phd" event={"ID":"13cd278d-3a38-407f-8232-12187088b070","Type":"ContainerDied","Data":"7e06a208554fc44f74d033e7f625169b06d5164440d5b7af4518ad2690941e54"} Jun 13 02:01:01.123411 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.123376 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lr2gx" podStartSLOduration=3.459754659 podStartE2EDuration="22.123364447s" totalImagesPullingTime="18.663609788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:01.122858179 +0000 UTC m=+22.602008451" watchObservedRunningTime="2026-06-13 02:01:01.123364447 +0000 UTC m=+22.602514732" Jun 13 02:01:01.123484 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.123458 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" podStartSLOduration=21.12345316 podStartE2EDuration="21.12345316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:44.090575653 +0000 UTC m=+5.569725927" watchObservedRunningTime="2026-06-13 02:01:01.12345316 +0000 UTC m=+22.602603432" Jun 13 02:01:01.155039 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.155004 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q9k7s" podStartSLOduration=3.492517541 podStartE2EDuration="22.154991683s" totalImagesPullingTime="18.662474142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:01.154569147 +0000 UTC m=+22.633719420" watchObservedRunningTime="2026-06-13 02:01:01.154991683 +0000 UTC m=+22.634141956" Jun 13 02:01:01.173752 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.173716 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5np24" podStartSLOduration=3.511015021 podStartE2EDuration="22.17370498s" totalImagesPullingTime="18.662689959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:01.173656402 +0000 UTC m=+22.652806687" watchObservedRunningTime="2026-06-13 02:01:01.17370498 +0000 UTC m=+22.652855251" Jun 13 02:01:01.189468 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.189433 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8ckbb" podStartSLOduration=3.482550688 podStartE2EDuration="22.189421644s" totalImagesPullingTime="18.706870956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:01.188725435 +0000 UTC m=+22.667875706" watchObservedRunningTime="2026-06-13 02:01:01.189421644 +0000 UTC m=+22.668571913" Jun 13 02:01:01.202472 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.202434 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qwmt8" podStartSLOduration=3.663113536 podStartE2EDuration="22.202421889s" totalImagesPullingTime="18.539308353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:01.201924696 +0000 UTC m=+22.681074958" watchObservedRunningTime="2026-06-13 02:01:01.202421889 +0000 UTC m=+22.681572161" Jun 13 02:01:01.909597 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:01.909574 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 02:01:02.002403 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:02.002293 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T02:01:01.909594162Z","UUID":"13dfcdfe-5cb5-4936-8ab3-8ec4a5536060","Handler":null,"Name":"","Endpoint":""} Jun 13 02:01:02.002561 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:02.002505 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:02.002561 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:02.002518 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:02.002967 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:02.002605 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:01:02.002967 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:02.002837 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:01:02.004033 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:02.004016 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 02:01:02.004103 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:02.004056 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 02:01:02.124379 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:02.124338 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" event={"ID":"91af975a-6f6a-42a4-89a1-5515884b1ff8","Type":"ContainerStarted","Data":"19b4189b4e9896c8e899e2ad6c5932d99f0babe1deadbc5f3f6cb116740159a0"} Jun 13 02:01:02.124591 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:02.124571 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" event={"ID":"91af975a-6f6a-42a4-89a1-5515884b1ff8","Type":"ContainerStarted","Data":"603994f6c6a65ba3de4a01be317e714b9e831f232d7a38f6f2abc98fc2fd6c86"} Jun 13 02:01:02.126309 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:02.126280 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" event={"ID":"33678e6e-9c07-41fd-ba45-20b9a64517bc","Type":"ContainerStarted","Data":"d3cc881b3ab8ecc88a8839aae8504983adcd669c9d468e6b2d34d2bccb759fbf"} Jun 13 02:01:02.127853 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:02.127831 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ttnkk" event={"ID":"eae3be70-43ac-4d3f-b846-6401c8e66a41","Type":"ContainerStarted","Data":"8af4e39c54b73dd6f00b8e3e51f96a5d08c0ca8167432861b0ebbe2bc9af2544"} Jun 13 02:01:02.142990 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:02.142925 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ttnkk" podStartSLOduration=4.477087489 podStartE2EDuration="23.142910514s" totalImagesPullingTime="18.665823025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:02.142434827 +0000 UTC m=+23.621585101" watchObservedRunningTime="2026-06-13 02:01:02.142910514 +0000 UTC m=+23.622060786" Jun 13 02:01:03.001548 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:03.001515 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:03.001697 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:03.001674 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:01:03.133016 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:03.132975 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" event={"ID":"33678e6e-9c07-41fd-ba45-20b9a64517bc","Type":"ContainerStarted","Data":"929dfd6be9b2a2a269a856c49b14b823859ace8ef4ac7bb06446e14366b2c575"} Jun 13 02:01:03.150605 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:03.150556 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4npxd" podStartSLOduration=3.583459735 podStartE2EDuration="24.150541191s" totalImagesPullingTime="20.567081456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:03.150455577 +0000 UTC m=+24.629605859" watchObservedRunningTime="2026-06-13 02:01:03.150541191 +0000 UTC m=+24.629691462" Jun 13 02:01:04.002176 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:04.002142 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:04.002368 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:04.002194 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:04.002368 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:04.002283 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:01:04.002486 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:04.002362 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:01:04.139389 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:04.139354 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" event={"ID":"91af975a-6f6a-42a4-89a1-5515884b1ff8","Type":"ContainerStarted","Data":"fabc76790bafdb88e91c94cd2c61179cdcf26ae94d271213ac65fdb267f9988c"} Jun 13 02:01:05.002404 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:05.002178 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:05.002596 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:05.002510 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:01:05.019333 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:05.019307 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:01:05.019880 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:05.019859 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:01:06.001786 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:06.001603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:06.002477 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:06.001656 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:06.002477 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:06.001870 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:01:06.002477 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:06.001945 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:01:06.146591 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:06.146546 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" event={"ID":"91af975a-6f6a-42a4-89a1-5515884b1ff8","Type":"ContainerStarted","Data":"71c629c12e4baf2eccee16d857b85e1675d0c04e9de3774d7032dfae41ad6a50"} Jun 13 02:01:06.146803 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:06.146775 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:01:06.146865 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:06.146854 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:01:06.148354 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:06.148330 2557 generic.go:356] "Generic (PLEG): container finished" podID="13cd278d-3a38-407f-8232-12187088b070" containerID="157e462f0b0774b66d8dd6f884a25950a542bba3204a1cb69ca1664dd82db599" exitCode=0 Jun 13 02:01:06.148465 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:06.148376 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9phd" event={"ID":"13cd278d-3a38-407f-8232-12187088b070","Type":"ContainerDied","Data":"157e462f0b0774b66d8dd6f884a25950a542bba3204a1cb69ca1664dd82db599"} Jun 13 02:01:06.163601 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:06.163578 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:01:06.173929 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:06.173891 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" podStartSLOduration=8.484969808 podStartE2EDuration="27.173876837s" totalImagesPullingTime="18.688907029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:06.17363202 +0000 UTC m=+27.652782302" watchObservedRunningTime="2026-06-13 02:01:06.173876837 +0000 UTC m=+27.653027110" Jun 13 02:01:07.002236 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:07.002206 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:07.002739 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:07.002317 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:01:07.150873 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:07.150846 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:01:07.165696 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:07.165670 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:01:07.511369 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:07.511343 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kjxpz"] Jun 13 02:01:07.511594 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:07.511448 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:07.511594 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:07.511539 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:01:07.513896 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:07.513875 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4qw44"] Jun 13 02:01:07.513996 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:07.513945 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:07.514039 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:07.514029 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:01:07.527132 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:07.527112 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5977q"] Jun 13 02:01:07.527214 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:07.527205 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:07.527325 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:07.527305 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:01:08.154814 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:08.154777 2557 generic.go:356] "Generic (PLEG): container finished" podID="13cd278d-3a38-407f-8232-12187088b070" containerID="a33dccaf0172f49b62fa583375843551ff3a7a84cf1ddc5fed3d6f830bf3563c" exitCode=0 Jun 13 02:01:08.155333 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:08.154830 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9phd" event={"ID":"13cd278d-3a38-407f-8232-12187088b070","Type":"ContainerDied","Data":"a33dccaf0172f49b62fa583375843551ff3a7a84cf1ddc5fed3d6f830bf3563c"} Jun 13 02:01:09.004670 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:09.004640 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:09.004670 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:09.004663 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:09.004894 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:09.004649 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:09.004894 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:09.004740 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:01:09.004894 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:09.004833 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:01:09.005010 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:09.004899 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:01:10.162508 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:10.162474 2557 generic.go:356] "Generic (PLEG): container finished" podID="13cd278d-3a38-407f-8232-12187088b070" containerID="c23fe03dc1c36607e169cdd0e448c4037aea2a1b0c1f0c3bbc35730a5a1e9bc4" exitCode=0 Jun 13 02:01:10.163025 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:10.162549 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9phd" event={"ID":"13cd278d-3a38-407f-8232-12187088b070","Type":"ContainerDied","Data":"c23fe03dc1c36607e169cdd0e448c4037aea2a1b0c1f0c3bbc35730a5a1e9bc4"} Jun 13 02:01:10.295012 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:10.294984 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:01:10.295152 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:10.295089 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 02:01:10.295534 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:10.295520 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qwmt8" Jun 13 02:01:11.005622 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:11.005589 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:11.005806 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:11.005627 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:11.005806 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:11.005630 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:11.005806 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:11.005724 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:01:11.005806 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:11.005787 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:01:11.006038 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:11.005873 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:01:12.688705 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:12.688662 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:12.689337 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:12.688743 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:12.689337 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:12.688836 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:12.689337 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:12.688846 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:12.689337 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:12.688894 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs podName:c0366e70-4c1a-496c-9928-ac65525e6b37 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:44.688874568 +0000 UTC m=+66.168024822 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs") pod "network-metrics-daemon-5977q" (UID: "c0366e70-4c1a-496c-9928-ac65525e6b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:12.689337 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:12.688913 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret podName:8f629165-2355-472e-990b-37bf4c1c13a7 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:44.688903694 +0000 UTC m=+66.168053945 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret") pod "global-pull-secret-syncer-kjxpz" (UID: "8f629165-2355-472e-990b-37bf4c1c13a7") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:12.792773 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:12.792730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767bd\" (UniqueName: \"kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd\") pod \"network-check-target-4qw44\" (UID: \"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2\") " pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:12.793220 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:12.793197 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:01:12.793336 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:12.793224 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:01:12.793336 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:12.793240 2557 projected.go:196] Error preparing data for projected volume kube-api-access-767bd for pod openshift-network-diagnostics/network-check-target-4qw44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:12.793336 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:12.793304 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd podName:e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:44.793286738 +0000 UTC m=+66.272437194 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-767bd" (UniqueName: "kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd") pod "network-check-target-4qw44" (UID: "e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:13.002178 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:13.002142 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:13.002355 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:13.002142 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:13.002355 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:13.002263 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:13.002355 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:13.002281 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:01:13.002502 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:13.002372 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qw44" podUID="e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2" Jun 13 02:01:13.002502 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:13.002475 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjxpz" podUID="8f629165-2355-472e-990b-37bf4c1c13a7" Jun 13 02:01:14.350695 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.350666 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeReady" Jun 13 02:01:14.351141 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.350784 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 02:01:14.388324 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.388301 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kmq5z"] Jun 13 02:01:14.412039 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.411978 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4qqmb"] Jun 13 02:01:14.412187 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.412073 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.414618 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.414594 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bc58g\"" Jun 13 02:01:14.414761 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.414619 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 02:01:14.414761 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.414622 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 02:01:14.425629 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.425612 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kmq5z"] Jun 13 02:01:14.425703 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.425644 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4qqmb"] Jun 13 02:01:14.425740 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.425720 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4qqmb" Jun 13 02:01:14.428390 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.428364 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 02:01:14.428496 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.428388 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n4zgq\"" Jun 13 02:01:14.428496 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.428388 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 02:01:14.428496 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.428368 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 02:01:14.506461 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.506437 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44ad9c9f-e870-462a-bb6b-4eee24c316e2-config-volume\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.506563 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.506475 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2303d56d-2e9a-4ff7-ba2e-a07b453a4c91-cert\") pod \"ingress-canary-4qqmb\" (UID: \"2303d56d-2e9a-4ff7-ba2e-a07b453a4c91\") " pod="openshift-ingress-canary/ingress-canary-4qqmb" Jun 13 02:01:14.506563 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.506497 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.506675 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.506575 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k98rw\" (UniqueName: \"kubernetes.io/projected/2303d56d-2e9a-4ff7-ba2e-a07b453a4c91-kube-api-access-k98rw\") pod \"ingress-canary-4qqmb\" (UID: \"2303d56d-2e9a-4ff7-ba2e-a07b453a4c91\") " pod="openshift-ingress-canary/ingress-canary-4qqmb" Jun 13 02:01:14.506675 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.506636 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmfcb\" (UniqueName: \"kubernetes.io/projected/44ad9c9f-e870-462a-bb6b-4eee24c316e2-kube-api-access-gmfcb\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.506776 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.506706 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44ad9c9f-e870-462a-bb6b-4eee24c316e2-tmp-dir\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.607205 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.607174 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44ad9c9f-e870-462a-bb6b-4eee24c316e2-config-volume\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.607317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.607214 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2303d56d-2e9a-4ff7-ba2e-a07b453a4c91-cert\") pod \"ingress-canary-4qqmb\" (UID: \"2303d56d-2e9a-4ff7-ba2e-a07b453a4c91\") " pod="openshift-ingress-canary/ingress-canary-4qqmb" Jun 13 02:01:14.607317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.607232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.607317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.607282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k98rw\" (UniqueName: \"kubernetes.io/projected/2303d56d-2e9a-4ff7-ba2e-a07b453a4c91-kube-api-access-k98rw\") pod \"ingress-canary-4qqmb\" (UID: \"2303d56d-2e9a-4ff7-ba2e-a07b453a4c91\") " pod="openshift-ingress-canary/ingress-canary-4qqmb" Jun 13 02:01:14.607317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.607300 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmfcb\" (UniqueName: \"kubernetes.io/projected/44ad9c9f-e870-462a-bb6b-4eee24c316e2-kube-api-access-gmfcb\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.607514 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.607341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44ad9c9f-e870-462a-bb6b-4eee24c316e2-tmp-dir\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.607514 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:14.607421 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:14.607514 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:14.607504 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls podName:44ad9c9f-e870-462a-bb6b-4eee24c316e2 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:15.107484396 +0000 UTC m=+36.586634650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls") pod "dns-default-kmq5z" (UID: "44ad9c9f-e870-462a-bb6b-4eee24c316e2") : secret "dns-default-metrics-tls" not found Jun 13 02:01:14.607665 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.607609 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44ad9c9f-e870-462a-bb6b-4eee24c316e2-tmp-dir\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.607814 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.607791 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44ad9c9f-e870-462a-bb6b-4eee24c316e2-config-volume\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.611027 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.611010 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2303d56d-2e9a-4ff7-ba2e-a07b453a4c91-cert\") pod \"ingress-canary-4qqmb\" (UID: \"2303d56d-2e9a-4ff7-ba2e-a07b453a4c91\") " pod="openshift-ingress-canary/ingress-canary-4qqmb" Jun 13 02:01:14.617748 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.617729 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmfcb\" (UniqueName: \"kubernetes.io/projected/44ad9c9f-e870-462a-bb6b-4eee24c316e2-kube-api-access-gmfcb\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:14.618051 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.618034 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k98rw\" (UniqueName: \"kubernetes.io/projected/2303d56d-2e9a-4ff7-ba2e-a07b453a4c91-kube-api-access-k98rw\") pod \"ingress-canary-4qqmb\" (UID: \"2303d56d-2e9a-4ff7-ba2e-a07b453a4c91\") " pod="openshift-ingress-canary/ingress-canary-4qqmb" Jun 13 02:01:14.751453 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.751430 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4qqmb" Jun 13 02:01:14.942370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:14.942336 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4qqmb"] Jun 13 02:01:14.946316 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:01:14.946296 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2303d56d_2e9a_4ff7_ba2e_a07b453a4c91.slice/crio-66b2ac8ec1f07c9181055e2bc781f585640cc21091827c194c276cf85652587b WatchSource:0}: Error finding container 66b2ac8ec1f07c9181055e2bc781f585640cc21091827c194c276cf85652587b: Status 404 returned error can't find the container with id 66b2ac8ec1f07c9181055e2bc781f585640cc21091827c194c276cf85652587b Jun 13 02:01:15.002099 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.002031 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:15.002189 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.002031 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:15.002235 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.002032 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:15.004806 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.004639 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 02:01:15.004806 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.004648 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 02:01:15.004806 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.004674 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sngzk\"" Jun 13 02:01:15.004806 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.004707 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 02:01:15.004806 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.004786 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xr6x\"" Jun 13 02:01:15.005078 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.004962 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 02:01:15.110621 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.110582 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:15.110764 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:15.110702 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:15.110764 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:15.110756 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls podName:44ad9c9f-e870-462a-bb6b-4eee24c316e2 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:16.110741795 +0000 UTC m=+37.589892062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls") pod "dns-default-kmq5z" (UID: "44ad9c9f-e870-462a-bb6b-4eee24c316e2") : secret "dns-default-metrics-tls" not found Jun 13 02:01:15.174595 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.174548 2557 generic.go:356] "Generic (PLEG): container finished" podID="13cd278d-3a38-407f-8232-12187088b070" containerID="c852ef8a7fafda2c6fe04569645456eb40f51a085efaa63853b9580eebb76407" exitCode=0 Jun 13 02:01:15.174750 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.174625 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9phd" event={"ID":"13cd278d-3a38-407f-8232-12187088b070","Type":"ContainerDied","Data":"c852ef8a7fafda2c6fe04569645456eb40f51a085efaa63853b9580eebb76407"} Jun 13 02:01:15.175795 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:15.175769 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4qqmb" event={"ID":"2303d56d-2e9a-4ff7-ba2e-a07b453a4c91","Type":"ContainerStarted","Data":"66b2ac8ec1f07c9181055e2bc781f585640cc21091827c194c276cf85652587b"} Jun 13 02:01:16.120352 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:16.120311 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:16.120901 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:16.120467 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:16.120901 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:16.120539 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls podName:44ad9c9f-e870-462a-bb6b-4eee24c316e2 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:18.120517353 +0000 UTC m=+39.599667603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls") pod "dns-default-kmq5z" (UID: "44ad9c9f-e870-462a-bb6b-4eee24c316e2") : secret "dns-default-metrics-tls" not found Jun 13 02:01:16.182332 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:16.182293 2557 generic.go:356] "Generic (PLEG): container finished" podID="13cd278d-3a38-407f-8232-12187088b070" containerID="d6f336057f1ca43707f82cfbac804914ffebf198cb92636320b6745a797a2159" exitCode=0 Jun 13 02:01:16.182494 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:16.182370 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9phd" event={"ID":"13cd278d-3a38-407f-8232-12187088b070","Type":"ContainerDied","Data":"d6f336057f1ca43707f82cfbac804914ffebf198cb92636320b6745a797a2159"} Jun 13 02:01:17.188258 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:17.188069 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9phd" event={"ID":"13cd278d-3a38-407f-8232-12187088b070","Type":"ContainerStarted","Data":"37a8db4262956934021194bdac3ddfbdbb91027ce96cfd2f7c9000b0cff7b549"} Jun 13 02:01:17.189484 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:17.189465 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4qqmb" event={"ID":"2303d56d-2e9a-4ff7-ba2e-a07b453a4c91","Type":"ContainerStarted","Data":"029c6a965e824b0c9a8f06c688ff9f1e63e9b7a95eb0f36ea362ded31fe474b7"} Jun 13 02:01:17.210364 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:17.210320 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t9phd" podStartSLOduration=8.811276398 podStartE2EDuration="38.210308171s" totalImagesPullingTime="29.399031773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:17.208991312 +0000 UTC m=+38.688141584" watchObservedRunningTime="2026-06-13 02:01:17.210308171 +0000 UTC m=+38.689458443" Jun 13 02:01:17.222732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:17.222687 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4qqmb" podStartSLOduration=1.393587184 podStartE2EDuration="3.222678969s" totalImagesPullingTime="1.829091785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:17.222669169 +0000 UTC m=+38.701819451" watchObservedRunningTime="2026-06-13 02:01:17.222678969 +0000 UTC m=+38.701829241" Jun 13 02:01:18.133405 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:18.133371 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:18.133578 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:18.133525 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:18.133618 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:18.133590 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls podName:44ad9c9f-e870-462a-bb6b-4eee24c316e2 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:22.133575893 +0000 UTC m=+43.612726143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls") pod "dns-default-kmq5z" (UID: "44ad9c9f-e870-462a-bb6b-4eee24c316e2") : secret "dns-default-metrics-tls" not found Jun 13 02:01:22.161137 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:22.161102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:22.161615 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:22.161218 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:22.161615 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:22.161269 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls podName:44ad9c9f-e870-462a-bb6b-4eee24c316e2 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:30.161256212 +0000 UTC m=+51.640406463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls") pod "dns-default-kmq5z" (UID: "44ad9c9f-e870-462a-bb6b-4eee24c316e2") : secret "dns-default-metrics-tls" not found Jun 13 02:01:30.216080 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:30.216028 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:30.216543 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:30.216177 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:30.216543 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:30.216239 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls podName:44ad9c9f-e870-462a-bb6b-4eee24c316e2 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:46.216223643 +0000 UTC m=+67.695373893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls") pod "dns-default-kmq5z" (UID: "44ad9c9f-e870-462a-bb6b-4eee24c316e2") : secret "dns-default-metrics-tls" not found Jun 13 02:01:39.177178 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:39.177150 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hg7w" Jun 13 02:01:44.708740 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:44.708703 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:01:44.709182 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:44.708758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:44.711433 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:44.711413 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 02:01:44.711500 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:44.711484 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 02:01:44.719396 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:44.719379 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 02:01:44.719493 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:44.719450 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs podName:c0366e70-4c1a-496c-9928-ac65525e6b37 nodeName:}" failed. No retries permitted until 2026-06-13 02:02:48.719435155 +0000 UTC m=+130.198585405 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs") pod "network-metrics-daemon-5977q" (UID: "c0366e70-4c1a-496c-9928-ac65525e6b37") : secret "metrics-daemon-secret" not found Jun 13 02:01:44.722963 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:44.722922 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f629165-2355-472e-990b-37bf4c1c13a7-original-pull-secret\") pod \"global-pull-secret-syncer-kjxpz\" (UID: \"8f629165-2355-472e-990b-37bf4c1c13a7\") " pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:44.809418 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:44.809383 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767bd\" (UniqueName: \"kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd\") pod \"network-check-target-4qw44\" (UID: \"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2\") " pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:44.812310 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:44.812293 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 02:01:44.822537 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:44.822518 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 02:01:44.833070 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:44.833041 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-767bd\" (UniqueName: \"kubernetes.io/projected/e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2-kube-api-access-767bd\") pod \"network-check-target-4qw44\" (UID: \"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2\") " pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:45.013560 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:45.013536 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjxpz" Jun 13 02:01:45.021649 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:45.021631 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xr6x\"" Jun 13 02:01:45.028981 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:45.028963 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:45.159491 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:45.159454 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kjxpz"] Jun 13 02:01:45.162347 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:01:45.162325 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f629165_2355_472e_990b_37bf4c1c13a7.slice/crio-86cee2ee6af887ab399426185a633ee8002b38c7c932ed62dc6f58bdf0fc4689 WatchSource:0}: Error finding container 86cee2ee6af887ab399426185a633ee8002b38c7c932ed62dc6f58bdf0fc4689: Status 404 returned error can't find the container with id 86cee2ee6af887ab399426185a633ee8002b38c7c932ed62dc6f58bdf0fc4689 Jun 13 02:01:45.179224 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:45.179198 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4qw44"] Jun 13 02:01:45.181896 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:01:45.181873 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67ee2ef_ba5e_4b90_87cd_95bb5a9a47c2.slice/crio-c1b76477ac058fc891300cbaf6afc6a3d5f0f282f22ab5f1ef23d24760073d3a WatchSource:0}: Error finding container c1b76477ac058fc891300cbaf6afc6a3d5f0f282f22ab5f1ef23d24760073d3a: Status 404 returned error can't find the container with id c1b76477ac058fc891300cbaf6afc6a3d5f0f282f22ab5f1ef23d24760073d3a Jun 13 02:01:45.258712 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:45.258680 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4qw44" event={"ID":"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2","Type":"ContainerStarted","Data":"c1b76477ac058fc891300cbaf6afc6a3d5f0f282f22ab5f1ef23d24760073d3a"} Jun 13 02:01:45.259670 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:45.259649 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kjxpz" event={"ID":"8f629165-2355-472e-990b-37bf4c1c13a7","Type":"ContainerStarted","Data":"86cee2ee6af887ab399426185a633ee8002b38c7c932ed62dc6f58bdf0fc4689"} Jun 13 02:01:46.220635 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:46.220596 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:01:46.221190 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:46.220762 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:46.221190 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:01:46.220843 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls podName:44ad9c9f-e870-462a-bb6b-4eee24c316e2 nodeName:}" failed. No retries permitted until 2026-06-13 02:02:18.220819878 +0000 UTC m=+99.699970129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls") pod "dns-default-kmq5z" (UID: "44ad9c9f-e870-462a-bb6b-4eee24c316e2") : secret "dns-default-metrics-tls" not found Jun 13 02:01:50.274928 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:50.274876 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4qw44" event={"ID":"e67ee2ef-ba5e-4b90-87cd-95bb5a9a47c2","Type":"ContainerStarted","Data":"88a3980b14409a1f6629ceb9b4cc163c4aa4308dd193a37839b77147ff876a4e"} Jun 13 02:01:50.275400 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:50.275005 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:01:50.276321 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:50.276299 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kjxpz" event={"ID":"8f629165-2355-472e-990b-37bf4c1c13a7","Type":"ContainerStarted","Data":"f5ea20abfe9270149ae66f8df6985038cd6175cdee2e14464e443fbf0d645123"} Jun 13 02:01:50.289934 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:50.289891 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4qw44" podStartSLOduration=66.749258627 podStartE2EDuration="1m11.289879538s" totalImagesPullingTime="4.540620911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:50.288922486 +0000 UTC m=+71.768072779" watchObservedRunningTime="2026-06-13 02:01:50.289879538 +0000 UTC m=+71.769029847" Jun 13 02:01:50.302276 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:01:50.302238 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kjxpz" podStartSLOduration=66.739538791 podStartE2EDuration="1m11.302225457s" totalImagesPullingTime="4.562686666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:50.301823309 +0000 UTC m=+71.780973582" watchObservedRunningTime="2026-06-13 02:01:50.302225457 +0000 UTC m=+71.781375730" Jun 13 02:02:18.234006 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:02:18.233938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:02:18.234536 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:02:18.234112 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:02:18.234536 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:02:18.234212 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls podName:44ad9c9f-e870-462a-bb6b-4eee24c316e2 nodeName:}" failed. No retries permitted until 2026-06-13 02:03:22.234190787 +0000 UTC m=+163.713341038 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls") pod "dns-default-kmq5z" (UID: "44ad9c9f-e870-462a-bb6b-4eee24c316e2") : secret "dns-default-metrics-tls" not found Jun 13 02:02:21.281653 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:02:21.281618 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4qw44" Jun 13 02:02:48.732426 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:02:48.732394 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:02:48.732893 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:02:48.732528 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 02:02:48.732893 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:02:48.732589 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs podName:c0366e70-4c1a-496c-9928-ac65525e6b37 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:50.732575323 +0000 UTC m=+252.211725573 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs") pod "network-metrics-daemon-5977q" (UID: "c0366e70-4c1a-496c-9928-ac65525e6b37") : secret "metrics-daemon-secret" not found Jun 13 02:03:17.424313 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:03:17.424209 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kmq5z" podUID="44ad9c9f-e870-462a-bb6b-4eee24c316e2" Jun 13 02:03:17.480721 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:03:17.480691 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kmq5z" Jun 13 02:03:18.022672 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:03:18.022620 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5977q" podUID="c0366e70-4c1a-496c-9928-ac65525e6b37" Jun 13 02:03:22.262049 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:03:22.261925 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:03:22.262456 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:03:22.262072 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:03:22.262456 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:03:22.262135 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls podName:44ad9c9f-e870-462a-bb6b-4eee24c316e2 nodeName:}" failed. No retries permitted until 2026-06-13 02:05:24.262118811 +0000 UTC m=+285.741269061 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls") pod "dns-default-kmq5z" (UID: "44ad9c9f-e870-462a-bb6b-4eee24c316e2") : secret "dns-default-metrics-tls" not found Jun 13 02:03:29.003455 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:03:29.003416 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:04:30.719717 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.719680 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-hh6pd"] Jun 13 02:04:30.721389 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.721373 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x"] Jun 13 02:04:30.721529 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.721510 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:30.723087 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.723066 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74b48dc66b-725zw"] Jun 13 02:04:30.723194 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.723166 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x" Jun 13 02:04:30.724648 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.724630 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.725290 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.725271 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 13 02:04:30.726126 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.726109 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fttvr\"" Jun 13 02:04:30.726212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.726159 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5pvbx\"" Jun 13 02:04:30.726459 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.726443 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 13 02:04:30.726740 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.726728 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 13 02:04:30.727439 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.727419 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 13 02:04:30.727547 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.727420 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 02:04:30.727547 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.727424 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:04:30.727547 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.727521 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 13 02:04:30.727670 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.727546 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 02:04:30.729419 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.729400 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 13 02:04:30.729979 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.729941 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 13 02:04:30.730907 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.730883 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-svcvx\"" Jun 13 02:04:30.735393 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.735374 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x"] Jun 13 02:04:30.738510 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.738491 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-hh6pd"] Jun 13 02:04:30.753852 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.753831 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74b48dc66b-725zw"] Jun 13 02:04:30.821241 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.821211 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk"] Jun 13 02:04:30.823178 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.823161 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz"] Jun 13 02:04:30.823289 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.823273 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:30.824767 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.824751 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-5jtnr"] Jun 13 02:04:30.824874 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.824863 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:30.825773 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.825751 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rnpvp\"" Jun 13 02:04:30.825868 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.825786 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 13 02:04:30.825868 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.825788 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:04:30.826043 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.826024 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-default-certificate\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.826093 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.826074 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 13 02:04:30.826093 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.826085 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb14295a-9e1b-483c-8171-c427c3bedaad-nginx-conf\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:30.826158 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.826108 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.826158 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.826125 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.826233 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.826217 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-stats-auth\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.826282 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.826248 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99rnr\" (UniqueName: \"kubernetes.io/projected/79d3ca1c-dd15-46e6-b97e-ab817f52c686-kube-api-access-99rnr\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.826333 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.826278 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:30.826333 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.826319 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wn6r\" (UniqueName: \"kubernetes.io/projected/7daaef1d-38d0-4c25-a802-d920e657f398-kube-api-access-4wn6r\") pod \"volume-data-source-validator-bd4ccd799-fs55x\" (UID: \"7daaef1d-38d0-4c25-a802-d920e657f398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x" Jun 13 02:04:30.826556 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.826541 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:30.827311 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.827291 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 13 02:04:30.827404 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.827359 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 13 02:04:30.827404 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.827364 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 13 02:04:30.827848 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.827835 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:04:30.828146 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.828126 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h5hz9\"" Jun 13 02:04:30.828747 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.828732 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 02:04:30.828747 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.828743 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 13 02:04:30.829337 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.829320 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 02:04:30.829337 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.829328 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 13 02:04:30.830172 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.830155 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6x6t4\"" Jun 13 02:04:30.836103 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.836082 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 13 02:04:30.836748 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.836729 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz"] Jun 13 02:04:30.837478 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.837461 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk"] Jun 13 02:04:30.838565 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.838543 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-5jtnr"] Jun 13 02:04:30.919986 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.919937 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59bb8c8fb5-wllj8"] Jun 13 02:04:30.922031 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.922012 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:30.926503 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926486 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 02:04:30.926607 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926586 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9f9a144-91b4-4b93-aa8e-b83432e8ce41-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kkstz\" (UID: \"b9f9a144-91b4-4b93-aa8e-b83432e8ce41\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:30.926665 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926613 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-tmp\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:30.926665 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926640 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-default-certificate\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.926748 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926689 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb14295a-9e1b-483c-8171-c427c3bedaad-nginx-conf\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:30.926748 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926717 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.926748 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926735 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.926881 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926775 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 02:04:30.926881 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-stats-auth\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.927000 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926896 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99rnr\" (UniqueName: \"kubernetes.io/projected/79d3ca1c-dd15-46e6-b97e-ab817f52c686-kube-api-access-99rnr\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.927000 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:30.927000 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.926973 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:30.927166 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927000 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-snapshots\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:30.927166 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927042 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngdb\" (UniqueName: \"kubernetes.io/projected/b9f9a144-91b4-4b93-aa8e-b83432e8ce41-kube-api-access-tngdb\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kkstz\" (UID: \"b9f9a144-91b4-4b93-aa8e-b83432e8ce41\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:30.927166 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927068 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:30.927166 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmxr4\" (UniqueName: \"kubernetes.io/projected/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-kube-api-access-lmxr4\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:30.927166 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krnzl\" (UniqueName: \"kubernetes.io/projected/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-kube-api-access-krnzl\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:30.927166 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927157 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9f9a144-91b4-4b93-aa8e-b83432e8ce41-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kkstz\" (UID: \"b9f9a144-91b4-4b93-aa8e-b83432e8ce41\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:30.927499 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927172 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x269m\"" Jun 13 02:04:30.927499 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927181 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-serving-cert\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:30.927499 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927212 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wn6r\" (UniqueName: \"kubernetes.io/projected/7daaef1d-38d0-4c25-a802-d920e657f398-kube-api-access-4wn6r\") pod \"volume-data-source-validator-bd4ccd799-fs55x\" (UID: \"7daaef1d-38d0-4c25-a802-d920e657f398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x" Jun 13 02:04:30.927499 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927245 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:30.927499 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927378 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 02:04:30.927499 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.927458 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb14295a-9e1b-483c-8171-c427c3bedaad-nginx-conf\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:30.927864 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:30.927539 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 02:04:30.927864 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:30.927607 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle podName:79d3ca1c-dd15-46e6-b97e-ab817f52c686 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:31.427585715 +0000 UTC m=+232.906735979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle") pod "router-default-74b48dc66b-725zw" (UID: "79d3ca1c-dd15-46e6-b97e-ab817f52c686") : configmap references non-existent config key: service-ca.crt Jun 13 02:04:30.927864 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:30.927628 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert podName:bb14295a-9e1b-483c-8171-c427c3bedaad nodeName:}" failed. No retries permitted until 2026-06-13 02:04:31.427617943 +0000 UTC m=+232.906768206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hh6pd" (UID: "bb14295a-9e1b-483c-8171-c427c3bedaad") : secret "networking-console-plugin-cert" not found Jun 13 02:04:30.927864 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:30.927658 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 02:04:30.927864 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:30.927712 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs podName:79d3ca1c-dd15-46e6-b97e-ab817f52c686 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:31.427695706 +0000 UTC m=+232.906845959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs") pod "router-default-74b48dc66b-725zw" (UID: "79d3ca1c-dd15-46e6-b97e-ab817f52c686") : secret "router-metrics-certs-default" not found Jun 13 02:04:30.929764 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.929743 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-default-certificate\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.929931 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.929912 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-stats-auth\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.935016 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.934989 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 02:04:30.942480 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.942458 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59bb8c8fb5-wllj8"] Jun 13 02:04:30.945890 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.945872 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99rnr\" (UniqueName: \"kubernetes.io/projected/79d3ca1c-dd15-46e6-b97e-ab817f52c686-kube-api-access-99rnr\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:30.949352 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:30.949332 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wn6r\" (UniqueName: \"kubernetes.io/projected/7daaef1d-38d0-4c25-a802-d920e657f398-kube-api-access-4wn6r\") pod \"volume-data-source-validator-bd4ccd799-fs55x\" (UID: \"7daaef1d-38d0-4c25-a802-d920e657f398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x" Jun 13 02:04:31.027938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.027902 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krnzl\" (UniqueName: \"kubernetes.io/projected/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-kube-api-access-krnzl\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.027938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.027942 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-serving-cert\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.028205 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.027980 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-certificates\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.028205 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.027997 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-trusted-ca\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.028205 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028015 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/079617cb-c115-4eb5-9e2d-42afd7154e0b-ca-trust-extracted\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.028205 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028034 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9f9a144-91b4-4b93-aa8e-b83432e8ce41-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kkstz\" (UID: \"b9f9a144-91b4-4b93-aa8e-b83432e8ce41\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:31.028205 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028049 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.028205 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028096 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-image-registry-private-configuration\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028276 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-snapshots\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngdb\" (UniqueName: \"kubernetes.io/projected/b9f9a144-91b4-4b93-aa8e-b83432e8ce41-kube-api-access-tngdb\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kkstz\" (UID: \"b9f9a144-91b4-4b93-aa8e-b83432e8ce41\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028320 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028358 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-installation-pull-secrets\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmxr4\" (UniqueName: \"kubernetes.io/projected/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-kube-api-access-lmxr4\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028409 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2wbw\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-kube-api-access-g2wbw\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9f9a144-91b4-4b93-aa8e-b83432e8ce41-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kkstz\" (UID: \"b9f9a144-91b4-4b93-aa8e-b83432e8ce41\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028461 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-bound-sa-token\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.028455 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.028534 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls podName:7a6ee75e-bba9-4a4b-90cd-f479cc5a3805 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:31.528514181 +0000 UTC m=+233.007664434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls") pod "cluster-samples-operator-9547488fd-bq4nk" (UID: "7a6ee75e-bba9-4a4b-90cd-f479cc5a3805") : secret "samples-operator-tls" not found Jun 13 02:04:31.028580 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028565 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.029133 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028682 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-tmp\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.029133 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028778 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.029133 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028980 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-snapshots\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.029133 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.028981 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-tmp\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.029133 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.029102 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9f9a144-91b4-4b93-aa8e-b83432e8ce41-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kkstz\" (UID: \"b9f9a144-91b4-4b93-aa8e-b83432e8ce41\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:31.029359 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.029256 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.029631 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.029607 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.030537 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.030517 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-serving-cert\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.030783 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.030766 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9f9a144-91b4-4b93-aa8e-b83432e8ce41-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kkstz\" (UID: \"b9f9a144-91b4-4b93-aa8e-b83432e8ce41\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:31.037241 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.037221 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krnzl\" (UniqueName: \"kubernetes.io/projected/45293b1c-6b4f-4abd-a2cf-2d30a52103c0-kube-api-access-krnzl\") pod \"insights-operator-5bbd86d6bd-5jtnr\" (UID: \"45293b1c-6b4f-4abd-a2cf-2d30a52103c0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.037241 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.037235 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngdb\" (UniqueName: \"kubernetes.io/projected/b9f9a144-91b4-4b93-aa8e-b83432e8ce41-kube-api-access-tngdb\") pod \"kube-storage-version-migrator-operator-7c578b78fc-kkstz\" (UID: \"b9f9a144-91b4-4b93-aa8e-b83432e8ce41\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:31.037506 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.037487 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmxr4\" (UniqueName: \"kubernetes.io/projected/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-kube-api-access-lmxr4\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:31.040259 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.040238 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x" Jun 13 02:04:31.129549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.129517 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-installation-pull-secrets\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.129549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.129554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2wbw\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-kube-api-access-g2wbw\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.129836 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.129576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-bound-sa-token\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.129836 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.129651 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-certificates\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.129836 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.129675 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-trusted-ca\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.129836 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.129702 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/079617cb-c115-4eb5-9e2d-42afd7154e0b-ca-trust-extracted\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.129836 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.129732 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.129836 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.129766 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-image-registry-private-configuration\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.131377 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.130452 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/079617cb-c115-4eb5-9e2d-42afd7154e0b-ca-trust-extracted\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.131377 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.131143 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-trusted-ca\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.131377 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.131329 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:04:31.131377 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.131350 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb8c8fb5-wllj8: secret "image-registry-tls" not found Jun 13 02:04:31.131642 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.131403 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls podName:079617cb-c115-4eb5-9e2d-42afd7154e0b nodeName:}" failed. No retries permitted until 2026-06-13 02:04:31.631384805 +0000 UTC m=+233.110535062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls") pod "image-registry-59bb8c8fb5-wllj8" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b") : secret "image-registry-tls" not found Jun 13 02:04:31.131914 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.131881 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-certificates\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.132882 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.132863 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-installation-pull-secrets\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.132882 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.132877 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-image-registry-private-configuration\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.141238 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.141148 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" Jun 13 02:04:31.142751 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.142728 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-bound-sa-token\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.142832 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.142727 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2wbw\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-kube-api-access-g2wbw\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.146720 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.146699 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" Jun 13 02:04:31.158363 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.158344 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x"] Jun 13 02:04:31.161352 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:04:31.161311 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7daaef1d_38d0_4c25_a802_d920e657f398.slice/crio-acf1533ed6e2b30af0a83f655da1010f280e7e295da3d6bb8ef42d6be9f72893 WatchSource:0}: Error finding container acf1533ed6e2b30af0a83f655da1010f280e7e295da3d6bb8ef42d6be9f72893: Status 404 returned error can't find the container with id acf1533ed6e2b30af0a83f655da1010f280e7e295da3d6bb8ef42d6be9f72893 Jun 13 02:04:31.266898 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.266867 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz"] Jun 13 02:04:31.269494 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:04:31.269467 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f9a144_91b4_4b93_aa8e_b83432e8ce41.slice/crio-e2a4b8e77912751073d0565bcf19457b5d7b2ff8be393359f502339729b305dd WatchSource:0}: Error finding container e2a4b8e77912751073d0565bcf19457b5d7b2ff8be393359f502339729b305dd: Status 404 returned error can't find the container with id e2a4b8e77912751073d0565bcf19457b5d7b2ff8be393359f502339729b305dd Jun 13 02:04:31.286251 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.286230 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-5jtnr"] Jun 13 02:04:31.288366 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:04:31.288345 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45293b1c_6b4f_4abd_a2cf_2d30a52103c0.slice/crio-50d839a8c65c1e632a65c40c3f829edb44cc437f9fd114d6efba8741caef9a7c WatchSource:0}: Error finding container 50d839a8c65c1e632a65c40c3f829edb44cc437f9fd114d6efba8741caef9a7c: Status 404 returned error can't find the container with id 50d839a8c65c1e632a65c40c3f829edb44cc437f9fd114d6efba8741caef9a7c Jun 13 02:04:31.432350 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.432320 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:31.432518 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.432380 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:31.432518 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.432489 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 02:04:31.432629 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.432558 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs podName:79d3ca1c-dd15-46e6-b97e-ab817f52c686 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:32.432538649 +0000 UTC m=+233.911688919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs") pod "router-default-74b48dc66b-725zw" (UID: "79d3ca1c-dd15-46e6-b97e-ab817f52c686") : secret "router-metrics-certs-default" not found Jun 13 02:04:31.432629 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.432599 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle podName:79d3ca1c-dd15-46e6-b97e-ab817f52c686 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:32.432585158 +0000 UTC m=+233.911735409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle") pod "router-default-74b48dc66b-725zw" (UID: "79d3ca1c-dd15-46e6-b97e-ab817f52c686") : configmap references non-existent config key: service-ca.crt Jun 13 02:04:31.432629 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.432615 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:31.432783 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.432708 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 02:04:31.432783 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.432744 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert podName:bb14295a-9e1b-483c-8171-c427c3bedaad nodeName:}" failed. No retries permitted until 2026-06-13 02:04:32.432734556 +0000 UTC m=+233.911884807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hh6pd" (UID: "bb14295a-9e1b-483c-8171-c427c3bedaad") : secret "networking-console-plugin-cert" not found Jun 13 02:04:31.533586 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.533556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:31.533744 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.533703 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 02:04:31.533792 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.533760 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls podName:7a6ee75e-bba9-4a4b-90cd-f479cc5a3805 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:32.533746048 +0000 UTC m=+234.012896299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls") pod "cluster-samples-operator-9547488fd-bq4nk" (UID: "7a6ee75e-bba9-4a4b-90cd-f479cc5a3805") : secret "samples-operator-tls" not found Jun 13 02:04:31.634192 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.634121 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:31.634309 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.634222 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:04:31.634309 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.634234 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb8c8fb5-wllj8: secret "image-registry-tls" not found Jun 13 02:04:31.634309 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:31.634282 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls podName:079617cb-c115-4eb5-9e2d-42afd7154e0b nodeName:}" failed. No retries permitted until 2026-06-13 02:04:32.634266237 +0000 UTC m=+234.113416512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls") pod "image-registry-59bb8c8fb5-wllj8" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b") : secret "image-registry-tls" not found Jun 13 02:04:31.659121 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.659095 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" event={"ID":"b9f9a144-91b4-4b93-aa8e-b83432e8ce41","Type":"ContainerStarted","Data":"e2a4b8e77912751073d0565bcf19457b5d7b2ff8be393359f502339729b305dd"} Jun 13 02:04:31.661743 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.661718 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" event={"ID":"45293b1c-6b4f-4abd-a2cf-2d30a52103c0","Type":"ContainerStarted","Data":"50d839a8c65c1e632a65c40c3f829edb44cc437f9fd114d6efba8741caef9a7c"} Jun 13 02:04:31.662909 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:31.662887 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x" event={"ID":"7daaef1d-38d0-4c25-a802-d920e657f398","Type":"ContainerStarted","Data":"acf1533ed6e2b30af0a83f655da1010f280e7e295da3d6bb8ef42d6be9f72893"} Jun 13 02:04:32.441657 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:32.441633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:32.441987 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:32.441695 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:32.441987 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:32.441713 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:32.441987 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:32.441770 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 02:04:32.441987 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:32.441788 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 02:04:32.441987 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:32.441826 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs podName:79d3ca1c-dd15-46e6-b97e-ab817f52c686 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.441811736 +0000 UTC m=+235.920961986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs") pod "router-default-74b48dc66b-725zw" (UID: "79d3ca1c-dd15-46e6-b97e-ab817f52c686") : secret "router-metrics-certs-default" not found Jun 13 02:04:32.441987 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:32.441839 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert podName:bb14295a-9e1b-483c-8171-c427c3bedaad nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.44183301 +0000 UTC m=+235.920983260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hh6pd" (UID: "bb14295a-9e1b-483c-8171-c427c3bedaad") : secret "networking-console-plugin-cert" not found Jun 13 02:04:32.441987 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:32.441867 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle podName:79d3ca1c-dd15-46e6-b97e-ab817f52c686 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.441847219 +0000 UTC m=+235.920997477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle") pod "router-default-74b48dc66b-725zw" (UID: "79d3ca1c-dd15-46e6-b97e-ab817f52c686") : configmap references non-existent config key: service-ca.crt Jun 13 02:04:32.542533 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:32.542496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:32.542730 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:32.542606 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 02:04:32.542730 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:32.542677 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls podName:7a6ee75e-bba9-4a4b-90cd-f479cc5a3805 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.542656411 +0000 UTC m=+236.021806676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls") pod "cluster-samples-operator-9547488fd-bq4nk" (UID: "7a6ee75e-bba9-4a4b-90cd-f479cc5a3805") : secret "samples-operator-tls" not found Jun 13 02:04:32.643085 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:32.643052 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:32.643255 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:32.643228 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:04:32.643293 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:32.643260 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb8c8fb5-wllj8: secret "image-registry-tls" not found Jun 13 02:04:32.643340 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:32.643331 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls podName:079617cb-c115-4eb5-9e2d-42afd7154e0b nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.643308704 +0000 UTC m=+236.122458969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls") pod "image-registry-59bb8c8fb5-wllj8" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b") : secret "image-registry-tls" not found Jun 13 02:04:32.668204 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:32.668113 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x" event={"ID":"7daaef1d-38d0-4c25-a802-d920e657f398","Type":"ContainerStarted","Data":"4f35785de97f7aa391dc2410684ecf19728804e320c53c880b4e7b235ee60255"} Jun 13 02:04:32.684083 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:32.684030 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fs55x" podStartSLOduration=1.431391783 podStartE2EDuration="2.684009701s" totalImagesPullingTime="1.252617918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:32.682352761 +0000 UTC m=+234.161503037" watchObservedRunningTime="2026-06-13 02:04:32.684009701 +0000 UTC m=+234.163159976" Jun 13 02:04:33.673062 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:33.672979 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" event={"ID":"45293b1c-6b4f-4abd-a2cf-2d30a52103c0","Type":"ContainerStarted","Data":"97912265a2119ff228d3560dcf35b40173f6edb33963a1cbf2c1d7e83c105c73"} Jun 13 02:04:33.674379 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:33.674352 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" event={"ID":"b9f9a144-91b4-4b93-aa8e-b83432e8ce41","Type":"ContainerStarted","Data":"806bacc491becba33961293ea83b3b0d3f2081bf0dbe0810960f4aba3c95fbe8"} Jun 13 02:04:33.688930 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:33.688880 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" podStartSLOduration=1.400892324 podStartE2EDuration="3.688861814s" totalImagesPullingTime="2.28796949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:33.687524501 +0000 UTC m=+235.166674772" watchObservedRunningTime="2026-06-13 02:04:33.688861814 +0000 UTC m=+235.168012090" Jun 13 02:04:33.701433 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:33.701392 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" podStartSLOduration=1.396114652 podStartE2EDuration="3.701375631s" totalImagesPullingTime="2.305260979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:33.700612228 +0000 UTC m=+235.179762501" watchObservedRunningTime="2026-06-13 02:04:33.701375631 +0000 UTC m=+235.180525903" Jun 13 02:04:34.291081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.291050 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z9svn"] Jun 13 02:04:34.294273 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.294252 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.296633 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.296609 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 02:04:34.296855 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.296838 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6pdp8\"" Jun 13 02:04:34.297061 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.297043 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 02:04:34.307316 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.307294 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z9svn"] Jun 13 02:04:34.360831 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.360802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sczrk\" (UniqueName: \"kubernetes.io/projected/e32d4329-4112-4718-9e8b-f83b37c84559-kube-api-access-sczrk\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.360944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.360894 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.361031 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.360969 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.361031 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.360997 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e32d4329-4112-4718-9e8b-f83b37c84559-data-volume\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.361031 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.361029 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e32d4329-4112-4718-9e8b-f83b37c84559-crio-socket\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.461334 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.461299 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sczrk\" (UniqueName: \"kubernetes.io/projected/e32d4329-4112-4718-9e8b-f83b37c84559-kube-api-access-sczrk\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.461495 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.461341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:34.461495 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.461363 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:34.461495 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.461436 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 02:04:34.461495 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.461489 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert podName:bb14295a-9e1b-483c-8171-c427c3bedaad nodeName:}" failed. No retries permitted until 2026-06-13 02:04:38.461476255 +0000 UTC m=+239.940626505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hh6pd" (UID: "bb14295a-9e1b-483c-8171-c427c3bedaad") : secret "networking-console-plugin-cert" not found Jun 13 02:04:34.461719 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.461501 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle podName:79d3ca1c-dd15-46e6-b97e-ab817f52c686 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:38.461495132 +0000 UTC m=+239.940645382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle") pod "router-default-74b48dc66b-725zw" (UID: "79d3ca1c-dd15-46e6-b97e-ab817f52c686") : configmap references non-existent config key: service-ca.crt Jun 13 02:04:34.461719 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.461512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.461719 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.461547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.461719 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.461564 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e32d4329-4112-4718-9e8b-f83b37c84559-data-volume\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.461719 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.461580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:34.461719 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.461584 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:34.461719 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.461614 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e32d4329-4112-4718-9e8b-f83b37c84559-crio-socket\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.461719 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.461640 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm podName:e32d4329-4112-4718-9e8b-f83b37c84559 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.961621042 +0000 UTC m=+236.440771299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9svn" (UID: "e32d4329-4112-4718-9e8b-f83b37c84559") : configmap "kube-rbac-proxy" not found Jun 13 02:04:34.461719 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.461673 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:34.461719 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.461679 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e32d4329-4112-4718-9e8b-f83b37c84559-crio-socket\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.462094 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.461725 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 02:04:34.462094 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.461734 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls podName:e32d4329-4112-4718-9e8b-f83b37c84559 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.961719474 +0000 UTC m=+236.440869731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9svn" (UID: "e32d4329-4112-4718-9e8b-f83b37c84559") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:34.462094 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.461786 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs podName:79d3ca1c-dd15-46e6-b97e-ab817f52c686 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:38.461772806 +0000 UTC m=+239.940923070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs") pod "router-default-74b48dc66b-725zw" (UID: "79d3ca1c-dd15-46e6-b97e-ab817f52c686") : secret "router-metrics-certs-default" not found Jun 13 02:04:34.462094 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.461907 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e32d4329-4112-4718-9e8b-f83b37c84559-data-volume\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.468801 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.468774 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sczrk\" (UniqueName: \"kubernetes.io/projected/e32d4329-4112-4718-9e8b-f83b37c84559-kube-api-access-sczrk\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.562592 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.562506 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:34.562740 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.562652 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 02:04:34.562740 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.562720 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls podName:7a6ee75e-bba9-4a4b-90cd-f479cc5a3805 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:38.562704287 +0000 UTC m=+240.041854537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls") pod "cluster-samples-operator-9547488fd-bq4nk" (UID: "7a6ee75e-bba9-4a4b-90cd-f479cc5a3805") : secret "samples-operator-tls" not found Jun 13 02:04:34.663153 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.663101 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:34.663329 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.663260 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:04:34.663329 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.663281 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb8c8fb5-wllj8: secret "image-registry-tls" not found Jun 13 02:04:34.663398 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.663346 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls podName:079617cb-c115-4eb5-9e2d-42afd7154e0b nodeName:}" failed. No retries permitted until 2026-06-13 02:04:38.663330815 +0000 UTC m=+240.142481069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls") pod "image-registry-59bb8c8fb5-wllj8" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b") : secret "image-registry-tls" not found Jun 13 02:04:34.966195 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.966113 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.966195 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:34.966167 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:34.966576 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.966241 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:34.966576 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.966305 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm podName:e32d4329-4112-4718-9e8b-f83b37c84559 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:35.966289874 +0000 UTC m=+237.445440125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9svn" (UID: "e32d4329-4112-4718-9e8b-f83b37c84559") : configmap "kube-rbac-proxy" not found Jun 13 02:04:34.966576 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.966334 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:34.966576 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:34.966391 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls podName:e32d4329-4112-4718-9e8b-f83b37c84559 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:35.966375905 +0000 UTC m=+237.445526159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9svn" (UID: "e32d4329-4112-4718-9e8b-f83b37c84559") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:35.973432 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:35.973388 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:35.973801 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:35.973504 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:35.973801 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:35.973544 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:35.973801 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:35.973573 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:35.973801 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:35.973616 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm podName:e32d4329-4112-4718-9e8b-f83b37c84559 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:37.973602177 +0000 UTC m=+239.452752428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9svn" (UID: "e32d4329-4112-4718-9e8b-f83b37c84559") : configmap "kube-rbac-proxy" not found Jun 13 02:04:35.973801 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:35.973628 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls podName:e32d4329-4112-4718-9e8b-f83b37c84559 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:37.973622233 +0000 UTC m=+239.452772483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9svn" (UID: "e32d4329-4112-4718-9e8b-f83b37c84559") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:36.468471 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:36.468443 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q9k7s_aa14882d-ac61-40d0-94f3-22037f5816ce/dns-node-resolver/0.log" Jun 13 02:04:37.068892 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:37.068864 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5np24_6180dba6-1f27-479e-9a60-2e77d9399dbf/node-ca/0.log" Jun 13 02:04:37.869272 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:37.869247 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4qqmb_2303d56d-2e9a-4ff7-ba2e-a07b453a4c91/serve-healthcheck-canary/0.log" Jun 13 02:04:37.990419 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:37.990374 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:37.990590 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:37.990495 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:37.990590 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:37.990513 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:37.990590 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:37.990569 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls podName:e32d4329-4112-4718-9e8b-f83b37c84559 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:41.990555431 +0000 UTC m=+243.469705681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9svn" (UID: "e32d4329-4112-4718-9e8b-f83b37c84559") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:37.990590 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:37.990570 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:37.990748 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:37.990610 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm podName:e32d4329-4112-4718-9e8b-f83b37c84559 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:41.990599408 +0000 UTC m=+243.469749659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9svn" (UID: "e32d4329-4112-4718-9e8b-f83b37c84559") : configmap "kube-rbac-proxy" not found Jun 13 02:04:38.494230 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:38.494196 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:38.494605 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:38.494260 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:38.494605 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:38.494279 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:38.494605 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:38.494356 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 02:04:38.494605 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:38.494362 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 02:04:38.494605 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:38.494427 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle podName:79d3ca1c-dd15-46e6-b97e-ab817f52c686 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:46.494407898 +0000 UTC m=+247.973558167 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle") pod "router-default-74b48dc66b-725zw" (UID: "79d3ca1c-dd15-46e6-b97e-ab817f52c686") : configmap references non-existent config key: service-ca.crt Jun 13 02:04:38.494605 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:38.494447 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert podName:bb14295a-9e1b-483c-8171-c427c3bedaad nodeName:}" failed. No retries permitted until 2026-06-13 02:04:46.494438809 +0000 UTC m=+247.973589064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hh6pd" (UID: "bb14295a-9e1b-483c-8171-c427c3bedaad") : secret "networking-console-plugin-cert" not found Jun 13 02:04:38.494605 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:38.494461 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs podName:79d3ca1c-dd15-46e6-b97e-ab817f52c686 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:46.494453446 +0000 UTC m=+247.973603697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs") pod "router-default-74b48dc66b-725zw" (UID: "79d3ca1c-dd15-46e6-b97e-ab817f52c686") : secret "router-metrics-certs-default" not found Jun 13 02:04:38.594913 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:38.594879 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:38.595097 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:38.595052 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 02:04:38.595139 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:38.595115 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls podName:7a6ee75e-bba9-4a4b-90cd-f479cc5a3805 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:46.595100227 +0000 UTC m=+248.074250479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls") pod "cluster-samples-operator-9547488fd-bq4nk" (UID: "7a6ee75e-bba9-4a4b-90cd-f479cc5a3805") : secret "samples-operator-tls" not found Jun 13 02:04:38.695582 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:38.695556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:38.695738 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:38.695659 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:04:38.695738 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:38.695670 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bb8c8fb5-wllj8: secret "image-registry-tls" not found Jun 13 02:04:38.695738 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:38.695712 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls podName:079617cb-c115-4eb5-9e2d-42afd7154e0b nodeName:}" failed. No retries permitted until 2026-06-13 02:04:46.695700212 +0000 UTC m=+248.174850462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls") pod "image-registry-59bb8c8fb5-wllj8" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b") : secret "image-registry-tls" not found Jun 13 02:04:42.023394 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:42.023352 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:42.023796 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:42.023412 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:42.023796 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:42.023474 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:42.023796 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:42.023547 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm podName:e32d4329-4112-4718-9e8b-f83b37c84559 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:50.023531848 +0000 UTC m=+251.502682102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z9svn" (UID: "e32d4329-4112-4718-9e8b-f83b37c84559") : configmap "kube-rbac-proxy" not found Jun 13 02:04:42.023796 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:42.023550 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:42.023796 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:42.023597 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls podName:e32d4329-4112-4718-9e8b-f83b37c84559 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:50.023585722 +0000 UTC m=+251.502735973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z9svn" (UID: "e32d4329-4112-4718-9e8b-f83b37c84559") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:46.564386 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.564346 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:46.564386 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.564392 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:04:46.564844 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:46.564491 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 02:04:46.564844 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:04:46.564547 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert podName:bb14295a-9e1b-483c-8171-c427c3bedaad nodeName:}" failed. No retries permitted until 2026-06-13 02:05:02.564532815 +0000 UTC m=+264.043683070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hh6pd" (UID: "bb14295a-9e1b-483c-8171-c427c3bedaad") : secret "networking-console-plugin-cert" not found Jun 13 02:04:46.564844 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.564585 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:46.565044 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.565024 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d3ca1c-dd15-46e6-b97e-ab817f52c686-service-ca-bundle\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:46.566851 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.566834 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79d3ca1c-dd15-46e6-b97e-ab817f52c686-metrics-certs\") pod \"router-default-74b48dc66b-725zw\" (UID: \"79d3ca1c-dd15-46e6-b97e-ab817f52c686\") " pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:46.648018 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.647988 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-svcvx\"" Jun 13 02:04:46.656049 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.656030 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:46.665653 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.665626 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:46.668463 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.668432 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a6ee75e-bba9-4a4b-90cd-f479cc5a3805-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-bq4nk\" (UID: \"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:46.736294 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.736237 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rnpvp\"" Jun 13 02:04:46.744493 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.744468 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" Jun 13 02:04:46.766216 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.766187 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:46.768744 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.768711 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls\") pod \"image-registry-59bb8c8fb5-wllj8\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:46.781686 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.781649 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74b48dc66b-725zw"] Jun 13 02:04:46.784216 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:04:46.784191 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d3ca1c_dd15_46e6_b97e_ab817f52c686.slice/crio-4d57007640b7d678fb080aa4b26edaa112824442dd1b8cc385cd3d29c06992e3 WatchSource:0}: Error finding container 4d57007640b7d678fb080aa4b26edaa112824442dd1b8cc385cd3d29c06992e3: Status 404 returned error can't find the container with id 4d57007640b7d678fb080aa4b26edaa112824442dd1b8cc385cd3d29c06992e3 Jun 13 02:04:46.834929 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.834903 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x269m\"" Jun 13 02:04:46.842639 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.842603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:46.872125 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.872042 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk"] Jun 13 02:04:46.977480 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:46.977451 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59bb8c8fb5-wllj8"] Jun 13 02:04:46.979590 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:04:46.979560 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079617cb_c115_4eb5_9e2d_42afd7154e0b.slice/crio-a0ed17f06462187f5c3920faa26bc3de7f6465a639891132b9c649c47ae9b451 WatchSource:0}: Error finding container a0ed17f06462187f5c3920faa26bc3de7f6465a639891132b9c649c47ae9b451: Status 404 returned error can't find the container with id a0ed17f06462187f5c3920faa26bc3de7f6465a639891132b9c649c47ae9b451 Jun 13 02:04:47.715916 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:47.715879 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74b48dc66b-725zw" event={"ID":"79d3ca1c-dd15-46e6-b97e-ab817f52c686","Type":"ContainerStarted","Data":"6a841ef1e652650713d8686a18f9ef3ee66f1d678cba90278a35ed3ca061f0db"} Jun 13 02:04:47.716398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:47.715934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74b48dc66b-725zw" event={"ID":"79d3ca1c-dd15-46e6-b97e-ab817f52c686","Type":"ContainerStarted","Data":"4d57007640b7d678fb080aa4b26edaa112824442dd1b8cc385cd3d29c06992e3"} Jun 13 02:04:47.717254 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:47.717224 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" event={"ID":"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805","Type":"ContainerStarted","Data":"3c47a776d22b77842f14bd7df66a318e99e00fbe4f8ee616eb12a0964f65bcb3"} Jun 13 02:04:47.718860 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:47.718836 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" event={"ID":"079617cb-c115-4eb5-9e2d-42afd7154e0b","Type":"ContainerStarted","Data":"719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa"} Jun 13 02:04:47.718979 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:47.718877 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" event={"ID":"079617cb-c115-4eb5-9e2d-42afd7154e0b","Type":"ContainerStarted","Data":"a0ed17f06462187f5c3920faa26bc3de7f6465a639891132b9c649c47ae9b451"} Jun 13 02:04:47.719051 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:47.719001 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:04:47.737756 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:47.737703 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-74b48dc66b-725zw" podStartSLOduration=17.737685689 podStartE2EDuration="17.737685689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:47.737196988 +0000 UTC m=+249.216347273" watchObservedRunningTime="2026-06-13 02:04:47.737685689 +0000 UTC m=+249.216835962" Jun 13 02:04:47.756887 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:47.756830 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" podStartSLOduration=17.756811068 podStartE2EDuration="17.756811068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:47.756607237 +0000 UTC m=+249.235757532" watchObservedRunningTime="2026-06-13 02:04:47.756811068 +0000 UTC m=+249.235961342" Jun 13 02:04:48.656477 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:48.656454 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:48.659172 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:48.659148 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:48.723660 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:48.723626 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" event={"ID":"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805","Type":"ContainerStarted","Data":"e3017f1b803a7ea0eeaf20121785f84df68a836b95be6bced6c5543b8f63b45f"} Jun 13 02:04:48.724042 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:48.723687 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" event={"ID":"7a6ee75e-bba9-4a4b-90cd-f479cc5a3805","Type":"ContainerStarted","Data":"7613e7f1a11dd8e01dd7caa508ea4f31f54c8accee393bc9a2447cf3abd9715a"} Jun 13 02:04:48.724042 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:48.723911 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:48.725127 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:48.725105 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74b48dc66b-725zw" Jun 13 02:04:48.738030 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:48.737989 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-bq4nk" podStartSLOduration=17.106418834 podStartE2EDuration="18.737975335s" totalImagesPullingTime="1.631556501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:48.737165805 +0000 UTC m=+250.216316089" watchObservedRunningTime="2026-06-13 02:04:48.737975335 +0000 UTC m=+250.217125597" Jun 13 02:04:50.093253 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.093162 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:50.093253 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.093229 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:50.093738 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.093658 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e32d4329-4112-4718-9e8b-f83b37c84559-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:50.095516 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.095493 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e32d4329-4112-4718-9e8b-f83b37c84559-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z9svn\" (UID: \"e32d4329-4112-4718-9e8b-f83b37c84559\") " pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:50.205612 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.205584 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6pdp8\"" Jun 13 02:04:50.213633 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.213608 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z9svn" Jun 13 02:04:50.336255 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.336230 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z9svn"] Jun 13 02:04:50.338599 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:04:50.338564 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32d4329_4112_4718_9e8b_f83b37c84559.slice/crio-42040adafb01d988b70b8336112fc65bd956194cc200a69b14fba9d388045f2f WatchSource:0}: Error finding container 42040adafb01d988b70b8336112fc65bd956194cc200a69b14fba9d388045f2f: Status 404 returned error can't find the container with id 42040adafb01d988b70b8336112fc65bd956194cc200a69b14fba9d388045f2f Jun 13 02:04:50.731413 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.731381 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9svn" event={"ID":"e32d4329-4112-4718-9e8b-f83b37c84559","Type":"ContainerStarted","Data":"42040adafb01d988b70b8336112fc65bd956194cc200a69b14fba9d388045f2f"} Jun 13 02:04:50.799397 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.799359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:04:50.803261 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.803206 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0366e70-4c1a-496c-9928-ac65525e6b37-metrics-certs\") pod \"network-metrics-daemon-5977q\" (UID: \"c0366e70-4c1a-496c-9928-ac65525e6b37\") " pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:04:50.906927 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.906892 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sngzk\"" Jun 13 02:04:50.915362 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:50.915316 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5977q" Jun 13 02:04:51.075876 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:51.075783 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5977q"] Jun 13 02:04:51.078621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:04:51.078590 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0366e70_4c1a_496c_9928_ac65525e6b37.slice/crio-077e979fd4c71666e3d0330a235a0ea0edc35dbd9b1fa6a16e2a4c8a08b30101 WatchSource:0}: Error finding container 077e979fd4c71666e3d0330a235a0ea0edc35dbd9b1fa6a16e2a4c8a08b30101: Status 404 returned error can't find the container with id 077e979fd4c71666e3d0330a235a0ea0edc35dbd9b1fa6a16e2a4c8a08b30101 Jun 13 02:04:51.736526 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:51.736483 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5977q" event={"ID":"c0366e70-4c1a-496c-9928-ac65525e6b37","Type":"ContainerStarted","Data":"077e979fd4c71666e3d0330a235a0ea0edc35dbd9b1fa6a16e2a4c8a08b30101"} Jun 13 02:04:54.748846 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:54.748811 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5977q" event={"ID":"c0366e70-4c1a-496c-9928-ac65525e6b37","Type":"ContainerStarted","Data":"dddb2b4ad032493494b67a4ef6424afd4d9ba8ee972d6e9287a1e856c68de1e3"} Jun 13 02:04:54.749345 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:54.748873 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5977q" event={"ID":"c0366e70-4c1a-496c-9928-ac65525e6b37","Type":"ContainerStarted","Data":"2f9ed39ee6d9999c670cb27be532ce6ffe5ec1497a0d78f4feb67553ee808d9f"} Jun 13 02:04:54.750500 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:54.750476 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9svn" event={"ID":"e32d4329-4112-4718-9e8b-f83b37c84559","Type":"ContainerStarted","Data":"e12bf794d1d6d7525d753e406c8fa6f8ce5e76ffe7fb4b645872cb4b54d89268"} Jun 13 02:04:54.750591 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:54.750520 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9svn" event={"ID":"e32d4329-4112-4718-9e8b-f83b37c84559","Type":"ContainerStarted","Data":"433c6128b956407fa34b2a161e92aa8ddd044c3bf7fbbd40e97b89e3dff4b2c5"} Jun 13 02:04:54.763879 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:54.763836 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5977q" podStartSLOduration=252.902354962 podStartE2EDuration="4m15.763823695s" totalImagesPullingTime="2.861468733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:54.762836954 +0000 UTC m=+256.241987227" watchObservedRunningTime="2026-06-13 02:04:54.763823695 +0000 UTC m=+256.242973966" Jun 13 02:04:56.759330 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:56.759292 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z9svn" event={"ID":"e32d4329-4112-4718-9e8b-f83b37c84559","Type":"ContainerStarted","Data":"2efcd9a4899b783187af76aad643ecdb3c9a77f37266e8aa568bcfbed7454814"} Jun 13 02:04:56.776693 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:56.776641 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z9svn" podStartSLOduration=16.964711521 podStartE2EDuration="22.776623247s" totalImagesPullingTime="5.811911726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:04:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:56.776307671 +0000 UTC m=+258.255457952" watchObservedRunningTime="2026-06-13 02:04:56.776623247 +0000 UTC m=+258.255773520" Jun 13 02:04:58.775968 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:58.775918 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt"] Jun 13 02:04:58.779047 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:58.779020 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt" Jun 13 02:04:58.782657 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:58.782634 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mp7c2\"" Jun 13 02:04:58.782760 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:58.782679 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 13 02:04:58.787541 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:58.787517 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt"] Jun 13 02:04:58.795234 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:58.795214 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59bb8c8fb5-wllj8"] Jun 13 02:04:58.961860 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:58.961826 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5bcd7ef4-1a57-427e-8927-9d37604863a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-qlpjt\" (UID: \"5bcd7ef4-1a57-427e-8927-9d37604863a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt" Jun 13 02:04:59.062317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:59.062289 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5bcd7ef4-1a57-427e-8927-9d37604863a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-qlpjt\" (UID: \"5bcd7ef4-1a57-427e-8927-9d37604863a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt" Jun 13 02:04:59.064642 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:59.064616 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5bcd7ef4-1a57-427e-8927-9d37604863a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-qlpjt\" (UID: \"5bcd7ef4-1a57-427e-8927-9d37604863a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt" Jun 13 02:04:59.088099 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:59.088079 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt" Jun 13 02:04:59.233656 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:59.233633 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt"] Jun 13 02:04:59.235834 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:04:59.235808 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bcd7ef4_1a57_427e_8927_9d37604863a8.slice/crio-af1416ba72e61d8571cc8f876fa44dc358d046f47b7775fc40f82aaa8ef4c74e WatchSource:0}: Error finding container af1416ba72e61d8571cc8f876fa44dc358d046f47b7775fc40f82aaa8ef4c74e: Status 404 returned error can't find the container with id af1416ba72e61d8571cc8f876fa44dc358d046f47b7775fc40f82aaa8ef4c74e Jun 13 02:04:59.771114 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:04:59.771041 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt" event={"ID":"5bcd7ef4-1a57-427e-8927-9d37604863a8","Type":"ContainerStarted","Data":"af1416ba72e61d8571cc8f876fa44dc358d046f47b7775fc40f82aaa8ef4c74e"} Jun 13 02:05:00.775296 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:00.775268 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt" event={"ID":"5bcd7ef4-1a57-427e-8927-9d37604863a8","Type":"ContainerStarted","Data":"cad42b55d8a3b44271d8bf22ba6cf29dff18d5226a222560ae0f0cdaf84ee00f"} Jun 13 02:05:00.775687 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:00.775466 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt" Jun 13 02:05:00.779810 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:00.779790 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt" Jun 13 02:05:00.790069 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:00.789877 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-qlpjt" podStartSLOduration=1.5769647610000002 podStartE2EDuration="2.789863762s" totalImagesPullingTime="1.212899001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:00.789003236 +0000 UTC m=+262.268153507" watchObservedRunningTime="2026-06-13 02:05:00.789863762 +0000 UTC m=+262.269014034" Jun 13 02:05:02.588408 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:02.588345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:05:02.590824 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:02.590789 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb14295a-9e1b-483c-8171-c427c3bedaad-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hh6pd\" (UID: \"bb14295a-9e1b-483c-8171-c427c3bedaad\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:05:02.836165 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:02.836132 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5pvbx\"" Jun 13 02:05:02.844494 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:02.844418 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" Jun 13 02:05:02.968681 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:02.968651 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-hh6pd"] Jun 13 02:05:02.971285 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:05:02.971256 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb14295a_9e1b_483c_8171_c427c3bedaad.slice/crio-c003da76205c0c4a7716b9668381b43635efe66b18d04b730048fc0537e91607 WatchSource:0}: Error finding container c003da76205c0c4a7716b9668381b43635efe66b18d04b730048fc0537e91607: Status 404 returned error can't find the container with id c003da76205c0c4a7716b9668381b43635efe66b18d04b730048fc0537e91607 Jun 13 02:05:03.786386 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:03.786349 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" event={"ID":"bb14295a-9e1b-483c-8171-c427c3bedaad","Type":"ContainerStarted","Data":"c003da76205c0c4a7716b9668381b43635efe66b18d04b730048fc0537e91607"} Jun 13 02:05:04.791269 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:04.791224 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" event={"ID":"bb14295a-9e1b-483c-8171-c427c3bedaad","Type":"ContainerStarted","Data":"806c61f91d9a16600cf6794d17cbb01140ac6452194be2f230287691204f83c3"} Jun 13 02:05:04.806773 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:04.806715 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-hh6pd" podStartSLOduration=33.646619891 podStartE2EDuration="34.806698328s" totalImagesPullingTime="1.160078437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:04.805710522 +0000 UTC m=+266.284860794" watchObservedRunningTime="2026-06-13 02:05:04.806698328 +0000 UTC m=+266.285848599" Jun 13 02:05:06.450352 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.450320 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw"] Jun 13 02:05:06.454704 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.454685 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.457247 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.457223 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 02:05:06.458266 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.458244 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 02:05:06.458349 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.458252 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 13 02:05:06.458401 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.458385 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 13 02:05:06.458446 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.458439 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xgffd\"" Jun 13 02:05:06.458568 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.458551 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 02:05:06.462837 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.462814 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m"] Jun 13 02:05:06.465962 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.465923 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.467185 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.467162 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw"] Jun 13 02:05:06.468515 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.468499 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 13 02:05:06.468669 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.468648 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 13 02:05:06.468799 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.468648 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d4sw7\"" Jun 13 02:05:06.468879 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.468862 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 13 02:05:06.476969 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.476928 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n2kkx"] Jun 13 02:05:06.480122 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.480102 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m"] Jun 13 02:05:06.480224 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.480203 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.482698 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.482672 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 02:05:06.482698 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.482684 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 02:05:06.483008 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.482984 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rj66z\"" Jun 13 02:05:06.483008 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.482997 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 02:05:06.518323 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518294 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c3252ae-c97a-44da-9c3d-a7c6c8867574-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.518323 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518325 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf8dp\" (UniqueName: \"kubernetes.io/projected/e7a850ff-3894-437a-86b1-48b1d1235d8a-kube-api-access-cf8dp\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.518536 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518344 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8c3252ae-c97a-44da-9c3d-a7c6c8867574-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.518536 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518362 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-root\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.518536 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518411 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.518536 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518459 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.518536 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518489 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7a850ff-3894-437a-86b1-48b1d1235d8a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.518536 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518512 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.518736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518544 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-wtmp\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.518736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518561 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-tls\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.518736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518579 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-metrics-client-ca\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.518736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518608 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkbs2\" (UniqueName: \"kubernetes.io/projected/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-api-access-mkbs2\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.518736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518625 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7a850ff-3894-437a-86b1-48b1d1235d8a-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.518736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518641 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-sys\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.518736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-textfile\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.518736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518669 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6vv2\" (UniqueName: \"kubernetes.io/projected/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-kube-api-access-z6vv2\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.518736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518688 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.519064 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518740 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.519064 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.518776 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7a850ff-3894-437a-86b1-48b1d1235d8a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.619807 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.619771 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf8dp\" (UniqueName: \"kubernetes.io/projected/e7a850ff-3894-437a-86b1-48b1d1235d8a-kube-api-access-cf8dp\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.619807 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.619810 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8c3252ae-c97a-44da-9c3d-a7c6c8867574-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.620074 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.619833 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-root\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620074 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.619851 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620074 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.619889 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.620074 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.619914 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-root\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620074 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.619918 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7a850ff-3894-437a-86b1-48b1d1235d8a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.620074 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620035 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620074 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-wtmp\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620111 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-tls\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620145 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-metrics-client-ca\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620179 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkbs2\" (UniqueName: \"kubernetes.io/projected/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-api-access-mkbs2\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620203 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7a850ff-3894-437a-86b1-48b1d1235d8a-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:06.620223 2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620229 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-sys\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620251 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-wtmp\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-textfile\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:06.620282 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-tls podName:c5038f21-bf61-4ed4-9d5a-e56c8936af2a nodeName:}" failed. No retries permitted until 2026-06-13 02:05:07.120262524 +0000 UTC m=+268.599412790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-tls") pod "node-exporter-n2kkx" (UID: "c5038f21-bf61-4ed4-9d5a-e56c8936af2a") : secret "node-exporter-tls" not found Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620278 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8c3252ae-c97a-44da-9c3d-a7c6c8867574-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620323 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-sys\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620338 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6vv2\" (UniqueName: \"kubernetes.io/projected/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-kube-api-access-z6vv2\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.620428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620422 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.621117 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620452 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7a850ff-3894-437a-86b1-48b1d1235d8a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.621117 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620489 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c3252ae-c97a-44da-9c3d-a7c6c8867574-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.621117 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620516 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.621117 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:06.620618 2557 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 13 02:05:06.621117 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:06.620671 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-tls podName:8c3252ae-c97a-44da-9c3d-a7c6c8867574 nodeName:}" failed. No retries permitted until 2026-06-13 02:05:07.120651698 +0000 UTC m=+268.599801962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-7tj6m" (UID: "8c3252ae-c97a-44da-9c3d-a7c6c8867574") : secret "kube-state-metrics-tls" not found Jun 13 02:05:06.621117 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:06.620734 2557 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 13 02:05:06.621117 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:06.620771 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a850ff-3894-437a-86b1-48b1d1235d8a-openshift-state-metrics-tls podName:e7a850ff-3894-437a-86b1-48b1d1235d8a nodeName:}" failed. No retries permitted until 2026-06-13 02:05:07.120759188 +0000 UTC m=+268.599909444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e7a850ff-3894-437a-86b1-48b1d1235d8a-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-rchpw" (UID: "e7a850ff-3894-437a-86b1-48b1d1235d8a") : secret "openshift-state-metrics-tls" not found Jun 13 02:05:06.621117 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.620867 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7a850ff-3894-437a-86b1-48b1d1235d8a-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.621552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.621172 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c3252ae-c97a-44da-9c3d-a7c6c8867574-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.621552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.621312 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-textfile\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.621552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.621321 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.621552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.621408 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-metrics-client-ca\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.622531 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.622510 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7a850ff-3894-437a-86b1-48b1d1235d8a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.622628 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.622608 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.623143 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.623127 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:06.628863 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.628835 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf8dp\" (UniqueName: \"kubernetes.io/projected/e7a850ff-3894-437a-86b1-48b1d1235d8a-kube-api-access-cf8dp\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:06.629065 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.629046 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkbs2\" (UniqueName: \"kubernetes.io/projected/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-api-access-mkbs2\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:06.630111 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:06.630091 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6vv2\" (UniqueName: \"kubernetes.io/projected/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-kube-api-access-z6vv2\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:07.124427 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.124378 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-tls\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:07.124582 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.124451 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:07.124582 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.124470 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7a850ff-3894-437a-86b1-48b1d1235d8a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:07.126727 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.126700 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7a850ff-3894-437a-86b1-48b1d1235d8a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-rchpw\" (UID: \"e7a850ff-3894-437a-86b1-48b1d1235d8a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:07.126842 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.126788 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5038f21-bf61-4ed4-9d5a-e56c8936af2a-node-exporter-tls\") pod \"node-exporter-n2kkx\" (UID: \"c5038f21-bf61-4ed4-9d5a-e56c8936af2a\") " pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:07.127336 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.127319 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c3252ae-c97a-44da-9c3d-a7c6c8867574-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-7tj6m\" (UID: \"8c3252ae-c97a-44da-9c3d-a7c6c8867574\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:07.363525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.363486 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" Jun 13 02:05:07.376718 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.376663 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" Jun 13 02:05:07.390799 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.390776 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n2kkx" Jun 13 02:05:07.462563 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:05:07.461852 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5038f21_bf61_4ed4_9d5a_e56c8936af2a.slice/crio-132493cc0c0740f2c586d32dd39bfae4bff234834a8a1958a6ddeca4c4c35d59 WatchSource:0}: Error finding container 132493cc0c0740f2c586d32dd39bfae4bff234834a8a1958a6ddeca4c4c35d59: Status 404 returned error can't find the container with id 132493cc0c0740f2c586d32dd39bfae4bff234834a8a1958a6ddeca4c4c35d59 Jun 13 02:05:07.543992 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.543932 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 02:05:07.551777 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:05:07.551747 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a850ff_3894_437a_86b1_48b1d1235d8a.slice/crio-480e9c31baa59a8743604023867f8be5550fd49f736c3cea504ba3a0f85333a5 WatchSource:0}: Error finding container 480e9c31baa59a8743604023867f8be5550fd49f736c3cea504ba3a0f85333a5: Status 404 returned error can't find the container with id 480e9c31baa59a8743604023867f8be5550fd49f736c3cea504ba3a0f85333a5 Jun 13 02:05:07.564296 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.564274 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw"] Jun 13 02:05:07.564378 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.564314 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 02:05:07.564441 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.564421 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.567525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.567490 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g4764\"" Jun 13 02:05:07.567525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.567501 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 13 02:05:07.567766 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.567750 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 13 02:05:07.567865 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.567848 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 13 02:05:07.567943 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.567929 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 13 02:05:07.568023 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.567761 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 13 02:05:07.568825 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.568409 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 13 02:05:07.568825 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.568471 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 13 02:05:07.568825 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.568604 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 13 02:05:07.568825 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.568662 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 13 02:05:07.569235 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.568917 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m"] Jun 13 02:05:07.570878 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:05:07.570860 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3252ae_c97a_44da_9c3d_a7c6c8867574.slice/crio-b955e49f1c31e874352ff0d77e3fb25b9f9c2a2fe9e4893840548d3866fc02b3 WatchSource:0}: Error finding container b955e49f1c31e874352ff0d77e3fb25b9f9c2a2fe9e4893840548d3866fc02b3: Status 404 returned error can't find the container with id b955e49f1c31e874352ff0d77e3fb25b9f9c2a2fe9e4893840548d3866fc02b3 Jun 13 02:05:07.629908 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.629853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630024 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.629907 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630024 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.629992 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630130 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.630034 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630130 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.630062 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630130 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.630091 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlqx2\" (UniqueName: \"kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-kube-api-access-tlqx2\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630233 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.630205 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630269 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.630244 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-out\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630306 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.630277 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-volume\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630349 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.630308 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630349 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.630326 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-web-config\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630349 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.630339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.630443 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.630368 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.731782 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.731755 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-out\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.731890 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.731795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-volume\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.731890 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.731813 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732029 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:07.731927 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-trusted-ca-bundle podName:b177b3c9-87d0-4c92-a1ad-334b9ad2c083 nodeName:}" failed. No retries permitted until 2026-06-13 02:05:08.231904524 +0000 UTC m=+269.711054798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083") : configmap references non-existent config key: ca-bundle.crt Jun 13 02:05:07.732029 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.731960 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-web-config\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732029 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.731985 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732029 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.732005 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732242 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.732151 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732351 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.732237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732351 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.732279 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732351 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.732305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732351 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.732331 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732544 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.732361 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlqx2\" (UniqueName: \"kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-kube-api-access-tlqx2\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732544 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.732420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.732544 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:07.732509 2557 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 13 02:05:07.732696 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:07.732572 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-main-tls podName:b177b3c9-87d0-4c92-a1ad-334b9ad2c083 nodeName:}" failed. No retries permitted until 2026-06-13 02:05:08.232556429 +0000 UTC m=+269.711706683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083") : secret "alertmanager-main-tls" not found Jun 13 02:05:07.732808 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.732784 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.733098 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.733076 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.735863 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.735835 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.735995 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.735898 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-web-config\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.736174 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.736129 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.736439 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.736392 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-volume\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.736662 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.736641 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-out\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.736922 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.736902 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.737197 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.737178 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.737338 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.737323 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.742194 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.742171 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlqx2\" (UniqueName: \"kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-kube-api-access-tlqx2\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:07.803168 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.803126 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2kkx" event={"ID":"c5038f21-bf61-4ed4-9d5a-e56c8936af2a","Type":"ContainerStarted","Data":"132493cc0c0740f2c586d32dd39bfae4bff234834a8a1958a6ddeca4c4c35d59"} Jun 13 02:05:07.804817 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.804780 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" event={"ID":"e7a850ff-3894-437a-86b1-48b1d1235d8a","Type":"ContainerStarted","Data":"99921ab89ecdf80fb1d9cf85d46216ff6f0963113644054d185c1351f7d719db"} Jun 13 02:05:07.804931 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.804838 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" event={"ID":"e7a850ff-3894-437a-86b1-48b1d1235d8a","Type":"ContainerStarted","Data":"aee5784bb9c0d4dd26fa5592897d654faf12cdfe9c0dd8fd6444cae9b64917c4"} Jun 13 02:05:07.804931 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.804867 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" event={"ID":"e7a850ff-3894-437a-86b1-48b1d1235d8a","Type":"ContainerStarted","Data":"480e9c31baa59a8743604023867f8be5550fd49f736c3cea504ba3a0f85333a5"} Jun 13 02:05:07.805835 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:07.805815 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" event={"ID":"8c3252ae-c97a-44da-9c3d-a7c6c8867574","Type":"ContainerStarted","Data":"b955e49f1c31e874352ff0d77e3fb25b9f9c2a2fe9e4893840548d3866fc02b3"} Jun 13 02:05:08.236405 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:08.236337 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:08.236688 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:08.236417 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:08.237287 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:08.237243 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:08.239407 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:08.239380 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:08.476630 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:08.476591 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:05:08.636512 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:08.636482 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 02:05:08.801671 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:08.801623 2557 patch_prober.go:28] interesting pod/image-registry-59bb8c8fb5-wllj8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 02:05:08.801810 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:08.801683 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" podUID="079617cb-c115-4eb5-9e2d-42afd7154e0b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:05:08.811446 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:08.811419 2557 generic.go:356] "Generic (PLEG): container finished" podID="c5038f21-bf61-4ed4-9d5a-e56c8936af2a" containerID="bf7b425b44065b523356bc80437e9dc0684a1302c3689d505ee807ea50eff9b7" exitCode=0 Jun 13 02:05:08.811569 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:08.811474 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2kkx" event={"ID":"c5038f21-bf61-4ed4-9d5a-e56c8936af2a","Type":"ContainerDied","Data":"bf7b425b44065b523356bc80437e9dc0684a1302c3689d505ee807ea50eff9b7"} Jun 13 02:05:09.085265 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:05:09.085198 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb177b3c9_87d0_4c92_a1ad_334b9ad2c083.slice/crio-c294462ad314a6733c3b027afed8b11fed470b400b84e14bc72ef07398ef95d6 WatchSource:0}: Error finding container c294462ad314a6733c3b027afed8b11fed470b400b84e14bc72ef07398ef95d6: Status 404 returned error can't find the container with id c294462ad314a6733c3b027afed8b11fed470b400b84e14bc72ef07398ef95d6 Jun 13 02:05:09.818114 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:09.818070 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2kkx" event={"ID":"c5038f21-bf61-4ed4-9d5a-e56c8936af2a","Type":"ContainerStarted","Data":"ce7b4429d1ce2a36e7ca822d44cb2d451ccd082f6c73d44ec0d5b646665f4e3b"} Jun 13 02:05:09.818585 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:09.818173 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2kkx" event={"ID":"c5038f21-bf61-4ed4-9d5a-e56c8936af2a","Type":"ContainerStarted","Data":"94ee93804807732cc1a747876b4dc2142869ff44b605b236ca2a1c801460068f"} Jun 13 02:05:09.820215 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:09.820189 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" event={"ID":"e7a850ff-3894-437a-86b1-48b1d1235d8a","Type":"ContainerStarted","Data":"1a258780f1a0240711bf7e00ce99d2ae3ae09d7d6cc5939165239d49cc44dde4"} Jun 13 02:05:09.822367 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:09.822338 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" event={"ID":"8c3252ae-c97a-44da-9c3d-a7c6c8867574","Type":"ContainerStarted","Data":"95018652721ef3fe0b1cc6c9a9339239181f12d1a53dfc8dc803690876df7a30"} Jun 13 02:05:09.822465 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:09.822396 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" event={"ID":"8c3252ae-c97a-44da-9c3d-a7c6c8867574","Type":"ContainerStarted","Data":"817bfbdf6ff8655e4110efafd70ad5e48c1cb48c8d613912aa97e3628c80ed02"} Jun 13 02:05:09.822465 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:09.822422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" event={"ID":"8c3252ae-c97a-44da-9c3d-a7c6c8867574","Type":"ContainerStarted","Data":"b259c6a2b4ed89885c003dc283d277bd7457f1312ac4fd91f5d7416d5beb97af"} Jun 13 02:05:09.823443 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:09.823424 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerStarted","Data":"c294462ad314a6733c3b027afed8b11fed470b400b84e14bc72ef07398ef95d6"} Jun 13 02:05:09.836890 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:09.836845 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n2kkx" podStartSLOduration=2.831715967 podStartE2EDuration="3.83683062s" totalImagesPullingTime="919.925906ms" totalInitContainerRuntime="85.188747ms" isStatefulPod=true podCreationTimestamp="2026-06-13 02:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:09.83486266 +0000 UTC m=+271.314012932" watchObservedRunningTime="2026-06-13 02:05:09.83683062 +0000 UTC m=+271.315980885" Jun 13 02:05:09.852530 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:09.852489 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7tj6m" podStartSLOduration=2.286598868 podStartE2EDuration="3.852475362s" totalImagesPullingTime="1.565876494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:09.851142994 +0000 UTC m=+271.330293265" watchObservedRunningTime="2026-06-13 02:05:09.852475362 +0000 UTC m=+271.331625633" Jun 13 02:05:09.867447 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:09.867396 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rchpw" podStartSLOduration=2.488167656 podStartE2EDuration="3.867378262s" totalImagesPullingTime="1.379210606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:09.866206913 +0000 UTC m=+271.345357206" watchObservedRunningTime="2026-06-13 02:05:09.867378262 +0000 UTC m=+271.346528534" Jun 13 02:05:10.828368 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.828336 2557 generic.go:356] "Generic (PLEG): container finished" podID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerID="969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35" exitCode=0 Jun 13 02:05:10.828726 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.828428 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerDied","Data":"969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35"} Jun 13 02:05:10.863022 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.862995 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-647467fc44-d7grc"] Jun 13 02:05:10.866140 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.866126 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:10.868719 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.868700 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 13 02:05:10.868833 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.868704 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-p27wx\"" Jun 13 02:05:10.868907 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.868892 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 13 02:05:10.869030 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.869008 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1qecp55laeves\"" Jun 13 02:05:10.869102 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.869095 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 13 02:05:10.869156 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.869135 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 13 02:05:10.874897 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.874845 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-647467fc44-d7grc"] Jun 13 02:05:10.959071 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.959029 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsh8k\" (UniqueName: \"kubernetes.io/projected/8588be49-aa7d-4dca-9405-2516b273ef86-kube-api-access-jsh8k\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:10.959071 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.959079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8588be49-aa7d-4dca-9405-2516b273ef86-secret-metrics-server-client-certs\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:10.959276 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.959101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8588be49-aa7d-4dca-9405-2516b273ef86-metrics-server-audit-profiles\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:10.959276 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.959121 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8588be49-aa7d-4dca-9405-2516b273ef86-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:10.959276 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.959164 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8588be49-aa7d-4dca-9405-2516b273ef86-audit-log\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:10.959276 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.959236 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8588be49-aa7d-4dca-9405-2516b273ef86-client-ca-bundle\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:10.959398 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:10.959290 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8588be49-aa7d-4dca-9405-2516b273ef86-secret-metrics-server-tls\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.059646 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.059612 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8588be49-aa7d-4dca-9405-2516b273ef86-secret-metrics-server-tls\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.059804 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.059657 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsh8k\" (UniqueName: \"kubernetes.io/projected/8588be49-aa7d-4dca-9405-2516b273ef86-kube-api-access-jsh8k\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.059804 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.059680 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8588be49-aa7d-4dca-9405-2516b273ef86-secret-metrics-server-client-certs\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.059804 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.059710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8588be49-aa7d-4dca-9405-2516b273ef86-metrics-server-audit-profiles\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.059804 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.059730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8588be49-aa7d-4dca-9405-2516b273ef86-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.059804 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.059750 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8588be49-aa7d-4dca-9405-2516b273ef86-audit-log\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.059804 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.059801 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8588be49-aa7d-4dca-9405-2516b273ef86-client-ca-bundle\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.060310 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.060260 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8588be49-aa7d-4dca-9405-2516b273ef86-audit-log\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.060535 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.060506 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8588be49-aa7d-4dca-9405-2516b273ef86-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.060973 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.060923 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8588be49-aa7d-4dca-9405-2516b273ef86-metrics-server-audit-profiles\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.062354 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.062332 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8588be49-aa7d-4dca-9405-2516b273ef86-secret-metrics-server-tls\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.062354 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.062347 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8588be49-aa7d-4dca-9405-2516b273ef86-client-ca-bundle\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.062473 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.062458 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8588be49-aa7d-4dca-9405-2516b273ef86-secret-metrics-server-client-certs\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.067277 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.067258 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsh8k\" (UniqueName: \"kubernetes.io/projected/8588be49-aa7d-4dca-9405-2516b273ef86-kube-api-access-jsh8k\") pod \"metrics-server-647467fc44-d7grc\" (UID: \"8588be49-aa7d-4dca-9405-2516b273ef86\") " pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.175686 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.175614 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:11.306838 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.306812 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-647467fc44-d7grc"] Jun 13 02:05:11.308621 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:05:11.308596 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8588be49_aa7d_4dca_9405_2516b273ef86.slice/crio-6255ef49a07142e5e51b9625c3605539f257511c547719b1f58904318f727602 WatchSource:0}: Error finding container 6255ef49a07142e5e51b9625c3605539f257511c547719b1f58904318f727602: Status 404 returned error can't find the container with id 6255ef49a07142e5e51b9625c3605539f257511c547719b1f58904318f727602 Jun 13 02:05:11.832799 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:11.832763 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-647467fc44-d7grc" event={"ID":"8588be49-aa7d-4dca-9405-2516b273ef86","Type":"ContainerStarted","Data":"6255ef49a07142e5e51b9625c3605539f257511c547719b1f58904318f727602"} Jun 13 02:05:13.845485 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:13.845446 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-647467fc44-d7grc" event={"ID":"8588be49-aa7d-4dca-9405-2516b273ef86","Type":"ContainerStarted","Data":"96d99ba4e1aa431182833dc36f284e172cc1e686b343039469805ed603f5cf75"} Jun 13 02:05:13.848733 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:13.848696 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerStarted","Data":"f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087"} Jun 13 02:05:13.848924 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:13.848765 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerStarted","Data":"8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1"} Jun 13 02:05:13.848924 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:13.848814 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerStarted","Data":"68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb"} Jun 13 02:05:13.848924 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:13.848852 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerStarted","Data":"12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d"} Jun 13 02:05:13.848924 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:13.848891 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerStarted","Data":"eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa"} Jun 13 02:05:13.863229 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:13.863186 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-647467fc44-d7grc" podStartSLOduration=1.9586201619999999 podStartE2EDuration="3.863171209s" totalImagesPullingTime="1.904551047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:13.861540353 +0000 UTC m=+275.340690626" watchObservedRunningTime="2026-06-13 02:05:13.863171209 +0000 UTC m=+275.342321480" Jun 13 02:05:14.856334 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:14.856298 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerStarted","Data":"3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032"} Jun 13 02:05:14.882599 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:14.882532 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.7586871630000003 podStartE2EDuration="7.882510488s" totalImagesPullingTime="4.107249541s" totalInitContainerRuntime="16.573784ms" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:14.880911805 +0000 UTC m=+276.360062071" watchObservedRunningTime="2026-06-13 02:05:14.882510488 +0000 UTC m=+276.361660761" Jun 13 02:05:18.799982 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:18.799929 2557 patch_prober.go:28] interesting pod/image-registry-59bb8c8fb5-wllj8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 02:05:18.800328 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:18.800000 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" podUID="079617cb-c115-4eb5-9e2d-42afd7154e0b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:05:20.481804 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:20.481761 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kmq5z" podUID="44ad9c9f-e870-462a-bb6b-4eee24c316e2" Jun 13 02:05:20.879908 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:20.879880 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kmq5z" Jun 13 02:05:23.814900 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:23.814837 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" podUID="079617cb-c115-4eb5-9e2d-42afd7154e0b" containerName="registry" containerID="cri-o://719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa" gracePeriod=30 Jun 13 02:05:24.053263 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.053240 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:05:24.172554 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.172463 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-trusted-ca\") pod \"079617cb-c115-4eb5-9e2d-42afd7154e0b\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " Jun 13 02:05:24.172554 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.172513 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-certificates\") pod \"079617cb-c115-4eb5-9e2d-42afd7154e0b\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " Jun 13 02:05:24.172554 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.172533 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/079617cb-c115-4eb5-9e2d-42afd7154e0b-ca-trust-extracted\") pod \"079617cb-c115-4eb5-9e2d-42afd7154e0b\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " Jun 13 02:05:24.172554 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.172552 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-bound-sa-token\") pod \"079617cb-c115-4eb5-9e2d-42afd7154e0b\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " Jun 13 02:05:24.172864 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.172616 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls\") pod \"079617cb-c115-4eb5-9e2d-42afd7154e0b\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " Jun 13 02:05:24.172864 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.172653 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-image-registry-private-configuration\") pod \"079617cb-c115-4eb5-9e2d-42afd7154e0b\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " Jun 13 02:05:24.172864 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.172826 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-installation-pull-secrets\") pod \"079617cb-c115-4eb5-9e2d-42afd7154e0b\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " Jun 13 02:05:24.173038 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.172887 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2wbw\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-kube-api-access-g2wbw\") pod \"079617cb-c115-4eb5-9e2d-42afd7154e0b\" (UID: \"079617cb-c115-4eb5-9e2d-42afd7154e0b\") " Jun 13 02:05:24.173038 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.172991 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "079617cb-c115-4eb5-9e2d-42afd7154e0b" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:05:24.173038 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.173002 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "079617cb-c115-4eb5-9e2d-42afd7154e0b" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:05:24.173250 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.173222 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-trusted-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:05:24.173377 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.173253 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-certificates\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:05:24.175307 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.175275 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "079617cb-c115-4eb5-9e2d-42afd7154e0b" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:05:24.175414 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.175376 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "079617cb-c115-4eb5-9e2d-42afd7154e0b" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:05:24.175468 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.175456 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "079617cb-c115-4eb5-9e2d-42afd7154e0b" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:05:24.175566 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.175551 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "079617cb-c115-4eb5-9e2d-42afd7154e0b" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:05:24.175728 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.175712 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-kube-api-access-g2wbw" (OuterVolumeSpecName: "kube-api-access-g2wbw") pod "079617cb-c115-4eb5-9e2d-42afd7154e0b" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b"). InnerVolumeSpecName "kube-api-access-g2wbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:05:24.180562 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.180537 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/079617cb-c115-4eb5-9e2d-42afd7154e0b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "079617cb-c115-4eb5-9e2d-42afd7154e0b" (UID: "079617cb-c115-4eb5-9e2d-42afd7154e0b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:05:24.273801 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.273754 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:05:24.273944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.273835 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-registry-tls\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:05:24.273944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.273846 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-image-registry-private-configuration\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:05:24.273944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.273854 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/079617cb-c115-4eb5-9e2d-42afd7154e0b-installation-pull-secrets\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:05:24.273944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.273863 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2wbw\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-kube-api-access-g2wbw\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:05:24.273944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.273872 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/079617cb-c115-4eb5-9e2d-42afd7154e0b-ca-trust-extracted\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:05:24.273944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.273880 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/079617cb-c115-4eb5-9e2d-42afd7154e0b-bound-sa-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:05:24.275936 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.275918 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ad9c9f-e870-462a-bb6b-4eee24c316e2-metrics-tls\") pod \"dns-default-kmq5z\" (UID: \"44ad9c9f-e870-462a-bb6b-4eee24c316e2\") " pod="openshift-dns/dns-default-kmq5z" Jun 13 02:05:24.484286 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.484202 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bc58g\"" Jun 13 02:05:24.491269 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.491247 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kmq5z" Jun 13 02:05:24.620907 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.620881 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kmq5z"] Jun 13 02:05:24.623209 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:05:24.623179 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ad9c9f_e870_462a_bb6b_4eee24c316e2.slice/crio-14e2be459fda4a1f1a9e7454c808903558ad484ba3315f454feb973f9ddc9e45 WatchSource:0}: Error finding container 14e2be459fda4a1f1a9e7454c808903558ad484ba3315f454feb973f9ddc9e45: Status 404 returned error can't find the container with id 14e2be459fda4a1f1a9e7454c808903558ad484ba3315f454feb973f9ddc9e45 Jun 13 02:05:24.895856 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.895822 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kmq5z" event={"ID":"44ad9c9f-e870-462a-bb6b-4eee24c316e2","Type":"ContainerStarted","Data":"14e2be459fda4a1f1a9e7454c808903558ad484ba3315f454feb973f9ddc9e45"} Jun 13 02:05:24.897138 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.897114 2557 generic.go:356] "Generic (PLEG): container finished" podID="079617cb-c115-4eb5-9e2d-42afd7154e0b" containerID="719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa" exitCode=0 Jun 13 02:05:24.897260 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.897153 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" event={"ID":"079617cb-c115-4eb5-9e2d-42afd7154e0b","Type":"ContainerDied","Data":"719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa"} Jun 13 02:05:24.897260 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.897158 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" Jun 13 02:05:24.897260 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.897180 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bb8c8fb5-wllj8" event={"ID":"079617cb-c115-4eb5-9e2d-42afd7154e0b","Type":"ContainerDied","Data":"a0ed17f06462187f5c3920faa26bc3de7f6465a639891132b9c649c47ae9b451"} Jun 13 02:05:24.897260 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.897218 2557 scope.go:117] "RemoveContainer" containerID="719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa" Jun 13 02:05:24.914139 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.914125 2557 scope.go:117] "RemoveContainer" containerID="719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa" Jun 13 02:05:24.914381 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:05:24.914361 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa\": container with ID starting with 719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa not found: ID does not exist" containerID="719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa" Jun 13 02:05:24.914427 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.914389 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa"} err="failed to get container status \"719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa\": rpc error: code = NotFound desc = could not find container \"719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa\": container with ID starting with 719d7a8f242371a265b5b70fb2c20641bff4aca619cc7f130de91b81006f7eaa not found: ID does not exist" Jun 13 02:05:24.918013 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.917993 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59bb8c8fb5-wllj8"] Jun 13 02:05:24.921023 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:24.921003 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59bb8c8fb5-wllj8"] Jun 13 02:05:25.007137 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:25.007110 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="079617cb-c115-4eb5-9e2d-42afd7154e0b" path="/var/lib/kubelet/pods/079617cb-c115-4eb5-9e2d-42afd7154e0b/volumes" Jun 13 02:05:26.911894 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:26.911861 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kmq5z" event={"ID":"44ad9c9f-e870-462a-bb6b-4eee24c316e2","Type":"ContainerStarted","Data":"9c5d408948f09bad0ea00976cec84631ac03e363bf101fe8d1f5da12eb8ac769"} Jun 13 02:05:26.912286 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:26.911931 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kmq5z" event={"ID":"44ad9c9f-e870-462a-bb6b-4eee24c316e2","Type":"ContainerStarted","Data":"6c4723d16edd67dc801df7d07ccf240cb7cee9aa147ceaf4c68e1b4a47afe598"} Jun 13 02:05:26.912286 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:26.912001 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kmq5z" Jun 13 02:05:26.927880 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:26.927833 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kmq5z" podStartSLOduration=251.044640048 podStartE2EDuration="4m12.927815275s" totalImagesPullingTime="1.883175227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:26.92726514 +0000 UTC m=+288.406415412" watchObservedRunningTime="2026-06-13 02:05:26.927815275 +0000 UTC m=+288.406965552" Jun 13 02:05:27.301628 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.301589 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-xmjm4"] Jun 13 02:05:27.301904 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.301892 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="079617cb-c115-4eb5-9e2d-42afd7154e0b" containerName="registry" Jun 13 02:05:27.301966 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.301906 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="079617cb-c115-4eb5-9e2d-42afd7154e0b" containerName="registry" Jun 13 02:05:27.302013 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.302000 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="079617cb-c115-4eb5-9e2d-42afd7154e0b" containerName="registry" Jun 13 02:05:27.304317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.304295 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-xmjm4" Jun 13 02:05:27.306856 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.306827 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 13 02:05:27.307044 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.306903 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 13 02:05:27.307044 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.306969 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8lxgl\"" Jun 13 02:05:27.314127 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.314104 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-xmjm4"] Jun 13 02:05:27.400777 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.400741 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbm8p\" (UniqueName: \"kubernetes.io/projected/fffe19d4-087b-4d0a-812e-16525e5d6f60-kube-api-access-mbm8p\") pod \"downloads-694c955b9-xmjm4\" (UID: \"fffe19d4-087b-4d0a-812e-16525e5d6f60\") " pod="openshift-console/downloads-694c955b9-xmjm4" Jun 13 02:05:27.501458 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.501417 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbm8p\" (UniqueName: \"kubernetes.io/projected/fffe19d4-087b-4d0a-812e-16525e5d6f60-kube-api-access-mbm8p\") pod \"downloads-694c955b9-xmjm4\" (UID: \"fffe19d4-087b-4d0a-812e-16525e5d6f60\") " pod="openshift-console/downloads-694c955b9-xmjm4" Jun 13 02:05:27.509270 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.509239 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbm8p\" (UniqueName: \"kubernetes.io/projected/fffe19d4-087b-4d0a-812e-16525e5d6f60-kube-api-access-mbm8p\") pod \"downloads-694c955b9-xmjm4\" (UID: \"fffe19d4-087b-4d0a-812e-16525e5d6f60\") " pod="openshift-console/downloads-694c955b9-xmjm4" Jun 13 02:05:27.615248 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.615167 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-xmjm4" Jun 13 02:05:27.765994 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.765972 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-xmjm4"] Jun 13 02:05:27.767933 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:05:27.767908 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffe19d4_087b_4d0a_812e_16525e5d6f60.slice/crio-6dacd672111e195a8b8a15f1f9f9236c59a242864d90301fadef396c995b4650 WatchSource:0}: Error finding container 6dacd672111e195a8b8a15f1f9f9236c59a242864d90301fadef396c995b4650: Status 404 returned error can't find the container with id 6dacd672111e195a8b8a15f1f9f9236c59a242864d90301fadef396c995b4650 Jun 13 02:05:27.917013 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:27.916903 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-xmjm4" event={"ID":"fffe19d4-087b-4d0a-812e-16525e5d6f60","Type":"ContainerStarted","Data":"6dacd672111e195a8b8a15f1f9f9236c59a242864d90301fadef396c995b4650"} Jun 13 02:05:31.176046 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:31.176007 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:31.176536 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:31.176082 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:36.919161 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:36.919129 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kmq5z" Jun 13 02:05:38.635576 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.635539 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5856f7886b-4bjcw"] Jun 13 02:05:38.640585 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.640561 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.644279 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.644066 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 02:05:38.644279 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.644082 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 02:05:38.644279 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.644084 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 02:05:38.644279 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.644147 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vxpmj\"" Jun 13 02:05:38.644279 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.644068 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 02:05:38.644279 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.644152 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 02:05:38.647427 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.647405 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5856f7886b-4bjcw"] Jun 13 02:05:38.799322 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.799279 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-service-ca\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.799501 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.799337 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-serving-cert\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.799501 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.799408 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gckf2\" (UniqueName: \"kubernetes.io/projected/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-kube-api-access-gckf2\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.799606 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.799511 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-oauth-config\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.799662 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.799599 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-config\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.799662 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.799646 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-oauth-serving-cert\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.900259 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.900180 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-oauth-serving-cert\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.900259 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.900232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-service-ca\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.900487 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.900272 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-serving-cert\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.900487 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.900298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gckf2\" (UniqueName: \"kubernetes.io/projected/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-kube-api-access-gckf2\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.900487 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.900365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-oauth-config\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.901175 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.901151 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-config\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.902846 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.902819 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 02:05:38.903141 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.903120 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 02:05:38.903903 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.903886 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 02:05:38.904020 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.903933 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 02:05:38.904447 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.904425 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 02:05:38.909762 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.909126 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gckf2\" (UniqueName: \"kubernetes.io/projected/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-kube-api-access-gckf2\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.910898 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.910872 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-oauth-serving-cert\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.912386 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.912309 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-config\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.912386 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.912356 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-service-ca\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.914329 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.914303 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-serving-cert\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.914411 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.914396 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-oauth-config\") pod \"console-5856f7886b-4bjcw\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:38.955706 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.955679 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vxpmj\"" Jun 13 02:05:38.964172 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:38.964150 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:44.642075 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:44.642021 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 02:05:44.713978 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:44.713938 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5856f7886b-4bjcw"] Jun 13 02:05:44.716203 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:05:44.716175 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc3907b_e3b4_4182_9f4b_b80bbc1c1935.slice/crio-e11269581ec754f4767a251b351da6f476796525993318d58283694a71402fb2 WatchSource:0}: Error finding container e11269581ec754f4767a251b351da6f476796525993318d58283694a71402fb2: Status 404 returned error can't find the container with id e11269581ec754f4767a251b351da6f476796525993318d58283694a71402fb2 Jun 13 02:05:44.718761 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:44.718737 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:05:44.991338 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:44.991241 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5856f7886b-4bjcw" event={"ID":"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935","Type":"ContainerStarted","Data":"e11269581ec754f4767a251b351da6f476796525993318d58283694a71402fb2"} Jun 13 02:05:44.993078 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:44.993046 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-xmjm4" event={"ID":"fffe19d4-087b-4d0a-812e-16525e5d6f60","Type":"ContainerStarted","Data":"9afebe3c1608aa57b0cc5d117ebe83c0fc04dfad4cf05711e6d9c8efdb9a8738"} Jun 13 02:05:44.993302 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:44.993280 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-xmjm4" Jun 13 02:05:45.009341 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:45.009258 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-xmjm4" podStartSLOduration=1.118675055 podStartE2EDuration="18.009242004s" totalImagesPullingTime="16.890566949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:45.007697794 +0000 UTC m=+306.486848079" watchObservedRunningTime="2026-06-13 02:05:45.009242004 +0000 UTC m=+306.488392254" Jun 13 02:05:45.015159 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:45.015130 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-xmjm4" Jun 13 02:05:48.001441 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.001405 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7986cd7b67-8c5t9"] Jun 13 02:05:48.027292 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.027257 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7986cd7b67-8c5t9"] Jun 13 02:05:48.027446 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.027375 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.036727 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.036702 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 13 02:05:48.084772 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.084735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-oauth-config\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.084975 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.084784 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-oauth-serving-cert\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.084975 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.084853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5gx2\" (UniqueName: \"kubernetes.io/projected/36c48e89-1234-4f70-a7ae-a628ceb40e2c-kube-api-access-n5gx2\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.084975 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.084883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-serving-cert\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.084975 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.084910 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-config\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.084975 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.084934 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-service-ca\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.085247 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.085084 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-trusted-ca-bundle\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.186241 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.186205 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-serving-cert\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.186432 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.186258 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-config\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.186502 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.186443 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-service-ca\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.186556 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.186512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-trusted-ca-bundle\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.186612 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.186576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-oauth-config\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.186612 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.186606 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-oauth-serving-cert\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.186707 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.186647 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5gx2\" (UniqueName: \"kubernetes.io/projected/36c48e89-1234-4f70-a7ae-a628ceb40e2c-kube-api-access-n5gx2\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.187395 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.187235 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-config\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.187395 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.187268 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-service-ca\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.187577 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.187421 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-oauth-serving-cert\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.187843 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.187823 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-trusted-ca-bundle\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.189599 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.189572 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-serving-cert\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.189696 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.189609 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-oauth-config\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.195068 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.195046 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5gx2\" (UniqueName: \"kubernetes.io/projected/36c48e89-1234-4f70-a7ae-a628ceb40e2c-kube-api-access-n5gx2\") pod \"console-7986cd7b67-8c5t9\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.342313 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.342192 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:48.525370 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:48.525340 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7986cd7b67-8c5t9"] Jun 13 02:05:49.845000 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:05:49.844942 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c48e89_1234_4f70_a7ae_a628ceb40e2c.slice/crio-5a2972cc9c6cbb661116e53d07c93733e273f767097fbd2e39cd2095df0e2331 WatchSource:0}: Error finding container 5a2972cc9c6cbb661116e53d07c93733e273f767097fbd2e39cd2095df0e2331: Status 404 returned error can't find the container with id 5a2972cc9c6cbb661116e53d07c93733e273f767097fbd2e39cd2095df0e2331 Jun 13 02:05:50.018637 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:50.018598 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7986cd7b67-8c5t9" event={"ID":"36c48e89-1234-4f70-a7ae-a628ceb40e2c","Type":"ContainerStarted","Data":"5a2972cc9c6cbb661116e53d07c93733e273f767097fbd2e39cd2095df0e2331"} Jun 13 02:05:50.020415 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:50.020384 2557 generic.go:356] "Generic (PLEG): container finished" podID="b9f9a144-91b4-4b93-aa8e-b83432e8ce41" containerID="806bacc491becba33961293ea83b3b0d3f2081bf0dbe0810960f4aba3c95fbe8" exitCode=0 Jun 13 02:05:50.020415 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:50.020410 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" event={"ID":"b9f9a144-91b4-4b93-aa8e-b83432e8ce41","Type":"ContainerDied","Data":"806bacc491becba33961293ea83b3b0d3f2081bf0dbe0810960f4aba3c95fbe8"} Jun 13 02:05:50.020742 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:50.020726 2557 scope.go:117] "RemoveContainer" containerID="806bacc491becba33961293ea83b3b0d3f2081bf0dbe0810960f4aba3c95fbe8" Jun 13 02:05:51.027575 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:51.027374 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7986cd7b67-8c5t9" event={"ID":"36c48e89-1234-4f70-a7ae-a628ceb40e2c","Type":"ContainerStarted","Data":"0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3"} Jun 13 02:05:51.029892 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:51.029849 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-kkstz" event={"ID":"b9f9a144-91b4-4b93-aa8e-b83432e8ce41","Type":"ContainerStarted","Data":"247f32ee446fcfc972426b49ed11aba1a97f1fcfaeb958edd5045f9655a29b4c"} Jun 13 02:05:51.031823 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:51.031793 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5856f7886b-4bjcw" event={"ID":"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935","Type":"ContainerStarted","Data":"91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007"} Jun 13 02:05:51.045675 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:51.045616 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7986cd7b67-8c5t9" podStartSLOduration=3.530613244 podStartE2EDuration="4.045594464s" totalImagesPullingTime="514.98122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:51.045306972 +0000 UTC m=+312.524457256" watchObservedRunningTime="2026-06-13 02:05:51.045594464 +0000 UTC m=+312.524744737" Jun 13 02:05:51.083003 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:51.082412 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5856f7886b-4bjcw" podStartSLOduration=7.621025829 podStartE2EDuration="13.082390298s" totalImagesPullingTime="5.461364469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:51.079986655 +0000 UTC m=+312.559136928" watchObservedRunningTime="2026-06-13 02:05:51.082390298 +0000 UTC m=+312.561540571" Jun 13 02:05:51.183173 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:51.183142 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:51.187901 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:51.187866 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-647467fc44-d7grc" Jun 13 02:05:58.342729 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:58.342694 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:58.343214 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:58.342749 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:58.347579 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:58.347555 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:58.965000 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:58.964960 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:58.965135 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:58.965020 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:58.970089 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:58.970065 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:59.072243 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:59.072201 2557 generic.go:356] "Generic (PLEG): container finished" podID="45293b1c-6b4f-4abd-a2cf-2d30a52103c0" containerID="97912265a2119ff228d3560dcf35b40173f6edb33963a1cbf2c1d7e83c105c73" exitCode=0 Jun 13 02:05:59.072424 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:59.072279 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" event={"ID":"45293b1c-6b4f-4abd-a2cf-2d30a52103c0","Type":"ContainerDied","Data":"97912265a2119ff228d3560dcf35b40173f6edb33963a1cbf2c1d7e83c105c73"} Jun 13 02:05:59.072973 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:59.072931 2557 scope.go:117] "RemoveContainer" containerID="97912265a2119ff228d3560dcf35b40173f6edb33963a1cbf2c1d7e83c105c73" Jun 13 02:05:59.077567 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:59.077548 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:05:59.078060 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:59.078042 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:05:59.148031 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:05:59.147997 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5856f7886b-4bjcw"] Jun 13 02:06:00.078661 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:00.078618 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-5jtnr" event={"ID":"45293b1c-6b4f-4abd-a2cf-2d30a52103c0","Type":"ContainerStarted","Data":"8d8df6c7fe36657f6d49990c0495eeeb67cc8f4fb28da4c803745d37229953c5"} Jun 13 02:06:00.868012 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:00.867988 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b177b3c9-87d0-4c92-a1ad-334b9ad2c083/init-config-reloader/0.log" Jun 13 02:06:01.068632 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:01.068591 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b177b3c9-87d0-4c92-a1ad-334b9ad2c083/alertmanager/0.log" Jun 13 02:06:01.265408 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:01.265384 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b177b3c9-87d0-4c92-a1ad-334b9ad2c083/config-reloader/0.log" Jun 13 02:06:01.465926 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:01.465890 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b177b3c9-87d0-4c92-a1ad-334b9ad2c083/kube-rbac-proxy-web/0.log" Jun 13 02:06:01.666161 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:01.666090 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b177b3c9-87d0-4c92-a1ad-334b9ad2c083/kube-rbac-proxy/0.log" Jun 13 02:06:01.865968 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:01.865915 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b177b3c9-87d0-4c92-a1ad-334b9ad2c083/kube-rbac-proxy-metric/0.log" Jun 13 02:06:02.068382 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:02.068348 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b177b3c9-87d0-4c92-a1ad-334b9ad2c083/prom-label-proxy/0.log" Jun 13 02:06:02.466941 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:02.466863 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-7tj6m_8c3252ae-c97a-44da-9c3d-a7c6c8867574/kube-state-metrics/0.log" Jun 13 02:06:02.665337 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:02.665311 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-7tj6m_8c3252ae-c97a-44da-9c3d-a7c6c8867574/kube-rbac-proxy-main/0.log" Jun 13 02:06:02.867630 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:02.867602 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-7tj6m_8c3252ae-c97a-44da-9c3d-a7c6c8867574/kube-rbac-proxy-self/0.log" Jun 13 02:06:03.066096 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:03.066064 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-647467fc44-d7grc_8588be49-aa7d-4dca-9405-2516b273ef86/metrics-server/0.log" Jun 13 02:06:04.666168 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:04.666134 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2kkx_c5038f21-bf61-4ed4-9d5a-e56c8936af2a/init-textfile/0.log" Jun 13 02:06:04.872443 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:04.872409 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2kkx_c5038f21-bf61-4ed4-9d5a-e56c8936af2a/node-exporter/0.log" Jun 13 02:06:05.068549 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:05.068518 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2kkx_c5038f21-bf61-4ed4-9d5a-e56c8936af2a/kube-rbac-proxy/0.log" Jun 13 02:06:05.268460 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:05.268430 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-rchpw_e7a850ff-3894-437a-86b1-48b1d1235d8a/kube-rbac-proxy-main/0.log" Jun 13 02:06:05.468171 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:05.468094 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-rchpw_e7a850ff-3894-437a-86b1-48b1d1235d8a/kube-rbac-proxy-self/0.log" Jun 13 02:06:05.668151 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:05.668120 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-rchpw_e7a850ff-3894-437a-86b1-48b1d1235d8a/openshift-state-metrics/0.log" Jun 13 02:06:07.665354 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:07.665329 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-qlpjt_5bcd7ef4-1a57-427e-8927-9d37604863a8/prometheus-operator-admission-webhook/0.log" Jun 13 02:06:09.666743 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:09.666714 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-hh6pd_bb14295a-9e1b-483c-8171-c427c3bedaad/networking-console-plugin/0.log" Jun 13 02:06:10.266279 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:10.266251 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5856f7886b-4bjcw_cbc3907b-e3b4-4182-9f4b-b80bbc1c1935/console/0.log" Jun 13 02:06:10.466456 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:10.466426 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7986cd7b67-8c5t9_36c48e89-1234-4f70-a7ae-a628ceb40e2c/console/0.log" Jun 13 02:06:10.666901 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:10.666828 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-xmjm4_fffe19d4-087b-4d0a-812e-16525e5d6f60/download-server/0.log" Jun 13 02:06:10.866194 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:10.866163 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b48dc66b-725zw_79d3ca1c-dd15-46e6-b97e-ab817f52c686/router/0.log" Jun 13 02:06:11.065653 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:11.065624 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4qqmb_2303d56d-2e9a-4ff7-ba2e-a07b453a4c91/serve-healthcheck-canary/0.log" Jun 13 02:06:11.666997 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:11.666944 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9547488fd-bq4nk_7a6ee75e-bba9-4a4b-90cd-f479cc5a3805/cluster-samples-operator/0.log" Jun 13 02:06:11.866359 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:11.866318 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9547488fd-bq4nk_7a6ee75e-bba9-4a4b-90cd-f479cc5a3805/cluster-samples-operator-watch/0.log" Jun 13 02:06:26.105348 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.105262 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5856f7886b-4bjcw" podUID="cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" containerName="console" containerID="cri-o://91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007" gracePeriod=15 Jun 13 02:06:26.365249 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.365187 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:06:26.527533 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.527500 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-serving-cert\") pod \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " Jun 13 02:06:26.527689 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.527548 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gckf2\" (UniqueName: \"kubernetes.io/projected/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-kube-api-access-gckf2\") pod \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " Jun 13 02:06:26.527689 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.527565 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-oauth-config\") pod \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " Jun 13 02:06:26.527689 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.527660 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-oauth-serving-cert\") pod \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " Jun 13 02:06:26.527790 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.527753 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-config\") pod \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " Jun 13 02:06:26.527846 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.527801 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-service-ca\") pod \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\" (UID: \"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935\") " Jun 13 02:06:26.528155 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.528121 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" (UID: "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:26.528280 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.528152 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-config" (OuterVolumeSpecName: "console-config") pod "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" (UID: "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:26.528280 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.528242 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-service-ca" (OuterVolumeSpecName: "service-ca") pod "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" (UID: "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:26.529845 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.529826 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" (UID: "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:26.529930 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.529883 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-kube-api-access-gckf2" (OuterVolumeSpecName: "kube-api-access-gckf2") pod "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" (UID: "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935"). InnerVolumeSpecName "kube-api-access-gckf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:06:26.529994 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.529930 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" (UID: "cbc3907b-e3b4-4182-9f4b-b80bbc1c1935"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:26.628477 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.628404 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gckf2\" (UniqueName: \"kubernetes.io/projected/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-kube-api-access-gckf2\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:26.628477 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.628429 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-oauth-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:26.628477 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.628438 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-oauth-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:26.628477 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.628447 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:26.628477 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.628455 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:26.628477 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.628463 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935-console-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:26.690244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.690209 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 02:06:26.690588 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.690549 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="alertmanager" containerID="cri-o://eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa" gracePeriod=120 Jun 13 02:06:26.690674 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.690635 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="config-reloader" containerID="cri-o://12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d" gracePeriod=120 Jun 13 02:06:26.690750 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.690676 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="prom-label-proxy" containerID="cri-o://3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032" gracePeriod=120 Jun 13 02:06:26.690750 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.690695 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy" containerID="cri-o://8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1" gracePeriod=120 Jun 13 02:06:26.690750 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.690620 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy-metric" containerID="cri-o://f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087" gracePeriod=120 Jun 13 02:06:26.690909 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:26.690620 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy-web" containerID="cri-o://68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb" gracePeriod=120 Jun 13 02:06:27.191551 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.191516 2557 generic.go:356] "Generic (PLEG): container finished" podID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerID="3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032" exitCode=0 Jun 13 02:06:27.191551 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.191542 2557 generic.go:356] "Generic (PLEG): container finished" podID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerID="8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1" exitCode=0 Jun 13 02:06:27.191551 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.191551 2557 generic.go:356] "Generic (PLEG): container finished" podID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerID="12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d" exitCode=0 Jun 13 02:06:27.191551 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.191558 2557 generic.go:356] "Generic (PLEG): container finished" podID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerID="eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa" exitCode=0 Jun 13 02:06:27.192084 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.191584 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerDied","Data":"3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032"} Jun 13 02:06:27.192084 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.191646 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerDied","Data":"8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1"} Jun 13 02:06:27.192084 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.191673 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerDied","Data":"12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d"} Jun 13 02:06:27.192084 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.191696 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerDied","Data":"eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa"} Jun 13 02:06:27.192851 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.192830 2557 generic.go:356] "Generic (PLEG): container finished" podID="cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" containerID="91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007" exitCode=0 Jun 13 02:06:27.192981 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.192865 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5856f7886b-4bjcw" event={"ID":"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935","Type":"ContainerDied","Data":"91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007"} Jun 13 02:06:27.192981 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.192877 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5856f7886b-4bjcw" Jun 13 02:06:27.192981 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.192894 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5856f7886b-4bjcw" event={"ID":"cbc3907b-e3b4-4182-9f4b-b80bbc1c1935","Type":"ContainerDied","Data":"e11269581ec754f4767a251b351da6f476796525993318d58283694a71402fb2"} Jun 13 02:06:27.192981 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.192912 2557 scope.go:117] "RemoveContainer" containerID="91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007" Jun 13 02:06:27.200711 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.200695 2557 scope.go:117] "RemoveContainer" containerID="91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007" Jun 13 02:06:27.200974 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:06:27.200935 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007\": container with ID starting with 91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007 not found: ID does not exist" containerID="91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007" Jun 13 02:06:27.201061 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.200982 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007"} err="failed to get container status \"91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007\": rpc error: code = NotFound desc = could not find container \"91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007\": container with ID starting with 91f2255718780ade19a53011a327f2b9617c71c6ea225f62cd72cec3e7cd6007 not found: ID does not exist" Jun 13 02:06:27.208430 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.208410 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5856f7886b-4bjcw"] Jun 13 02:06:27.211812 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.211792 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5856f7886b-4bjcw"] Jun 13 02:06:27.509940 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.509908 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7754b57d-vzkl6"] Jun 13 02:06:27.510359 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.510335 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" containerName="console" Jun 13 02:06:27.510359 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.510357 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" containerName="console" Jun 13 02:06:27.510498 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.510414 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" containerName="console" Jun 13 02:06:27.542621 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.542591 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7754b57d-vzkl6"] Jun 13 02:06:27.542742 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.542685 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.638241 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.638208 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-config\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.638386 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.638256 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-service-ca\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.638386 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.638305 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-serving-cert\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.638386 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.638338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-trusted-ca-bundle\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.638386 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.638373 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-oauth-serving-cert\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.638530 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.638411 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-oauth-config\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.638530 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.638455 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68wtt\" (UniqueName: \"kubernetes.io/projected/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-kube-api-access-68wtt\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.739734 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.739692 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-service-ca\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.739912 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.739738 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-serving-cert\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.739912 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.739803 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-trusted-ca-bundle\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.739912 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.739838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-oauth-serving-cert\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.739912 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.739868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-oauth-config\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.740172 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.739980 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wtt\" (UniqueName: \"kubernetes.io/projected/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-kube-api-access-68wtt\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.740172 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.740033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-config\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.740629 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.740606 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-service-ca\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.740732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.740610 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-oauth-serving-cert\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.740732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.740655 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-config\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.740732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.740681 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-trusted-ca-bundle\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.742308 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.742282 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-serving-cert\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.742400 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.742307 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-oauth-config\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.749607 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.749582 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68wtt\" (UniqueName: \"kubernetes.io/projected/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-kube-api-access-68wtt\") pod \"console-7d7754b57d-vzkl6\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.851161 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.851136 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:27.992905 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:27.992877 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.002591 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.002569 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7754b57d-vzkl6"] Jun 13 02:06:28.005195 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:06:28.005171 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b9dc6e_4a8c_4856_b759_b54d8ac4bb8d.slice/crio-b561d039b332b91d7d59fb2acb9d7b60910141ba7e2e369a4b975122d8b47357 WatchSource:0}: Error finding container b561d039b332b91d7d59fb2acb9d7b60910141ba7e2e369a4b975122d8b47357: Status 404 returned error can't find the container with id b561d039b332b91d7d59fb2acb9d7b60910141ba7e2e369a4b975122d8b47357 Jun 13 02:06:28.144129 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144101 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-trusted-ca-bundle\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144228 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144151 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-web\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144228 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144185 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-cluster-tls-config\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144228 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144218 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-main-tls\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144387 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144248 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-volume\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144458 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144431 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-tls-assets\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144512 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144466 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:28.144512 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144479 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-metrics-client-ca\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144621 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144510 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144621 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144567 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlqx2\" (UniqueName: \"kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-kube-api-access-tlqx2\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144621 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144615 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144775 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144642 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-main-db\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144775 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144665 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-web-config\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144775 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144704 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-out\") pod \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\" (UID: \"b177b3c9-87d0-4c92-a1ad-334b9ad2c083\") " Jun 13 02:06:28.144990 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.144970 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.145415 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.145112 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:28.145919 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.145598 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:06:28.148663 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.148614 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:28.149435 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.149349 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-out" (OuterVolumeSpecName: "config-out") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:06:28.149435 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.149360 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:06:28.149435 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.149375 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:28.149435 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.149415 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:28.149700 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.149423 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-volume" (OuterVolumeSpecName: "config-volume") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:28.149920 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.149890 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-kube-api-access-tlqx2" (OuterVolumeSpecName: "kube-api-access-tlqx2") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "kube-api-access-tlqx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:06:28.150277 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.150238 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:28.153124 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.153095 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:28.160821 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.160796 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-web-config" (OuterVolumeSpecName: "web-config") pod "b177b3c9-87d0-4c92-a1ad-334b9ad2c083" (UID: "b177b3c9-87d0-4c92-a1ad-334b9ad2c083"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:28.202091 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.202053 2557 generic.go:356] "Generic (PLEG): container finished" podID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerID="f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087" exitCode=0 Jun 13 02:06:28.202091 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.202085 2557 generic.go:356] "Generic (PLEG): container finished" podID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerID="68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb" exitCode=0 Jun 13 02:06:28.202492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.202134 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.202492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.202131 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerDied","Data":"f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087"} Jun 13 02:06:28.202492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.202211 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerDied","Data":"68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb"} Jun 13 02:06:28.202492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.202253 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b177b3c9-87d0-4c92-a1ad-334b9ad2c083","Type":"ContainerDied","Data":"c294462ad314a6733c3b027afed8b11fed470b400b84e14bc72ef07398ef95d6"} Jun 13 02:06:28.202492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.202301 2557 scope.go:117] "RemoveContainer" containerID="3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032" Jun 13 02:06:28.204042 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.204016 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7754b57d-vzkl6" event={"ID":"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d","Type":"ContainerStarted","Data":"3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563"} Jun 13 02:06:28.204148 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.204065 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7754b57d-vzkl6" event={"ID":"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d","Type":"ContainerStarted","Data":"b561d039b332b91d7d59fb2acb9d7b60910141ba7e2e369a4b975122d8b47357"} Jun 13 02:06:28.211426 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.211376 2557 scope.go:117] "RemoveContainer" containerID="f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087" Jun 13 02:06:28.218732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.218710 2557 scope.go:117] "RemoveContainer" containerID="8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1" Jun 13 02:06:28.223875 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.223831 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d7754b57d-vzkl6" podStartSLOduration=1.223818502 podStartE2EDuration="1.223818502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:06:28.223231381 +0000 UTC m=+349.702381677" watchObservedRunningTime="2026-06-13 02:06:28.223818502 +0000 UTC m=+349.702968774" Jun 13 02:06:28.226855 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.226834 2557 scope.go:117] "RemoveContainer" containerID="68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb" Jun 13 02:06:28.233688 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.233673 2557 scope.go:117] "RemoveContainer" containerID="12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d" Jun 13 02:06:28.240751 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.240730 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 02:06:28.241016 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.240996 2557 scope.go:117] "RemoveContainer" containerID="eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa" Jun 13 02:06:28.244876 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.244841 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 02:06:28.246069 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246048 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246140 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246069 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-alertmanager-main-db\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246140 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246080 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-web-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246140 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246088 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-out\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246140 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246097 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246140 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246105 2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-cluster-tls-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246140 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246113 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-main-tls\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246140 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246121 2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246140 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246129 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-tls-assets\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246140 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246137 2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-metrics-client-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246416 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246145 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.246416 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.246154 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlqx2\" (UniqueName: \"kubernetes.io/projected/b177b3c9-87d0-4c92-a1ad-334b9ad2c083-kube-api-access-tlqx2\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:06:28.248889 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.248875 2557 scope.go:117] "RemoveContainer" containerID="969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35" Jun 13 02:06:28.256773 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.256753 2557 scope.go:117] "RemoveContainer" containerID="3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032" Jun 13 02:06:28.257070 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:06:28.257042 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032\": container with ID starting with 3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032 not found: ID does not exist" containerID="3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032" Jun 13 02:06:28.257130 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.257076 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032"} err="failed to get container status \"3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032\": rpc error: code = NotFound desc = could not find container \"3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032\": container with ID starting with 3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032 not found: ID does not exist" Jun 13 02:06:28.257130 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.257093 2557 scope.go:117] "RemoveContainer" containerID="f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087" Jun 13 02:06:28.263617 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:06:28.263586 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087\": container with ID starting with f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087 not found: ID does not exist" containerID="f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087" Jun 13 02:06:28.263708 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.263624 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087"} err="failed to get container status \"f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087\": rpc error: code = NotFound desc = could not find container \"f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087\": container with ID starting with f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087 not found: ID does not exist" Jun 13 02:06:28.263708 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.263649 2557 scope.go:117] "RemoveContainer" containerID="8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1" Jun 13 02:06:28.264053 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:06:28.264030 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1\": container with ID starting with 8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1 not found: ID does not exist" containerID="8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1" Jun 13 02:06:28.264136 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.264058 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1"} err="failed to get container status \"8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1\": rpc error: code = NotFound desc = could not find container \"8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1\": container with ID starting with 8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1 not found: ID does not exist" Jun 13 02:06:28.264136 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.264072 2557 scope.go:117] "RemoveContainer" containerID="68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb" Jun 13 02:06:28.264409 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:06:28.264394 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb\": container with ID starting with 68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb not found: ID does not exist" containerID="68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb" Jun 13 02:06:28.264470 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.264411 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb"} err="failed to get container status \"68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb\": rpc error: code = NotFound desc = could not find container \"68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb\": container with ID starting with 68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb not found: ID does not exist" Jun 13 02:06:28.264470 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.264422 2557 scope.go:117] "RemoveContainer" containerID="12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d" Jun 13 02:06:28.264666 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:06:28.264646 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d\": container with ID starting with 12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d not found: ID does not exist" containerID="12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d" Jun 13 02:06:28.264705 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.264683 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d"} err="failed to get container status \"12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d\": rpc error: code = NotFound desc = could not find container \"12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d\": container with ID starting with 12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d not found: ID does not exist" Jun 13 02:06:28.264739 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.264704 2557 scope.go:117] "RemoveContainer" containerID="eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa" Jun 13 02:06:28.264975 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:06:28.264919 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa\": container with ID starting with eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa not found: ID does not exist" containerID="eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa" Jun 13 02:06:28.265030 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.264980 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa"} err="failed to get container status \"eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa\": rpc error: code = NotFound desc = could not find container \"eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa\": container with ID starting with eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa not found: ID does not exist" Jun 13 02:06:28.265030 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.264993 2557 scope.go:117] "RemoveContainer" containerID="969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35" Jun 13 02:06:28.265270 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:06:28.265252 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35\": container with ID starting with 969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35 not found: ID does not exist" containerID="969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35" Jun 13 02:06:28.265320 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.265286 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35"} err="failed to get container status \"969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35\": rpc error: code = NotFound desc = could not find container \"969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35\": container with ID starting with 969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35 not found: ID does not exist" Jun 13 02:06:28.265357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.265315 2557 scope.go:117] "RemoveContainer" containerID="3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032" Jun 13 02:06:28.265601 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.265577 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032"} err="failed to get container status \"3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032\": rpc error: code = NotFound desc = could not find container \"3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032\": container with ID starting with 3944469b7e5a3d286af40b6a087c13723f0f83ff14ddc53846cf0614f9fa6032 not found: ID does not exist" Jun 13 02:06:28.265601 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.265601 2557 scope.go:117] "RemoveContainer" containerID="f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087" Jun 13 02:06:28.265776 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.265761 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087"} err="failed to get container status \"f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087\": rpc error: code = NotFound desc = could not find container \"f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087\": container with ID starting with f4a4aa74a0e305fc73b92b0f68ad97201ff42d90464b18558b1613049c3ee087 not found: ID does not exist" Jun 13 02:06:28.265826 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.265776 2557 scope.go:117] "RemoveContainer" containerID="8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1" Jun 13 02:06:28.266012 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.265991 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1"} err="failed to get container status \"8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1\": rpc error: code = NotFound desc = could not find container \"8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1\": container with ID starting with 8ec600c41b1478444bbdd40f6e079d630103c0203488de5a61fa56b753040de1 not found: ID does not exist" Jun 13 02:06:28.266012 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.266012 2557 scope.go:117] "RemoveContainer" containerID="68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb" Jun 13 02:06:28.266210 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.266194 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb"} err="failed to get container status \"68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb\": rpc error: code = NotFound desc = could not find container \"68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb\": container with ID starting with 68e08ebcb5dbac87e13e5f21460439ad53e541e4191cb18d26807c283960e0cb not found: ID does not exist" Jun 13 02:06:28.266253 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.266211 2557 scope.go:117] "RemoveContainer" containerID="12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d" Jun 13 02:06:28.266388 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.266369 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d"} err="failed to get container status \"12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d\": rpc error: code = NotFound desc = could not find container \"12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d\": container with ID starting with 12cf60b0a2baf64662a4d820363fa5b718d349799028997699069b3f948b2e2d not found: ID does not exist" Jun 13 02:06:28.266448 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.266390 2557 scope.go:117] "RemoveContainer" containerID="eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa" Jun 13 02:06:28.266606 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.266588 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa"} err="failed to get container status \"eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa\": rpc error: code = NotFound desc = could not find container \"eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa\": container with ID starting with eb286ad9558a4f95089f907b69666c10770c3d18946d2355b322523b2bece4fa not found: ID does not exist" Jun 13 02:06:28.266649 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.266605 2557 scope.go:117] "RemoveContainer" containerID="969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35" Jun 13 02:06:28.266805 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.266770 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35"} err="failed to get container status \"969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35\": rpc error: code = NotFound desc = could not find container \"969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35\": container with ID starting with 969010524b7d78e1445155ae803bb8f20932c227f9d42935958b2fd635aaca35 not found: ID does not exist" Jun 13 02:06:28.270449 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270431 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 02:06:28.270754 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270726 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="prom-label-proxy" Jun 13 02:06:28.270754 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270752 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="prom-label-proxy" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270766 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270771 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270777 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy-metric" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270802 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy-metric" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270814 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="init-config-reloader" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270822 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="init-config-reloader" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270831 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy-web" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270840 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy-web" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270853 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="config-reloader" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270862 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="config-reloader" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270884 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="alertmanager" Jun 13 02:06:28.270938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270893 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="alertmanager" Jun 13 02:06:28.271281 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.270990 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy" Jun 13 02:06:28.271281 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.271008 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy-metric" Jun 13 02:06:28.271281 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.271018 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="config-reloader" Jun 13 02:06:28.271281 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.271027 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="kube-rbac-proxy-web" Jun 13 02:06:28.271281 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.271036 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="alertmanager" Jun 13 02:06:28.271281 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.271042 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" containerName="prom-label-proxy" Jun 13 02:06:28.300270 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.300209 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 02:06:28.300385 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.300370 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.302829 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.302811 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g4764\"" Jun 13 02:06:28.303110 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.303087 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 13 02:06:28.303110 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.303103 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 13 02:06:28.303317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.303160 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 13 02:06:28.303317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.303175 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 13 02:06:28.303317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.303190 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 13 02:06:28.303492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.303403 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 13 02:06:28.303492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.303415 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 13 02:06:28.303492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.303423 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 13 02:06:28.308144 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.308124 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 13 02:06:28.447640 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447613 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447640 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447642 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447902 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447666 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5765c04-6407-4933-a93f-086de1a64fe8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447902 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447689 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447902 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447708 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447902 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447724 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-web-config\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447902 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447776 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5765c04-6407-4933-a93f-086de1a64fe8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447902 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447813 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5765c04-6407-4933-a93f-086de1a64fe8-config-out\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447902 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447837 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5765c04-6407-4933-a93f-086de1a64fe8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447902 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447902 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447876 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5765c04-6407-4933-a93f-086de1a64fe8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.447902 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447898 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgm22\" (UniqueName: \"kubernetes.io/projected/e5765c04-6407-4933-a93f-086de1a64fe8-kube-api-access-cgm22\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.448257 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.447923 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.548973 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.548913 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5765c04-6407-4933-a93f-086de1a64fe8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549127 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.548986 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549127 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549016 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549127 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549037 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-web-config\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549296 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5765c04-6407-4933-a93f-086de1a64fe8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549296 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549208 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5765c04-6407-4933-a93f-086de1a64fe8-config-out\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549296 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549247 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5765c04-6407-4933-a93f-086de1a64fe8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549296 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549274 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549484 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549295 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5765c04-6407-4933-a93f-086de1a64fe8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549484 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5765c04-6407-4933-a93f-086de1a64fe8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549484 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549354 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgm22\" (UniqueName: \"kubernetes.io/projected/e5765c04-6407-4933-a93f-086de1a64fe8-kube-api-access-cgm22\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549484 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549484 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549475 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.549703 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549500 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.550021 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.549998 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5765c04-6407-4933-a93f-086de1a64fe8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.550864 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.550804 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5765c04-6407-4933-a93f-086de1a64fe8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.551871 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.551845 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.552063 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.552043 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.552139 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.552043 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-web-config\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.552139 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.552071 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.552366 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.552348 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5765c04-6407-4933-a93f-086de1a64fe8-config-out\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.552625 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.552608 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.553587 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.553565 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5765c04-6407-4933-a93f-086de1a64fe8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.553763 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.553744 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.554054 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.554036 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5765c04-6407-4933-a93f-086de1a64fe8-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.559638 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.559612 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgm22\" (UniqueName: \"kubernetes.io/projected/e5765c04-6407-4933-a93f-086de1a64fe8-kube-api-access-cgm22\") pod \"alertmanager-main-0\" (UID: \"e5765c04-6407-4933-a93f-086de1a64fe8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.610381 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.610350 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 02:06:28.768553 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:28.768529 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 02:06:28.770104 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:06:28.770080 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5765c04_6407_4933_a93f_086de1a64fe8.slice/crio-9aad03dda2a5566d4486e14a5950ceb6386f95e6c65387706e5e12e5385c0930 WatchSource:0}: Error finding container 9aad03dda2a5566d4486e14a5950ceb6386f95e6c65387706e5e12e5385c0930: Status 404 returned error can't find the container with id 9aad03dda2a5566d4486e14a5950ceb6386f95e6c65387706e5e12e5385c0930 Jun 13 02:06:29.007163 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:29.007134 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b177b3c9-87d0-4c92-a1ad-334b9ad2c083" path="/var/lib/kubelet/pods/b177b3c9-87d0-4c92-a1ad-334b9ad2c083/volumes" Jun 13 02:06:29.007749 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:29.007735 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc3907b-e3b4-4182-9f4b-b80bbc1c1935" path="/var/lib/kubelet/pods/cbc3907b-e3b4-4182-9f4b-b80bbc1c1935/volumes" Jun 13 02:06:29.211516 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:29.211423 2557 generic.go:356] "Generic (PLEG): container finished" podID="e5765c04-6407-4933-a93f-086de1a64fe8" containerID="6b1f412932f826fd4192a6f13b2b790bb7c422a286fe2b166fa6abaa5cec1d73" exitCode=0 Jun 13 02:06:29.211516 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:29.211500 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5765c04-6407-4933-a93f-086de1a64fe8","Type":"ContainerDied","Data":"6b1f412932f826fd4192a6f13b2b790bb7c422a286fe2b166fa6abaa5cec1d73"} Jun 13 02:06:29.212131 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:29.211570 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5765c04-6407-4933-a93f-086de1a64fe8","Type":"ContainerStarted","Data":"9aad03dda2a5566d4486e14a5950ceb6386f95e6c65387706e5e12e5385c0930"} Jun 13 02:06:30.219648 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:30.219617 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5765c04-6407-4933-a93f-086de1a64fe8","Type":"ContainerStarted","Data":"292b5b7c329b76aef8d1875f3f676c3cc5b8655695e4349db0a803114dc38e71"} Jun 13 02:06:30.220088 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:30.219678 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5765c04-6407-4933-a93f-086de1a64fe8","Type":"ContainerStarted","Data":"67f526f33aa9a74dfde31474c8de4b062d33d4006ddc0fd231dd3ce5ae8181ff"} Jun 13 02:06:30.220088 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:30.219706 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5765c04-6407-4933-a93f-086de1a64fe8","Type":"ContainerStarted","Data":"add60a474cb00278ba04e2e3ee74cf3e7ca9335d740ff53ba4917c14fc24d523"} Jun 13 02:06:30.220088 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:30.219733 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5765c04-6407-4933-a93f-086de1a64fe8","Type":"ContainerStarted","Data":"893471d6ba0e46578ff5a4cf8419cc0bd9e38adef2407193f15483a6bd58af30"} Jun 13 02:06:30.220088 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:30.219756 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5765c04-6407-4933-a93f-086de1a64fe8","Type":"ContainerStarted","Data":"46697f6efd42ff9e23f77041890080e0b0dd13ef5ddd056b700426a121f14163"} Jun 13 02:06:30.220088 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:30.219786 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5765c04-6407-4933-a93f-086de1a64fe8","Type":"ContainerStarted","Data":"917fd889b4d50aacd6675a30729a48a6fffe00dce053ac529bc75bdf58f86c8a"} Jun 13 02:06:30.244798 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:30.244736 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.221385524 podStartE2EDuration="2.244718981s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.333457ms" isStatefulPod=false podCreationTimestamp="2026-06-13 02:06:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:06:30.242116118 +0000 UTC m=+351.721266380" watchObservedRunningTime="2026-06-13 02:06:30.244718981 +0000 UTC m=+351.723869252" Jun 13 02:06:37.852057 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:37.852002 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:37.852564 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:37.852085 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:37.856793 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:37.856774 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:38.258246 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:38.258216 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:06:38.304250 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:06:38.304216 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7986cd7b67-8c5t9"] Jun 13 02:07:03.326271 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.326232 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7986cd7b67-8c5t9" podUID="36c48e89-1234-4f70-a7ae-a628ceb40e2c" containerName="console" containerID="cri-o://0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3" gracePeriod=15 Jun 13 02:07:03.569286 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.569262 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:07:03.621311 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621238 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-serving-cert\") pod \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " Jun 13 02:07:03.621311 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621297 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-config\") pod \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " Jun 13 02:07:03.621511 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621350 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5gx2\" (UniqueName: \"kubernetes.io/projected/36c48e89-1234-4f70-a7ae-a628ceb40e2c-kube-api-access-n5gx2\") pod \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " Jun 13 02:07:03.621511 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621369 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-oauth-serving-cert\") pod \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " Jun 13 02:07:03.621511 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621401 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-trusted-ca-bundle\") pod \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " Jun 13 02:07:03.621511 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621421 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-oauth-config\") pod \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " Jun 13 02:07:03.621511 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621442 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-service-ca\") pod \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\" (UID: \"36c48e89-1234-4f70-a7ae-a628ceb40e2c\") " Jun 13 02:07:03.621867 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621834 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-config" (OuterVolumeSpecName: "console-config") pod "36c48e89-1234-4f70-a7ae-a628ceb40e2c" (UID: "36c48e89-1234-4f70-a7ae-a628ceb40e2c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:07:03.622013 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621858 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "36c48e89-1234-4f70-a7ae-a628ceb40e2c" (UID: "36c48e89-1234-4f70-a7ae-a628ceb40e2c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:07:03.622013 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621838 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "36c48e89-1234-4f70-a7ae-a628ceb40e2c" (UID: "36c48e89-1234-4f70-a7ae-a628ceb40e2c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:07:03.622013 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.621934 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-service-ca" (OuterVolumeSpecName: "service-ca") pod "36c48e89-1234-4f70-a7ae-a628ceb40e2c" (UID: "36c48e89-1234-4f70-a7ae-a628ceb40e2c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:07:03.623522 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.623499 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "36c48e89-1234-4f70-a7ae-a628ceb40e2c" (UID: "36c48e89-1234-4f70-a7ae-a628ceb40e2c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:07:03.623626 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.623608 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "36c48e89-1234-4f70-a7ae-a628ceb40e2c" (UID: "36c48e89-1234-4f70-a7ae-a628ceb40e2c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:07:03.623673 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.623641 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c48e89-1234-4f70-a7ae-a628ceb40e2c-kube-api-access-n5gx2" (OuterVolumeSpecName: "kube-api-access-n5gx2") pod "36c48e89-1234-4f70-a7ae-a628ceb40e2c" (UID: "36c48e89-1234-4f70-a7ae-a628ceb40e2c"). InnerVolumeSpecName "kube-api-access-n5gx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:07:03.722020 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.721987 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5gx2\" (UniqueName: \"kubernetes.io/projected/36c48e89-1234-4f70-a7ae-a628ceb40e2c-kube-api-access-n5gx2\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:07:03.722020 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.722015 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-oauth-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:07:03.722020 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.722025 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-trusted-ca-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:07:03.722247 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.722033 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-oauth-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:07:03.722247 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.722042 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:07:03.722247 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.722050 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:07:03.722247 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:03.722058 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36c48e89-1234-4f70-a7ae-a628ceb40e2c-console-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:07:04.363565 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:04.363529 2557 generic.go:356] "Generic (PLEG): container finished" podID="36c48e89-1234-4f70-a7ae-a628ceb40e2c" containerID="0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3" exitCode=0 Jun 13 02:07:04.364020 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:04.363592 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7986cd7b67-8c5t9" Jun 13 02:07:04.364020 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:04.363614 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7986cd7b67-8c5t9" event={"ID":"36c48e89-1234-4f70-a7ae-a628ceb40e2c","Type":"ContainerDied","Data":"0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3"} Jun 13 02:07:04.364020 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:04.363686 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7986cd7b67-8c5t9" event={"ID":"36c48e89-1234-4f70-a7ae-a628ceb40e2c","Type":"ContainerDied","Data":"5a2972cc9c6cbb661116e53d07c93733e273f767097fbd2e39cd2095df0e2331"} Jun 13 02:07:04.364020 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:04.363707 2557 scope.go:117] "RemoveContainer" containerID="0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3" Jun 13 02:07:04.372361 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:04.372343 2557 scope.go:117] "RemoveContainer" containerID="0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3" Jun 13 02:07:04.372615 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:07:04.372596 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3\": container with ID starting with 0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3 not found: ID does not exist" containerID="0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3" Jun 13 02:07:04.372677 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:04.372623 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3"} err="failed to get container status \"0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3\": rpc error: code = NotFound desc = could not find container \"0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3\": container with ID starting with 0d3509f478c6ade92c7a985674af764470c0c3c87ead1e66d98b34ab357778e3 not found: ID does not exist" Jun 13 02:07:04.383884 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:04.383861 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7986cd7b67-8c5t9"] Jun 13 02:07:04.387053 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:04.387031 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7986cd7b67-8c5t9"] Jun 13 02:07:05.010025 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:05.009994 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c48e89-1234-4f70-a7ae-a628ceb40e2c" path="/var/lib/kubelet/pods/36c48e89-1234-4f70-a7ae-a628ceb40e2c/volumes" Jun 13 02:07:25.890965 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:25.890910 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql"] Jun 13 02:07:25.891551 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:25.891388 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c48e89-1234-4f70-a7ae-a628ceb40e2c" containerName="console" Jun 13 02:07:25.891551 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:25.891408 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c48e89-1234-4f70-a7ae-a628ceb40e2c" containerName="console" Jun 13 02:07:25.891551 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:25.891483 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c48e89-1234-4f70-a7ae-a628ceb40e2c" containerName="console" Jun 13 02:07:25.893529 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:25.893507 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:25.896132 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:25.896110 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 02:07:25.897105 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:25.897080 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bcfzp\"" Jun 13 02:07:25.897197 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:25.897086 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 02:07:25.903860 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:25.903836 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql"] Jun 13 02:07:26.007830 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.007792 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-269sv\" (UniqueName: \"kubernetes.io/projected/644d5d4e-eb4f-4db1-9850-e48736121e98-kube-api-access-269sv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:26.008033 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.007844 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:26.008033 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.007922 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:26.109094 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.109056 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-269sv\" (UniqueName: \"kubernetes.io/projected/644d5d4e-eb4f-4db1-9850-e48736121e98-kube-api-access-269sv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:26.109239 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.109114 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:26.109239 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.109154 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:26.109525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.109504 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:26.109559 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.109541 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:26.117241 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.117219 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-269sv\" (UniqueName: \"kubernetes.io/projected/644d5d4e-eb4f-4db1-9850-e48736121e98-kube-api-access-269sv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:26.203492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.203416 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:26.326830 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.326797 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql"] Jun 13 02:07:26.329767 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:07:26.329739 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644d5d4e_eb4f_4db1_9850_e48736121e98.slice/crio-7b84f94f0ef21c9a1ec270f002edc5fff56282463fcaf4223c9a077c58eaf770 WatchSource:0}: Error finding container 7b84f94f0ef21c9a1ec270f002edc5fff56282463fcaf4223c9a077c58eaf770: Status 404 returned error can't find the container with id 7b84f94f0ef21c9a1ec270f002edc5fff56282463fcaf4223c9a077c58eaf770 Jun 13 02:07:26.454586 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:26.454515 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" event={"ID":"644d5d4e-eb4f-4db1-9850-e48736121e98","Type":"ContainerStarted","Data":"7b84f94f0ef21c9a1ec270f002edc5fff56282463fcaf4223c9a077c58eaf770"} Jun 13 02:07:32.483471 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:32.483391 2557 generic.go:356] "Generic (PLEG): container finished" podID="644d5d4e-eb4f-4db1-9850-e48736121e98" containerID="fe16574b48d5452f3e6fe29dca1f5c88aae0e0ce9d46eba8758d438641aa03f3" exitCode=0 Jun 13 02:07:32.483799 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:32.483472 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" event={"ID":"644d5d4e-eb4f-4db1-9850-e48736121e98","Type":"ContainerDied","Data":"fe16574b48d5452f3e6fe29dca1f5c88aae0e0ce9d46eba8758d438641aa03f3"} Jun 13 02:07:36.505241 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:36.505202 2557 generic.go:356] "Generic (PLEG): container finished" podID="644d5d4e-eb4f-4db1-9850-e48736121e98" containerID="0caa67cce9535d2cc7d6abb0211291b74db5dd5c6b2e7639d399290dd661e667" exitCode=0 Jun 13 02:07:36.505658 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:36.505258 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" event={"ID":"644d5d4e-eb4f-4db1-9850-e48736121e98","Type":"ContainerDied","Data":"0caa67cce9535d2cc7d6abb0211291b74db5dd5c6b2e7639d399290dd661e667"} Jun 13 02:07:43.539219 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:43.539187 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" event={"ID":"644d5d4e-eb4f-4db1-9850-e48736121e98","Type":"ContainerStarted","Data":"9eb159f9ef563487476ce5a0c0991b342d8bb4fe58ea857ad06a62441fae48a7"} Jun 13 02:07:43.557839 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:43.557793 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" podStartSLOduration=3.023163551 podStartE2EDuration="18.557777427s" totalImagesPullingTime="15.534613876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:07:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:07:43.556206305 +0000 UTC m=+425.035356578" watchObservedRunningTime="2026-06-13 02:07:43.557777427 +0000 UTC m=+425.036927698" Jun 13 02:07:44.545699 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:44.545663 2557 generic.go:356] "Generic (PLEG): container finished" podID="644d5d4e-eb4f-4db1-9850-e48736121e98" containerID="9eb159f9ef563487476ce5a0c0991b342d8bb4fe58ea857ad06a62441fae48a7" exitCode=0 Jun 13 02:07:44.546088 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:44.545784 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" event={"ID":"644d5d4e-eb4f-4db1-9850-e48736121e98","Type":"ContainerDied","Data":"9eb159f9ef563487476ce5a0c0991b342d8bb4fe58ea857ad06a62441fae48a7"} Jun 13 02:07:45.680385 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:45.680359 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:45.780589 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:45.780562 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-bundle\") pod \"644d5d4e-eb4f-4db1-9850-e48736121e98\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " Jun 13 02:07:45.780589 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:45.780593 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-util\") pod \"644d5d4e-eb4f-4db1-9850-e48736121e98\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " Jun 13 02:07:45.780841 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:45.780639 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-269sv\" (UniqueName: \"kubernetes.io/projected/644d5d4e-eb4f-4db1-9850-e48736121e98-kube-api-access-269sv\") pod \"644d5d4e-eb4f-4db1-9850-e48736121e98\" (UID: \"644d5d4e-eb4f-4db1-9850-e48736121e98\") " Jun 13 02:07:45.781307 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:45.781282 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-bundle" (OuterVolumeSpecName: "bundle") pod "644d5d4e-eb4f-4db1-9850-e48736121e98" (UID: "644d5d4e-eb4f-4db1-9850-e48736121e98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:07:45.782893 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:45.782860 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/644d5d4e-eb4f-4db1-9850-e48736121e98-kube-api-access-269sv" (OuterVolumeSpecName: "kube-api-access-269sv") pod "644d5d4e-eb4f-4db1-9850-e48736121e98" (UID: "644d5d4e-eb4f-4db1-9850-e48736121e98"). InnerVolumeSpecName "kube-api-access-269sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:07:45.785114 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:45.785085 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-util" (OuterVolumeSpecName: "util") pod "644d5d4e-eb4f-4db1-9850-e48736121e98" (UID: "644d5d4e-eb4f-4db1-9850-e48736121e98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:07:45.882217 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:45.882143 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:07:45.882217 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:45.882169 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/644d5d4e-eb4f-4db1-9850-e48736121e98-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:07:45.882217 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:45.882178 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-269sv\" (UniqueName: \"kubernetes.io/projected/644d5d4e-eb4f-4db1-9850-e48736121e98-kube-api-access-269sv\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:07:46.555533 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:46.555490 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" event={"ID":"644d5d4e-eb4f-4db1-9850-e48736121e98","Type":"ContainerDied","Data":"7b84f94f0ef21c9a1ec270f002edc5fff56282463fcaf4223c9a077c58eaf770"} Jun 13 02:07:46.555738 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:46.555558 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlp6ql" Jun 13 02:07:46.555738 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:46.555567 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b84f94f0ef21c9a1ec270f002edc5fff56282463fcaf4223c9a077c58eaf770" Jun 13 02:07:53.585899 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.585826 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d"] Jun 13 02:07:53.586338 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.586266 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644d5d4e-eb4f-4db1-9850-e48736121e98" containerName="util" Jun 13 02:07:53.586338 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.586281 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="644d5d4e-eb4f-4db1-9850-e48736121e98" containerName="util" Jun 13 02:07:53.586338 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.586297 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644d5d4e-eb4f-4db1-9850-e48736121e98" containerName="pull" Jun 13 02:07:53.586338 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.586302 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="644d5d4e-eb4f-4db1-9850-e48736121e98" containerName="pull" Jun 13 02:07:53.586338 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.586311 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644d5d4e-eb4f-4db1-9850-e48736121e98" containerName="extract" Jun 13 02:07:53.586338 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.586316 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="644d5d4e-eb4f-4db1-9850-e48736121e98" containerName="extract" Jun 13 02:07:53.586530 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.586373 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="644d5d4e-eb4f-4db1-9850-e48736121e98" containerName="extract" Jun 13 02:07:53.588546 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.588532 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" Jun 13 02:07:53.591262 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.591244 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fg989\"" Jun 13 02:07:53.591349 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.591263 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:07:53.591349 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.591263 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 13 02:07:53.602171 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.602143 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d"] Jun 13 02:07:53.642166 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.642137 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hcn5d\" (UID: \"8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" Jun 13 02:07:53.642352 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.642192 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n9f7\" (UniqueName: \"kubernetes.io/projected/8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05-kube-api-access-7n9f7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hcn5d\" (UID: \"8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" Jun 13 02:07:53.742884 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.742850 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hcn5d\" (UID: \"8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" Jun 13 02:07:53.743077 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.742902 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n9f7\" (UniqueName: \"kubernetes.io/projected/8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05-kube-api-access-7n9f7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hcn5d\" (UID: \"8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" Jun 13 02:07:53.743256 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.743237 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hcn5d\" (UID: \"8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" Jun 13 02:07:53.750784 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.750763 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n9f7\" (UniqueName: \"kubernetes.io/projected/8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05-kube-api-access-7n9f7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hcn5d\" (UID: \"8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" Jun 13 02:07:53.897759 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:53.897672 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" Jun 13 02:07:54.053539 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:54.053499 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d"] Jun 13 02:07:54.055400 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:07:54.055376 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8cb6bf_5e27_4f5b_85cf_12f907ee5b05.slice/crio-af7ef7cfd43e0a3e90b39f4dbab8292270aedede3c11137bb279434144ecf74c WatchSource:0}: Error finding container af7ef7cfd43e0a3e90b39f4dbab8292270aedede3c11137bb279434144ecf74c: Status 404 returned error can't find the container with id af7ef7cfd43e0a3e90b39f4dbab8292270aedede3c11137bb279434144ecf74c Jun 13 02:07:54.587716 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:54.587677 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" event={"ID":"8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05","Type":"ContainerStarted","Data":"af7ef7cfd43e0a3e90b39f4dbab8292270aedede3c11137bb279434144ecf74c"} Jun 13 02:07:56.597777 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:56.597743 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" event={"ID":"8e8cb6bf-5e27-4f5b-85cf-12f907ee5b05","Type":"ContainerStarted","Data":"5670da55db67c1355160d39504001e36af317a25acf4f35ad8697d7abc621976"} Jun 13 02:07:56.617616 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:56.617560 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hcn5d" podStartSLOduration=2.089335028 podStartE2EDuration="3.617546043s" totalImagesPullingTime="1.528211015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:07:56.616294649 +0000 UTC m=+438.095444920" watchObservedRunningTime="2026-06-13 02:07:56.617546043 +0000 UTC m=+438.096696314" Jun 13 02:07:57.896889 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.896854 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4"] Jun 13 02:07:57.900371 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.900357 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:57.902886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.902860 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 02:07:57.903126 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.903101 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bcfzp\"" Jun 13 02:07:57.903222 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.903203 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 02:07:57.909728 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.909707 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4"] Jun 13 02:07:57.977462 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.977422 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd2sq\" (UniqueName: \"kubernetes.io/projected/6d5b627e-0bd0-42b7-88cb-6e30125bd771-kube-api-access-rd2sq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:57.977741 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.977710 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:57.977845 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.977821 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:57.979001 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.978982 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6"] Jun 13 02:07:57.982157 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.982143 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" Jun 13 02:07:57.984584 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.984562 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 13 02:07:57.984584 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.984582 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 13 02:07:57.984728 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.984564 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-p7hbf\"" Jun 13 02:07:57.994318 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:57.994300 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6"] Jun 13 02:07:58.078648 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.078617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:58.078804 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.078678 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0375962-0bb6-4543-97e5-4427acc74ad2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-jm9f6\" (UID: \"a0375962-0bb6-4543-97e5-4427acc74ad2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" Jun 13 02:07:58.078804 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.078721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm69g\" (UniqueName: \"kubernetes.io/projected/a0375962-0bb6-4543-97e5-4427acc74ad2-kube-api-access-tm69g\") pod \"cert-manager-webhook-7dc76cbb94-jm9f6\" (UID: \"a0375962-0bb6-4543-97e5-4427acc74ad2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" Jun 13 02:07:58.078974 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.078851 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2sq\" (UniqueName: \"kubernetes.io/projected/6d5b627e-0bd0-42b7-88cb-6e30125bd771-kube-api-access-rd2sq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:58.078974 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.078894 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:58.079089 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.079051 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:58.079183 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.079164 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:58.086750 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.086721 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd2sq\" (UniqueName: \"kubernetes.io/projected/6d5b627e-0bd0-42b7-88cb-6e30125bd771-kube-api-access-rd2sq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:58.179552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.179487 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0375962-0bb6-4543-97e5-4427acc74ad2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-jm9f6\" (UID: \"a0375962-0bb6-4543-97e5-4427acc74ad2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" Jun 13 02:07:58.179552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.179517 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm69g\" (UniqueName: \"kubernetes.io/projected/a0375962-0bb6-4543-97e5-4427acc74ad2-kube-api-access-tm69g\") pod \"cert-manager-webhook-7dc76cbb94-jm9f6\" (UID: \"a0375962-0bb6-4543-97e5-4427acc74ad2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" Jun 13 02:07:58.187253 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.187223 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm69g\" (UniqueName: \"kubernetes.io/projected/a0375962-0bb6-4543-97e5-4427acc74ad2-kube-api-access-tm69g\") pod \"cert-manager-webhook-7dc76cbb94-jm9f6\" (UID: \"a0375962-0bb6-4543-97e5-4427acc74ad2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" Jun 13 02:07:58.187253 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.187240 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0375962-0bb6-4543-97e5-4427acc74ad2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-jm9f6\" (UID: \"a0375962-0bb6-4543-97e5-4427acc74ad2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" Jun 13 02:07:58.210118 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.210085 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:07:58.303220 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.303190 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" Jun 13 02:07:58.341825 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.341802 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4"] Jun 13 02:07:58.344746 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:07:58.344719 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5b627e_0bd0_42b7_88cb_6e30125bd771.slice/crio-c9a5f420421e32662e4ad29bd9e506ef6df4bcc757d97c0eb158556b8c662a47 WatchSource:0}: Error finding container c9a5f420421e32662e4ad29bd9e506ef6df4bcc757d97c0eb158556b8c662a47: Status 404 returned error can't find the container with id c9a5f420421e32662e4ad29bd9e506ef6df4bcc757d97c0eb158556b8c662a47 Jun 13 02:07:58.433355 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.433331 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6"] Jun 13 02:07:58.436054 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:07:58.436020 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0375962_0bb6_4543_97e5_4427acc74ad2.slice/crio-2ab6c137ae15c0e18c4f3a5f60459f8d6a07b6a8f84183dd217440c9b3e78fa1 WatchSource:0}: Error finding container 2ab6c137ae15c0e18c4f3a5f60459f8d6a07b6a8f84183dd217440c9b3e78fa1: Status 404 returned error can't find the container with id 2ab6c137ae15c0e18c4f3a5f60459f8d6a07b6a8f84183dd217440c9b3e78fa1 Jun 13 02:07:58.607702 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.607667 2557 generic.go:356] "Generic (PLEG): container finished" podID="6d5b627e-0bd0-42b7-88cb-6e30125bd771" containerID="747fdf5e4355468a0fc70ea5e3b753a926f4a811b6d986629be22998ff68aee6" exitCode=0 Jun 13 02:07:58.607881 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.607751 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" event={"ID":"6d5b627e-0bd0-42b7-88cb-6e30125bd771","Type":"ContainerDied","Data":"747fdf5e4355468a0fc70ea5e3b753a926f4a811b6d986629be22998ff68aee6"} Jun 13 02:07:58.607881 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.607803 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" event={"ID":"6d5b627e-0bd0-42b7-88cb-6e30125bd771","Type":"ContainerStarted","Data":"c9a5f420421e32662e4ad29bd9e506ef6df4bcc757d97c0eb158556b8c662a47"} Jun 13 02:07:58.609058 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:07:58.609035 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" event={"ID":"a0375962-0bb6-4543-97e5-4427acc74ad2","Type":"ContainerStarted","Data":"2ab6c137ae15c0e18c4f3a5f60459f8d6a07b6a8f84183dd217440c9b3e78fa1"} Jun 13 02:08:02.632262 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:02.632215 2557 generic.go:356] "Generic (PLEG): container finished" podID="6d5b627e-0bd0-42b7-88cb-6e30125bd771" containerID="45d35395d7f9a10704a787a91f0ad645dd15cb367c4fa76d3ecd4f28a3af0971" exitCode=0 Jun 13 02:08:02.632676 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:02.632279 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" event={"ID":"6d5b627e-0bd0-42b7-88cb-6e30125bd771","Type":"ContainerDied","Data":"45d35395d7f9a10704a787a91f0ad645dd15cb367c4fa76d3ecd4f28a3af0971"} Jun 13 02:08:02.633934 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:02.633913 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" event={"ID":"a0375962-0bb6-4543-97e5-4427acc74ad2","Type":"ContainerStarted","Data":"2cad8cd1bceeb9d3a71bc28dea04948649b8d50f1bc367e8d883ea16392bcfe9"} Jun 13 02:08:02.634135 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:02.634023 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" Jun 13 02:08:02.663265 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:02.663214 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" podStartSLOduration=1.935391057 podStartE2EDuration="5.663198459s" totalImagesPullingTime="3.727807402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:02.662103794 +0000 UTC m=+444.141254079" watchObservedRunningTime="2026-06-13 02:08:02.663198459 +0000 UTC m=+444.142348732" Jun 13 02:08:03.640445 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:03.640412 2557 generic.go:356] "Generic (PLEG): container finished" podID="6d5b627e-0bd0-42b7-88cb-6e30125bd771" containerID="efb2df23b3e2d1cf9201118134dd8754f91eb3ed529f57857276ff9c88da9550" exitCode=0 Jun 13 02:08:03.640831 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:03.640498 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" event={"ID":"6d5b627e-0bd0-42b7-88cb-6e30125bd771","Type":"ContainerDied","Data":"efb2df23b3e2d1cf9201118134dd8754f91eb3ed529f57857276ff9c88da9550"} Jun 13 02:08:04.778879 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:04.778852 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:08:04.841732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:04.841703 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rd2sq\" (UniqueName: \"kubernetes.io/projected/6d5b627e-0bd0-42b7-88cb-6e30125bd771-kube-api-access-rd2sq\") pod \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " Jun 13 02:08:04.841899 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:04.841785 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-bundle\") pod \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " Jun 13 02:08:04.841899 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:04.841829 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-util\") pod \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\" (UID: \"6d5b627e-0bd0-42b7-88cb-6e30125bd771\") " Jun 13 02:08:04.842198 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:04.842174 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-bundle" (OuterVolumeSpecName: "bundle") pod "6d5b627e-0bd0-42b7-88cb-6e30125bd771" (UID: "6d5b627e-0bd0-42b7-88cb-6e30125bd771"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:08:04.843782 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:04.843760 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d5b627e-0bd0-42b7-88cb-6e30125bd771-kube-api-access-rd2sq" (OuterVolumeSpecName: "kube-api-access-rd2sq") pod "6d5b627e-0bd0-42b7-88cb-6e30125bd771" (UID: "6d5b627e-0bd0-42b7-88cb-6e30125bd771"). InnerVolumeSpecName "kube-api-access-rd2sq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:08:04.846277 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:04.846254 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-util" (OuterVolumeSpecName: "util") pod "6d5b627e-0bd0-42b7-88cb-6e30125bd771" (UID: "6d5b627e-0bd0-42b7-88cb-6e30125bd771"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:08:04.942650 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:04.942573 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:08:04.942650 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:04.942599 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d5b627e-0bd0-42b7-88cb-6e30125bd771-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:08:04.942650 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:04.942610 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd2sq\" (UniqueName: \"kubernetes.io/projected/6d5b627e-0bd0-42b7-88cb-6e30125bd771-kube-api-access-rd2sq\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:08:05.651905 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:05.651873 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" Jun 13 02:08:05.651905 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:05.651891 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjckv4" event={"ID":"6d5b627e-0bd0-42b7-88cb-6e30125bd771","Type":"ContainerDied","Data":"c9a5f420421e32662e4ad29bd9e506ef6df4bcc757d97c0eb158556b8c662a47"} Jun 13 02:08:05.652149 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:05.651980 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9a5f420421e32662e4ad29bd9e506ef6df4bcc757d97c0eb158556b8c662a47" Jun 13 02:08:08.642633 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:08.642597 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-jm9f6" Jun 13 02:08:12.369288 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.369250 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh"] Jun 13 02:08:12.369652 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.369563 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d5b627e-0bd0-42b7-88cb-6e30125bd771" containerName="util" Jun 13 02:08:12.369652 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.369575 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d5b627e-0bd0-42b7-88cb-6e30125bd771" containerName="util" Jun 13 02:08:12.369652 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.369595 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d5b627e-0bd0-42b7-88cb-6e30125bd771" containerName="pull" Jun 13 02:08:12.369652 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.369601 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d5b627e-0bd0-42b7-88cb-6e30125bd771" containerName="pull" Jun 13 02:08:12.369652 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.369613 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d5b627e-0bd0-42b7-88cb-6e30125bd771" containerName="extract" Jun 13 02:08:12.369652 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.369619 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d5b627e-0bd0-42b7-88cb-6e30125bd771" containerName="extract" Jun 13 02:08:12.369835 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.369669 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d5b627e-0bd0-42b7-88cb-6e30125bd771" containerName="extract" Jun 13 02:08:12.416169 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.416140 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh"] Jun 13 02:08:12.416312 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.416229 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" Jun 13 02:08:12.419073 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.419051 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 02:08:12.419163 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.419095 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:08:12.420120 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.420102 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nm5ps\"" Jun 13 02:08:12.507482 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.507441 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zt5f\" (UniqueName: \"kubernetes.io/projected/77082ad2-9e27-45ab-b583-7c44d803b836-kube-api-access-6zt5f\") pod \"openshift-lws-operator-fd8ccff4c-thkhh\" (UID: \"77082ad2-9e27-45ab-b583-7c44d803b836\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" Jun 13 02:08:12.507673 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.507530 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77082ad2-9e27-45ab-b583-7c44d803b836-tmp\") pod \"openshift-lws-operator-fd8ccff4c-thkhh\" (UID: \"77082ad2-9e27-45ab-b583-7c44d803b836\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" Jun 13 02:08:12.608380 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.608341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77082ad2-9e27-45ab-b583-7c44d803b836-tmp\") pod \"openshift-lws-operator-fd8ccff4c-thkhh\" (UID: \"77082ad2-9e27-45ab-b583-7c44d803b836\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" Jun 13 02:08:12.608544 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.608409 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zt5f\" (UniqueName: \"kubernetes.io/projected/77082ad2-9e27-45ab-b583-7c44d803b836-kube-api-access-6zt5f\") pod \"openshift-lws-operator-fd8ccff4c-thkhh\" (UID: \"77082ad2-9e27-45ab-b583-7c44d803b836\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" Jun 13 02:08:12.608808 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.608790 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77082ad2-9e27-45ab-b583-7c44d803b836-tmp\") pod \"openshift-lws-operator-fd8ccff4c-thkhh\" (UID: \"77082ad2-9e27-45ab-b583-7c44d803b836\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" Jun 13 02:08:12.616677 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.616648 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zt5f\" (UniqueName: \"kubernetes.io/projected/77082ad2-9e27-45ab-b583-7c44d803b836-kube-api-access-6zt5f\") pod \"openshift-lws-operator-fd8ccff4c-thkhh\" (UID: \"77082ad2-9e27-45ab-b583-7c44d803b836\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" Jun 13 02:08:12.725154 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.725068 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" Jun 13 02:08:12.874742 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:12.874715 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh"] Jun 13 02:08:12.876864 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:08:12.876834 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77082ad2_9e27_45ab_b583_7c44d803b836.slice/crio-7dc4f1841b06ea85b9bfa4bb90082bf5d6f00d40e9162ab3429ec55f51d77d61 WatchSource:0}: Error finding container 7dc4f1841b06ea85b9bfa4bb90082bf5d6f00d40e9162ab3429ec55f51d77d61: Status 404 returned error can't find the container with id 7dc4f1841b06ea85b9bfa4bb90082bf5d6f00d40e9162ab3429ec55f51d77d61 Jun 13 02:08:13.694144 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:13.694110 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" event={"ID":"77082ad2-9e27-45ab-b583-7c44d803b836","Type":"ContainerStarted","Data":"7dc4f1841b06ea85b9bfa4bb90082bf5d6f00d40e9162ab3429ec55f51d77d61"} Jun 13 02:08:15.706036 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:15.705996 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" event={"ID":"77082ad2-9e27-45ab-b583-7c44d803b836","Type":"ContainerStarted","Data":"4f449d5dcca6c8ef1b1463b434221722454a576513bb360facf59fd1bfba6992"} Jun 13 02:08:15.721601 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:15.721551 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thkhh" podStartSLOduration=1.087438069 podStartE2EDuration="3.721534938s" totalImagesPullingTime="2.634096869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:15.72014222 +0000 UTC m=+457.199292491" watchObservedRunningTime="2026-06-13 02:08:15.721534938 +0000 UTC m=+457.200685209" Jun 13 02:08:16.827512 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:16.827477 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-f69xq"] Jun 13 02:08:16.829862 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:16.829844 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-f69xq" Jun 13 02:08:16.832441 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:16.832421 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qlfj8\"" Jun 13 02:08:16.841612 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:16.841591 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-f69xq"] Jun 13 02:08:16.946688 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:16.946654 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e925183-2e96-4de8-b1c7-f21cb52daaf6-bound-sa-token\") pod \"cert-manager-59c77684cc-f69xq\" (UID: \"0e925183-2e96-4de8-b1c7-f21cb52daaf6\") " pod="cert-manager/cert-manager-59c77684cc-f69xq" Jun 13 02:08:16.946839 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:16.946716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qn5d\" (UniqueName: \"kubernetes.io/projected/0e925183-2e96-4de8-b1c7-f21cb52daaf6-kube-api-access-7qn5d\") pod \"cert-manager-59c77684cc-f69xq\" (UID: \"0e925183-2e96-4de8-b1c7-f21cb52daaf6\") " pod="cert-manager/cert-manager-59c77684cc-f69xq" Jun 13 02:08:17.047596 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:17.047565 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e925183-2e96-4de8-b1c7-f21cb52daaf6-bound-sa-token\") pod \"cert-manager-59c77684cc-f69xq\" (UID: \"0e925183-2e96-4de8-b1c7-f21cb52daaf6\") " pod="cert-manager/cert-manager-59c77684cc-f69xq" Jun 13 02:08:17.047772 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:17.047622 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qn5d\" (UniqueName: \"kubernetes.io/projected/0e925183-2e96-4de8-b1c7-f21cb52daaf6-kube-api-access-7qn5d\") pod \"cert-manager-59c77684cc-f69xq\" (UID: \"0e925183-2e96-4de8-b1c7-f21cb52daaf6\") " pod="cert-manager/cert-manager-59c77684cc-f69xq" Jun 13 02:08:17.055279 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:17.055247 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e925183-2e96-4de8-b1c7-f21cb52daaf6-bound-sa-token\") pod \"cert-manager-59c77684cc-f69xq\" (UID: \"0e925183-2e96-4de8-b1c7-f21cb52daaf6\") " pod="cert-manager/cert-manager-59c77684cc-f69xq" Jun 13 02:08:17.055371 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:17.055357 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qn5d\" (UniqueName: \"kubernetes.io/projected/0e925183-2e96-4de8-b1c7-f21cb52daaf6-kube-api-access-7qn5d\") pod \"cert-manager-59c77684cc-f69xq\" (UID: \"0e925183-2e96-4de8-b1c7-f21cb52daaf6\") " pod="cert-manager/cert-manager-59c77684cc-f69xq" Jun 13 02:08:17.138450 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:17.138374 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-f69xq" Jun 13 02:08:17.260973 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:17.260934 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-f69xq"] Jun 13 02:08:17.263422 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:08:17.263395 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e925183_2e96_4de8_b1c7_f21cb52daaf6.slice/crio-d76c8e45cd00647804c04ec989dbdeb33eb061eafc5e988090ee2f01c6aa394e WatchSource:0}: Error finding container d76c8e45cd00647804c04ec989dbdeb33eb061eafc5e988090ee2f01c6aa394e: Status 404 returned error can't find the container with id d76c8e45cd00647804c04ec989dbdeb33eb061eafc5e988090ee2f01c6aa394e Jun 13 02:08:17.716909 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:17.716873 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-f69xq" event={"ID":"0e925183-2e96-4de8-b1c7-f21cb52daaf6","Type":"ContainerStarted","Data":"a745852dcbd590ac7db1c14a3fcbdcb202b5eb6099118085c93b0a74f1e484d8"} Jun 13 02:08:17.716909 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:17.716912 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-f69xq" event={"ID":"0e925183-2e96-4de8-b1c7-f21cb52daaf6","Type":"ContainerStarted","Data":"d76c8e45cd00647804c04ec989dbdeb33eb061eafc5e988090ee2f01c6aa394e"} Jun 13 02:08:17.735928 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:17.735878 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-f69xq" podStartSLOduration=1.73586206 podStartE2EDuration="1.73586206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:08:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:17.733461247 +0000 UTC m=+459.212611519" watchObservedRunningTime="2026-06-13 02:08:17.73586206 +0000 UTC m=+459.215012332" Jun 13 02:08:18.149282 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.149245 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl"] Jun 13 02:08:18.151869 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.151853 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.154261 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.154233 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bcfzp\"" Jun 13 02:08:18.154261 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.154233 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 02:08:18.154538 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.154526 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 02:08:18.159773 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.159751 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl"] Jun 13 02:08:18.258894 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.258868 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.259047 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.258929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.259047 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.259017 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5v6x\" (UniqueName: \"kubernetes.io/projected/d539dc3f-db6f-4606-a7f0-f72aef214207-kube-api-access-l5v6x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.359799 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.359766 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.360006 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.359824 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.360006 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.359857 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5v6x\" (UniqueName: \"kubernetes.io/projected/d539dc3f-db6f-4606-a7f0-f72aef214207-kube-api-access-l5v6x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.360310 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.360286 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.360310 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.360300 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.368295 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.368272 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5v6x\" (UniqueName: \"kubernetes.io/projected/d539dc3f-db6f-4606-a7f0-f72aef214207-kube-api-access-l5v6x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.462521 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.462448 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:18.585944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.585915 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl"] Jun 13 02:08:18.587305 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:08:18.587280 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd539dc3f_db6f_4606_a7f0_f72aef214207.slice/crio-c2fb307aae94d76f47cbb3a5c9e6bf2a4d1e02140aac1a95ef4844a91d519cab WatchSource:0}: Error finding container c2fb307aae94d76f47cbb3a5c9e6bf2a4d1e02140aac1a95ef4844a91d519cab: Status 404 returned error can't find the container with id c2fb307aae94d76f47cbb3a5c9e6bf2a4d1e02140aac1a95ef4844a91d519cab Jun 13 02:08:18.723150 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.723066 2557 generic.go:356] "Generic (PLEG): container finished" podID="d539dc3f-db6f-4606-a7f0-f72aef214207" containerID="bf7470c41e87b763a3ef9f739a462b2e80f7dc58013900c7439e0429cdc9673b" exitCode=0 Jun 13 02:08:18.723297 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.723155 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" event={"ID":"d539dc3f-db6f-4606-a7f0-f72aef214207","Type":"ContainerDied","Data":"bf7470c41e87b763a3ef9f739a462b2e80f7dc58013900c7439e0429cdc9673b"} Jun 13 02:08:18.723297 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:18.723209 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" event={"ID":"d539dc3f-db6f-4606-a7f0-f72aef214207","Type":"ContainerStarted","Data":"c2fb307aae94d76f47cbb3a5c9e6bf2a4d1e02140aac1a95ef4844a91d519cab"} Jun 13 02:08:19.729720 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:19.729640 2557 generic.go:356] "Generic (PLEG): container finished" podID="d539dc3f-db6f-4606-a7f0-f72aef214207" containerID="59573fb479227431f372a3f459ea01788be553ca5222aeef796f716ac67dc96e" exitCode=0 Jun 13 02:08:19.730083 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:19.729755 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" event={"ID":"d539dc3f-db6f-4606-a7f0-f72aef214207","Type":"ContainerDied","Data":"59573fb479227431f372a3f459ea01788be553ca5222aeef796f716ac67dc96e"} Jun 13 02:08:20.737466 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:20.737429 2557 generic.go:356] "Generic (PLEG): container finished" podID="d539dc3f-db6f-4606-a7f0-f72aef214207" containerID="4cc84ba9d23668754494541adfa0daf7eb8b0ad5b19beb8ae8fc7653f63848ab" exitCode=0 Jun 13 02:08:20.737827 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:20.737473 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" event={"ID":"d539dc3f-db6f-4606-a7f0-f72aef214207","Type":"ContainerDied","Data":"4cc84ba9d23668754494541adfa0daf7eb8b0ad5b19beb8ae8fc7653f63848ab"} Jun 13 02:08:21.872584 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:21.872561 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:21.993276 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:21.993199 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-util\") pod \"d539dc3f-db6f-4606-a7f0-f72aef214207\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " Jun 13 02:08:21.993276 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:21.993251 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5v6x\" (UniqueName: \"kubernetes.io/projected/d539dc3f-db6f-4606-a7f0-f72aef214207-kube-api-access-l5v6x\") pod \"d539dc3f-db6f-4606-a7f0-f72aef214207\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " Jun 13 02:08:21.993481 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:21.993347 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-bundle\") pod \"d539dc3f-db6f-4606-a7f0-f72aef214207\" (UID: \"d539dc3f-db6f-4606-a7f0-f72aef214207\") " Jun 13 02:08:21.994032 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:21.994000 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-bundle" (OuterVolumeSpecName: "bundle") pod "d539dc3f-db6f-4606-a7f0-f72aef214207" (UID: "d539dc3f-db6f-4606-a7f0-f72aef214207"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:08:21.995377 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:21.995348 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d539dc3f-db6f-4606-a7f0-f72aef214207-kube-api-access-l5v6x" (OuterVolumeSpecName: "kube-api-access-l5v6x") pod "d539dc3f-db6f-4606-a7f0-f72aef214207" (UID: "d539dc3f-db6f-4606-a7f0-f72aef214207"). InnerVolumeSpecName "kube-api-access-l5v6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:08:21.998900 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:21.998880 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-util" (OuterVolumeSpecName: "util") pod "d539dc3f-db6f-4606-a7f0-f72aef214207" (UID: "d539dc3f-db6f-4606-a7f0-f72aef214207"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:08:22.094801 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:22.094765 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:08:22.094801 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:22.094792 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d539dc3f-db6f-4606-a7f0-f72aef214207-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:08:22.094801 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:22.094803 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5v6x\" (UniqueName: \"kubernetes.io/projected/d539dc3f-db6f-4606-a7f0-f72aef214207-kube-api-access-l5v6x\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:08:22.747824 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:22.747784 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" event={"ID":"d539dc3f-db6f-4606-a7f0-f72aef214207","Type":"ContainerDied","Data":"c2fb307aae94d76f47cbb3a5c9e6bf2a4d1e02140aac1a95ef4844a91d519cab"} Jun 13 02:08:22.748009 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:22.747838 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2fb307aae94d76f47cbb3a5c9e6bf2a4d1e02140aac1a95ef4844a91d519cab" Jun 13 02:08:22.748009 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:22.747841 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ccjl" Jun 13 02:08:32.637817 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.637780 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs"] Jun 13 02:08:32.638298 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.638131 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d539dc3f-db6f-4606-a7f0-f72aef214207" containerName="util" Jun 13 02:08:32.638298 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.638143 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d539dc3f-db6f-4606-a7f0-f72aef214207" containerName="util" Jun 13 02:08:32.638298 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.638160 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d539dc3f-db6f-4606-a7f0-f72aef214207" containerName="extract" Jun 13 02:08:32.638298 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.638166 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d539dc3f-db6f-4606-a7f0-f72aef214207" containerName="extract" Jun 13 02:08:32.638298 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.638180 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d539dc3f-db6f-4606-a7f0-f72aef214207" containerName="pull" Jun 13 02:08:32.638298 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.638186 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d539dc3f-db6f-4606-a7f0-f72aef214207" containerName="pull" Jun 13 02:08:32.638298 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.638236 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d539dc3f-db6f-4606-a7f0-f72aef214207" containerName="extract" Jun 13 02:08:32.641426 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.641406 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.645556 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.645531 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5ldbz\"" Jun 13 02:08:32.645796 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.645773 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 02:08:32.645937 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.645846 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 02:08:32.646077 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.645868 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 02:08:32.646265 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.646195 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 02:08:32.661019 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.660989 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs"] Jun 13 02:08:32.675687 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.675648 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a69cb4ec-5941-426d-81db-3405738f196d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.675816 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.675721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a69cb4ec-5941-426d-81db-3405738f196d-manifests\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.675816 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.675770 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a69cb4ec-5941-426d-81db-3405738f196d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.675938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.675859 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjhws\" (UniqueName: \"kubernetes.io/projected/a69cb4ec-5941-426d-81db-3405738f196d-kube-api-access-pjhws\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.675938 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.675905 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a69cb4ec-5941-426d-81db-3405738f196d-tmp\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.777345 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.777310 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a69cb4ec-5941-426d-81db-3405738f196d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.777514 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.777361 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a69cb4ec-5941-426d-81db-3405738f196d-manifests\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.777514 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.777398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a69cb4ec-5941-426d-81db-3405738f196d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.777514 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.777429 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjhws\" (UniqueName: \"kubernetes.io/projected/a69cb4ec-5941-426d-81db-3405738f196d-kube-api-access-pjhws\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.777514 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.777454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a69cb4ec-5941-426d-81db-3405738f196d-tmp\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.777892 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.777868 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a69cb4ec-5941-426d-81db-3405738f196d-manifests\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.779780 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.779750 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a69cb4ec-5941-426d-81db-3405738f196d-tmp\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.780018 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.779999 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a69cb4ec-5941-426d-81db-3405738f196d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.780092 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.780045 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a69cb4ec-5941-426d-81db-3405738f196d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.790989 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.790945 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjhws\" (UniqueName: \"kubernetes.io/projected/a69cb4ec-5941-426d-81db-3405738f196d-kube-api-access-pjhws\") pod \"opendatahub-operator-controller-manager-76bc779c54-z2vfs\" (UID: \"a69cb4ec-5941-426d-81db-3405738f196d\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:32.953246 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:32.953153 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:33.098032 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:33.098010 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs"] Jun 13 02:08:33.100695 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:08:33.100668 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69cb4ec_5941_426d_81db_3405738f196d.slice/crio-41f923c02a08252f2fc2b262fc17022ed3b6810c304bacd8445b6d193401f63d WatchSource:0}: Error finding container 41f923c02a08252f2fc2b262fc17022ed3b6810c304bacd8445b6d193401f63d: Status 404 returned error can't find the container with id 41f923c02a08252f2fc2b262fc17022ed3b6810c304bacd8445b6d193401f63d Jun 13 02:08:33.802468 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:33.802424 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" event={"ID":"a69cb4ec-5941-426d-81db-3405738f196d","Type":"ContainerStarted","Data":"41f923c02a08252f2fc2b262fc17022ed3b6810c304bacd8445b6d193401f63d"} Jun 13 02:08:36.820791 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:36.820750 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" event={"ID":"a69cb4ec-5941-426d-81db-3405738f196d","Type":"ContainerStarted","Data":"f4ccae1cfdbd4fac35e726d5bfd1d7423619ca9fadb8f94360728a45d5a68ffa"} Jun 13 02:08:37.827120 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:37.827087 2557 generic.go:356] "Generic (PLEG): container finished" podID="a69cb4ec-5941-426d-81db-3405738f196d" containerID="f4ccae1cfdbd4fac35e726d5bfd1d7423619ca9fadb8f94360728a45d5a68ffa" exitCode=0 Jun 13 02:08:37.827461 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:37.827169 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" event={"ID":"a69cb4ec-5941-426d-81db-3405738f196d","Type":"ContainerDied","Data":"f4ccae1cfdbd4fac35e726d5bfd1d7423619ca9fadb8f94360728a45d5a68ffa"} Jun 13 02:08:38.834078 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:38.834043 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" event={"ID":"a69cb4ec-5941-426d-81db-3405738f196d","Type":"ContainerStarted","Data":"eba0fe84dff41b601935f0f4d67b3ed947c6e932b34e8e5ff44db26c93076e67"} Jun 13 02:08:38.834438 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:38.834202 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:38.855465 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:38.855418 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" podStartSLOduration=2.590354557 podStartE2EDuration="6.855405104s" totalImagesPullingTime="3.338028563s" totalInitContainerRuntime="927.021984ms" isStatefulPod=false podCreationTimestamp="2026-06-13 02:08:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:38.852989034 +0000 UTC m=+480.332139307" watchObservedRunningTime="2026-06-13 02:08:38.855405104 +0000 UTC m=+480.334555376" Jun 13 02:08:49.841909 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:49.841877 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-z2vfs" Jun 13 02:08:51.899723 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:51.899691 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-thgkp"] Jun 13 02:08:51.902858 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:51.902843 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:08:51.905357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:51.905340 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 13 02:08:51.905460 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:51.905404 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-t4nc6\"" Jun 13 02:08:51.912722 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:51.912691 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-thgkp"] Jun 13 02:08:51.948158 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:51.948128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2kx4\" (UniqueName: \"kubernetes.io/projected/777a005d-6303-4ab9-a8f1-bb1cc73c47aa-kube-api-access-z2kx4\") pod \"odh-model-controller-6dc94f689f-thgkp\" (UID: \"777a005d-6303-4ab9-a8f1-bb1cc73c47aa\") " pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:08:51.948297 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:51.948173 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/777a005d-6303-4ab9-a8f1-bb1cc73c47aa-cert\") pod \"odh-model-controller-6dc94f689f-thgkp\" (UID: \"777a005d-6303-4ab9-a8f1-bb1cc73c47aa\") " pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:08:52.049223 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.049186 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2kx4\" (UniqueName: \"kubernetes.io/projected/777a005d-6303-4ab9-a8f1-bb1cc73c47aa-kube-api-access-z2kx4\") pod \"odh-model-controller-6dc94f689f-thgkp\" (UID: \"777a005d-6303-4ab9-a8f1-bb1cc73c47aa\") " pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:08:52.049413 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.049244 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/777a005d-6303-4ab9-a8f1-bb1cc73c47aa-cert\") pod \"odh-model-controller-6dc94f689f-thgkp\" (UID: \"777a005d-6303-4ab9-a8f1-bb1cc73c47aa\") " pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:08:52.049413 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:08:52.049343 2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 13 02:08:52.049413 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:08:52.049411 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/777a005d-6303-4ab9-a8f1-bb1cc73c47aa-cert podName:777a005d-6303-4ab9-a8f1-bb1cc73c47aa nodeName:}" failed. No retries permitted until 2026-06-13 02:08:52.549392252 +0000 UTC m=+494.028542505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/777a005d-6303-4ab9-a8f1-bb1cc73c47aa-cert") pod "odh-model-controller-6dc94f689f-thgkp" (UID: "777a005d-6303-4ab9-a8f1-bb1cc73c47aa") : secret "odh-model-controller-webhook-cert" not found Jun 13 02:08:52.058559 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.058530 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2kx4\" (UniqueName: \"kubernetes.io/projected/777a005d-6303-4ab9-a8f1-bb1cc73c47aa-kube-api-access-z2kx4\") pod \"odh-model-controller-6dc94f689f-thgkp\" (UID: \"777a005d-6303-4ab9-a8f1-bb1cc73c47aa\") " pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:08:52.337199 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.337160 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-z52qc"] Jun 13 02:08:52.341678 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.341644 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-z52qc" Jun 13 02:08:52.344296 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.344272 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 13 02:08:52.344415 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.344300 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-c7x4v\"" Jun 13 02:08:52.350682 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.350658 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-z52qc"] Jun 13 02:08:52.453654 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.453621 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c479f1-1b38-4d6e-825c-5171ca376357-tls-certs\") pod \"model-serving-api-5dd488fc48-z52qc\" (UID: \"94c479f1-1b38-4d6e-825c-5171ca376357\") " pod="opendatahub/model-serving-api-5dd488fc48-z52qc" Jun 13 02:08:52.453654 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.453658 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd4hw\" (UniqueName: \"kubernetes.io/projected/94c479f1-1b38-4d6e-825c-5171ca376357-kube-api-access-sd4hw\") pod \"model-serving-api-5dd488fc48-z52qc\" (UID: \"94c479f1-1b38-4d6e-825c-5171ca376357\") " pod="opendatahub/model-serving-api-5dd488fc48-z52qc" Jun 13 02:08:52.554590 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.554558 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c479f1-1b38-4d6e-825c-5171ca376357-tls-certs\") pod \"model-serving-api-5dd488fc48-z52qc\" (UID: \"94c479f1-1b38-4d6e-825c-5171ca376357\") " pod="opendatahub/model-serving-api-5dd488fc48-z52qc" Jun 13 02:08:52.554590 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.554592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd4hw\" (UniqueName: \"kubernetes.io/projected/94c479f1-1b38-4d6e-825c-5171ca376357-kube-api-access-sd4hw\") pod \"model-serving-api-5dd488fc48-z52qc\" (UID: \"94c479f1-1b38-4d6e-825c-5171ca376357\") " pod="opendatahub/model-serving-api-5dd488fc48-z52qc" Jun 13 02:08:52.554799 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.554627 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/777a005d-6303-4ab9-a8f1-bb1cc73c47aa-cert\") pod \"odh-model-controller-6dc94f689f-thgkp\" (UID: \"777a005d-6303-4ab9-a8f1-bb1cc73c47aa\") " pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:08:52.557144 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.557120 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/777a005d-6303-4ab9-a8f1-bb1cc73c47aa-cert\") pod \"odh-model-controller-6dc94f689f-thgkp\" (UID: \"777a005d-6303-4ab9-a8f1-bb1cc73c47aa\") " pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:08:52.557254 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.557194 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c479f1-1b38-4d6e-825c-5171ca376357-tls-certs\") pod \"model-serving-api-5dd488fc48-z52qc\" (UID: \"94c479f1-1b38-4d6e-825c-5171ca376357\") " pod="opendatahub/model-serving-api-5dd488fc48-z52qc" Jun 13 02:08:52.563689 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.563665 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd4hw\" (UniqueName: \"kubernetes.io/projected/94c479f1-1b38-4d6e-825c-5171ca376357-kube-api-access-sd4hw\") pod \"model-serving-api-5dd488fc48-z52qc\" (UID: \"94c479f1-1b38-4d6e-825c-5171ca376357\") " pod="opendatahub/model-serving-api-5dd488fc48-z52qc" Jun 13 02:08:52.653881 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.653791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-z52qc" Jun 13 02:08:52.787419 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.787388 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-z52qc"] Jun 13 02:08:52.789399 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:08:52.789375 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c479f1_1b38_4d6e_825c_5171ca376357.slice/crio-558e09c1e00ca454452dcbc0cfe772677600420bc1eb7a908008db5e98feebd0 WatchSource:0}: Error finding container 558e09c1e00ca454452dcbc0cfe772677600420bc1eb7a908008db5e98feebd0: Status 404 returned error can't find the container with id 558e09c1e00ca454452dcbc0cfe772677600420bc1eb7a908008db5e98feebd0 Jun 13 02:08:52.815321 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.815293 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:08:52.904743 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.904672 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-z52qc" event={"ID":"94c479f1-1b38-4d6e-825c-5171ca376357","Type":"ContainerStarted","Data":"558e09c1e00ca454452dcbc0cfe772677600420bc1eb7a908008db5e98feebd0"} Jun 13 02:08:52.950987 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:52.950962 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-thgkp"] Jun 13 02:08:52.952338 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:08:52.952314 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777a005d_6303_4ab9_a8f1_bb1cc73c47aa.slice/crio-cae3340e72f489ae988940be39bd3ff623ebf8f5ea89fd056ee108f61aa65449 WatchSource:0}: Error finding container cae3340e72f489ae988940be39bd3ff623ebf8f5ea89fd056ee108f61aa65449: Status 404 returned error can't find the container with id cae3340e72f489ae988940be39bd3ff623ebf8f5ea89fd056ee108f61aa65449 Jun 13 02:08:53.914503 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:53.914468 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" event={"ID":"777a005d-6303-4ab9-a8f1-bb1cc73c47aa","Type":"ContainerStarted","Data":"cae3340e72f489ae988940be39bd3ff623ebf8f5ea89fd056ee108f61aa65449"} Jun 13 02:08:56.934332 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:56.934242 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" event={"ID":"777a005d-6303-4ab9-a8f1-bb1cc73c47aa","Type":"ContainerStarted","Data":"d7106efbc3f3b1f517e24fb1a9ea7a3559fbc85fe540e48e050e1bed607beff4"} Jun 13 02:08:56.934784 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:56.934345 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:08:56.935942 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:56.935916 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-z52qc" event={"ID":"94c479f1-1b38-4d6e-825c-5171ca376357","Type":"ContainerStarted","Data":"2f7facf24939589d8ba725ded66e2233af4f00fc5ad3ccb749167d7ff51acab2"} Jun 13 02:08:56.936087 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:56.936068 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-z52qc" Jun 13 02:08:56.949614 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:56.949559 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" podStartSLOduration=2.215165137 podStartE2EDuration="5.949540385s" totalImagesPullingTime="3.734375248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:56.948695581 +0000 UTC m=+498.427845874" watchObservedRunningTime="2026-06-13 02:08:56.949540385 +0000 UTC m=+498.428690659" Jun 13 02:08:56.966084 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:08:56.966030 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-z52qc" podStartSLOduration=1.074896816 podStartE2EDuration="4.966014601s" totalImagesPullingTime="3.891117785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:56.964828033 +0000 UTC m=+498.443978306" watchObservedRunningTime="2026-06-13 02:08:56.966014601 +0000 UTC m=+498.445164877" Jun 13 02:09:01.474551 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.474513 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-nhbnh"] Jun 13 02:09:01.478038 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.478022 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" Jun 13 02:09:01.481490 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.481471 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-h7dl2\"" Jun 13 02:09:01.482426 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.482409 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 13 02:09:01.503991 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.503942 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-nhbnh"] Jun 13 02:09:01.505832 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.505807 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj"] Jun 13 02:09:01.509219 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.509196 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" Jun 13 02:09:01.512444 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.512426 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-sl28l\"" Jun 13 02:09:01.512724 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.512709 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 13 02:09:01.531499 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.531469 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj"] Jun 13 02:09:01.634969 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.634922 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d193ca2a-e5e6-4e4e-8df0-c16a06f5c486-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-bdxnj\" (UID: \"d193ca2a-e5e6-4e4e-8df0-c16a06f5c486\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" Jun 13 02:09:01.635144 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.635003 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb62x\" (UniqueName: \"kubernetes.io/projected/1e2dfb58-2bdf-4768-8662-a697a7a72f4b-kube-api-access-hb62x\") pod \"kserve-controller-manager-69fc866d76-nhbnh\" (UID: \"1e2dfb58-2bdf-4768-8662-a697a7a72f4b\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" Jun 13 02:09:01.635144 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.635118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcx5b\" (UniqueName: \"kubernetes.io/projected/d193ca2a-e5e6-4e4e-8df0-c16a06f5c486-kube-api-access-bcx5b\") pod \"llmisvc-controller-manager-864bfd7bc9-bdxnj\" (UID: \"d193ca2a-e5e6-4e4e-8df0-c16a06f5c486\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" Jun 13 02:09:01.635229 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.635166 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e2dfb58-2bdf-4768-8662-a697a7a72f4b-cert\") pod \"kserve-controller-manager-69fc866d76-nhbnh\" (UID: \"1e2dfb58-2bdf-4768-8662-a697a7a72f4b\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" Jun 13 02:09:01.736663 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.736576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e2dfb58-2bdf-4768-8662-a697a7a72f4b-cert\") pod \"kserve-controller-manager-69fc866d76-nhbnh\" (UID: \"1e2dfb58-2bdf-4768-8662-a697a7a72f4b\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" Jun 13 02:09:01.736663 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.736618 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d193ca2a-e5e6-4e4e-8df0-c16a06f5c486-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-bdxnj\" (UID: \"d193ca2a-e5e6-4e4e-8df0-c16a06f5c486\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" Jun 13 02:09:01.736663 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.736650 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb62x\" (UniqueName: \"kubernetes.io/projected/1e2dfb58-2bdf-4768-8662-a697a7a72f4b-kube-api-access-hb62x\") pod \"kserve-controller-manager-69fc866d76-nhbnh\" (UID: \"1e2dfb58-2bdf-4768-8662-a697a7a72f4b\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" Jun 13 02:09:01.736986 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.736709 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcx5b\" (UniqueName: \"kubernetes.io/projected/d193ca2a-e5e6-4e4e-8df0-c16a06f5c486-kube-api-access-bcx5b\") pod \"llmisvc-controller-manager-864bfd7bc9-bdxnj\" (UID: \"d193ca2a-e5e6-4e4e-8df0-c16a06f5c486\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" Jun 13 02:09:01.739187 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.739159 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e2dfb58-2bdf-4768-8662-a697a7a72f4b-cert\") pod \"kserve-controller-manager-69fc866d76-nhbnh\" (UID: \"1e2dfb58-2bdf-4768-8662-a697a7a72f4b\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" Jun 13 02:09:01.739322 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.739294 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d193ca2a-e5e6-4e4e-8df0-c16a06f5c486-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-bdxnj\" (UID: \"d193ca2a-e5e6-4e4e-8df0-c16a06f5c486\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" Jun 13 02:09:01.744745 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.744717 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb62x\" (UniqueName: \"kubernetes.io/projected/1e2dfb58-2bdf-4768-8662-a697a7a72f4b-kube-api-access-hb62x\") pod \"kserve-controller-manager-69fc866d76-nhbnh\" (UID: \"1e2dfb58-2bdf-4768-8662-a697a7a72f4b\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" Jun 13 02:09:01.745840 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.745815 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcx5b\" (UniqueName: \"kubernetes.io/projected/d193ca2a-e5e6-4e4e-8df0-c16a06f5c486-kube-api-access-bcx5b\") pod \"llmisvc-controller-manager-864bfd7bc9-bdxnj\" (UID: \"d193ca2a-e5e6-4e4e-8df0-c16a06f5c486\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" Jun 13 02:09:01.788592 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.788556 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" Jun 13 02:09:01.819723 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.819695 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" Jun 13 02:09:01.963245 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.963208 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-nhbnh"] Jun 13 02:09:01.964987 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:09:01.964943 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2dfb58_2bdf_4768_8662_a697a7a72f4b.slice/crio-be17028db7d0a93860fe17500c1a8caa1fb5fc990b1648b695b7d0319441a049 WatchSource:0}: Error finding container be17028db7d0a93860fe17500c1a8caa1fb5fc990b1648b695b7d0319441a049: Status 404 returned error can't find the container with id be17028db7d0a93860fe17500c1a8caa1fb5fc990b1648b695b7d0319441a049 Jun 13 02:09:01.982879 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:01.982853 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj"] Jun 13 02:09:01.984664 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:09:01.984638 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd193ca2a_e5e6_4e4e_8df0_c16a06f5c486.slice/crio-255faf5b350058b5616550d1fae10770e545bac9fd1fafeca3ee7c2fc69a94f7 WatchSource:0}: Error finding container 255faf5b350058b5616550d1fae10770e545bac9fd1fafeca3ee7c2fc69a94f7: Status 404 returned error can't find the container with id 255faf5b350058b5616550d1fae10770e545bac9fd1fafeca3ee7c2fc69a94f7 Jun 13 02:09:02.208552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.208516 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4"] Jun 13 02:09:02.213321 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.213299 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.215869 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.215849 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 13 02:09:02.215980 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.215854 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 02:09:02.216030 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.215998 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lng9b\"" Jun 13 02:09:02.225258 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.225231 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4"] Jun 13 02:09:02.252932 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.252897 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276"] Jun 13 02:09:02.256585 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.256564 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.259134 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.259102 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 02:09:02.259234 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.259159 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bcfzp\"" Jun 13 02:09:02.259234 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.259200 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 02:09:02.266841 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.266817 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276"] Jun 13 02:09:02.343862 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.343829 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e82d15e-c6cf-49c8-aef0-84d85b43f138-tls-certs\") pod \"kube-auth-proxy-5f59d458f8-chrb4\" (UID: \"4e82d15e-c6cf-49c8-aef0-84d85b43f138\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.344062 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.343876 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.344062 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.343912 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qplm\" (UniqueName: \"kubernetes.io/projected/25432300-8ed3-40cb-ad35-e1d28157ec4c-kube-api-access-5qplm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.344062 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.343996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e82d15e-c6cf-49c8-aef0-84d85b43f138-tmp\") pod \"kube-auth-proxy-5f59d458f8-chrb4\" (UID: \"4e82d15e-c6cf-49c8-aef0-84d85b43f138\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.344062 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.344021 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj7qw\" (UniqueName: \"kubernetes.io/projected/4e82d15e-c6cf-49c8-aef0-84d85b43f138-kube-api-access-vj7qw\") pod \"kube-auth-proxy-5f59d458f8-chrb4\" (UID: \"4e82d15e-c6cf-49c8-aef0-84d85b43f138\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.344062 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.344043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.445184 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.445152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj7qw\" (UniqueName: \"kubernetes.io/projected/4e82d15e-c6cf-49c8-aef0-84d85b43f138-kube-api-access-vj7qw\") pod \"kube-auth-proxy-5f59d458f8-chrb4\" (UID: \"4e82d15e-c6cf-49c8-aef0-84d85b43f138\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.445184 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.445195 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.445439 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.445279 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e82d15e-c6cf-49c8-aef0-84d85b43f138-tls-certs\") pod \"kube-auth-proxy-5f59d458f8-chrb4\" (UID: \"4e82d15e-c6cf-49c8-aef0-84d85b43f138\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.445439 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.445321 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.445439 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.445359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qplm\" (UniqueName: \"kubernetes.io/projected/25432300-8ed3-40cb-ad35-e1d28157ec4c-kube-api-access-5qplm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.445439 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.445398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e82d15e-c6cf-49c8-aef0-84d85b43f138-tmp\") pod \"kube-auth-proxy-5f59d458f8-chrb4\" (UID: \"4e82d15e-c6cf-49c8-aef0-84d85b43f138\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.445637 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:09:02.445544 2557 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 13 02:09:02.445637 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:09:02.445614 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e82d15e-c6cf-49c8-aef0-84d85b43f138-tls-certs podName:4e82d15e-c6cf-49c8-aef0-84d85b43f138 nodeName:}" failed. No retries permitted until 2026-06-13 02:09:02.945592159 +0000 UTC m=+504.424742413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4e82d15e-c6cf-49c8-aef0-84d85b43f138-tls-certs") pod "kube-auth-proxy-5f59d458f8-chrb4" (UID: "4e82d15e-c6cf-49c8-aef0-84d85b43f138") : secret "kube-auth-proxy-tls" not found Jun 13 02:09:02.445744 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.445674 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.445783 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.445751 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.447780 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.447759 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e82d15e-c6cf-49c8-aef0-84d85b43f138-tmp\") pod \"kube-auth-proxy-5f59d458f8-chrb4\" (UID: \"4e82d15e-c6cf-49c8-aef0-84d85b43f138\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.458968 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.458923 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj7qw\" (UniqueName: \"kubernetes.io/projected/4e82d15e-c6cf-49c8-aef0-84d85b43f138-kube-api-access-vj7qw\") pod \"kube-auth-proxy-5f59d458f8-chrb4\" (UID: \"4e82d15e-c6cf-49c8-aef0-84d85b43f138\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.460235 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.460212 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qplm\" (UniqueName: \"kubernetes.io/projected/25432300-8ed3-40cb-ad35-e1d28157ec4c-kube-api-access-5qplm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.566447 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.566376 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:02.711677 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.711648 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276"] Jun 13 02:09:02.818321 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:09:02.818245 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25432300_8ed3_40cb_ad35_e1d28157ec4c.slice/crio-95ee418a787a70c3a7b49e3f734a3c9bcbb813aee2e73f9763198be3a67b1b54 WatchSource:0}: Error finding container 95ee418a787a70c3a7b49e3f734a3c9bcbb813aee2e73f9763198be3a67b1b54: Status 404 returned error can't find the container with id 95ee418a787a70c3a7b49e3f734a3c9bcbb813aee2e73f9763198be3a67b1b54 Jun 13 02:09:02.949874 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.949841 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e82d15e-c6cf-49c8-aef0-84d85b43f138-tls-certs\") pod \"kube-auth-proxy-5f59d458f8-chrb4\" (UID: \"4e82d15e-c6cf-49c8-aef0-84d85b43f138\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.952448 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.952429 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e82d15e-c6cf-49c8-aef0-84d85b43f138-tls-certs\") pod \"kube-auth-proxy-5f59d458f8-chrb4\" (UID: \"4e82d15e-c6cf-49c8-aef0-84d85b43f138\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:02.972598 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.972563 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" event={"ID":"d193ca2a-e5e6-4e4e-8df0-c16a06f5c486","Type":"ContainerStarted","Data":"255faf5b350058b5616550d1fae10770e545bac9fd1fafeca3ee7c2fc69a94f7"} Jun 13 02:09:02.973799 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.973769 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" event={"ID":"1e2dfb58-2bdf-4768-8662-a697a7a72f4b","Type":"ContainerStarted","Data":"be17028db7d0a93860fe17500c1a8caa1fb5fc990b1648b695b7d0319441a049"} Jun 13 02:09:02.975171 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:02.975141 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" event={"ID":"25432300-8ed3-40cb-ad35-e1d28157ec4c","Type":"ContainerStarted","Data":"95ee418a787a70c3a7b49e3f734a3c9bcbb813aee2e73f9763198be3a67b1b54"} Jun 13 02:09:03.124174 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:03.124105 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" Jun 13 02:09:03.503751 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:03.503716 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4"] Jun 13 02:09:03.543200 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:09:03.543157 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e82d15e_c6cf_49c8_aef0_84d85b43f138.slice/crio-5605305c9fa13afab7ec302487471cea4aadda9461a9b0e215d2486cb6e0c0cc WatchSource:0}: Error finding container 5605305c9fa13afab7ec302487471cea4aadda9461a9b0e215d2486cb6e0c0cc: Status 404 returned error can't find the container with id 5605305c9fa13afab7ec302487471cea4aadda9461a9b0e215d2486cb6e0c0cc Jun 13 02:09:03.982412 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:03.982363 2557 generic.go:356] "Generic (PLEG): container finished" podID="25432300-8ed3-40cb-ad35-e1d28157ec4c" containerID="9c7ae258d10ff34a8cae2d7e4b099dc67019ee4c27d6a98ecd27d9651ace5ce3" exitCode=0 Jun 13 02:09:03.982886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:03.982453 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" event={"ID":"25432300-8ed3-40cb-ad35-e1d28157ec4c","Type":"ContainerDied","Data":"9c7ae258d10ff34a8cae2d7e4b099dc67019ee4c27d6a98ecd27d9651ace5ce3"} Jun 13 02:09:03.983883 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:03.983828 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" event={"ID":"4e82d15e-c6cf-49c8-aef0-84d85b43f138","Type":"ContainerStarted","Data":"5605305c9fa13afab7ec302487471cea4aadda9461a9b0e215d2486cb6e0c0cc"} Jun 13 02:09:07.004664 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.004628 2557 generic.go:356] "Generic (PLEG): container finished" podID="25432300-8ed3-40cb-ad35-e1d28157ec4c" containerID="590cdd5af0bd05ad47edcae185630237cd523a55307d78bb3e7ee3fc7c1cdd9a" exitCode=0 Jun 13 02:09:07.008142 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.008118 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" event={"ID":"25432300-8ed3-40cb-ad35-e1d28157ec4c","Type":"ContainerDied","Data":"590cdd5af0bd05ad47edcae185630237cd523a55307d78bb3e7ee3fc7c1cdd9a"} Jun 13 02:09:07.008262 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.008168 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" event={"ID":"4e82d15e-c6cf-49c8-aef0-84d85b43f138","Type":"ContainerStarted","Data":"16bf38c8b0a8cdebb1cc0b2e6ff0daf11b38b945226012d51614863cbd56abfe"} Jun 13 02:09:07.008262 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.008196 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" event={"ID":"d193ca2a-e5e6-4e4e-8df0-c16a06f5c486","Type":"ContainerStarted","Data":"8f7d1ac089e3a79367bde378693e1cd02eae867abf76836b8ff3fa3ea6dae5a5"} Jun 13 02:09:07.009469 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.009447 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" event={"ID":"1e2dfb58-2bdf-4768-8662-a697a7a72f4b","Type":"ContainerStarted","Data":"014246cbef4ffefd1c0c2565a557304543abc25e1f6440a82ad96cb71edf91e2"} Jun 13 02:09:07.009846 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.009830 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" Jun 13 02:09:07.009933 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.009866 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" Jun 13 02:09:07.038784 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.038732 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f59d458f8-chrb4" podStartSLOduration=1.9940303799999999 podStartE2EDuration="5.0387175s" totalImagesPullingTime="3.04468712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:07.037658853 +0000 UTC m=+508.516809141" watchObservedRunningTime="2026-06-13 02:09:07.0387175 +0000 UTC m=+508.517867751" Jun 13 02:09:07.053618 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.053560 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" podStartSLOduration=1.488421418 podStartE2EDuration="6.053542968s" totalImagesPullingTime="4.56512155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:07.053059338 +0000 UTC m=+508.532209610" watchObservedRunningTime="2026-06-13 02:09:07.053542968 +0000 UTC m=+508.532693239" Jun 13 02:09:07.071285 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.071233 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" podStartSLOduration=1.515029212 podStartE2EDuration="6.071212628s" totalImagesPullingTime="4.556183416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:07.068715642 +0000 UTC m=+508.547865925" watchObservedRunningTime="2026-06-13 02:09:07.071212628 +0000 UTC m=+508.550362920" Jun 13 02:09:07.943733 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.943656 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-thgkp" Jun 13 02:09:07.945627 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:07.945606 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-z52qc" Jun 13 02:09:08.017843 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:08.017812 2557 generic.go:356] "Generic (PLEG): container finished" podID="25432300-8ed3-40cb-ad35-e1d28157ec4c" containerID="7dbbeb00be4a0211e38459bf12e775863f8f051bebb73d643053121b0240edbe" exitCode=0 Jun 13 02:09:08.018260 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:08.017903 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" event={"ID":"25432300-8ed3-40cb-ad35-e1d28157ec4c","Type":"ContainerDied","Data":"7dbbeb00be4a0211e38459bf12e775863f8f051bebb73d643053121b0240edbe"} Jun 13 02:09:09.208189 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:09.208151 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:09.314652 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:09.314562 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-bundle\") pod \"25432300-8ed3-40cb-ad35-e1d28157ec4c\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " Jun 13 02:09:09.314652 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:09.314611 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qplm\" (UniqueName: \"kubernetes.io/projected/25432300-8ed3-40cb-ad35-e1d28157ec4c-kube-api-access-5qplm\") pod \"25432300-8ed3-40cb-ad35-e1d28157ec4c\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " Jun 13 02:09:09.314873 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:09.314662 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-util\") pod \"25432300-8ed3-40cb-ad35-e1d28157ec4c\" (UID: \"25432300-8ed3-40cb-ad35-e1d28157ec4c\") " Jun 13 02:09:09.315726 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:09.315691 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-bundle" (OuterVolumeSpecName: "bundle") pod "25432300-8ed3-40cb-ad35-e1d28157ec4c" (UID: "25432300-8ed3-40cb-ad35-e1d28157ec4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:09:09.316741 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:09.316717 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25432300-8ed3-40cb-ad35-e1d28157ec4c-kube-api-access-5qplm" (OuterVolumeSpecName: "kube-api-access-5qplm") pod "25432300-8ed3-40cb-ad35-e1d28157ec4c" (UID: "25432300-8ed3-40cb-ad35-e1d28157ec4c"). InnerVolumeSpecName "kube-api-access-5qplm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:09:09.319865 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:09.319843 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-util" (OuterVolumeSpecName: "util") pod "25432300-8ed3-40cb-ad35-e1d28157ec4c" (UID: "25432300-8ed3-40cb-ad35-e1d28157ec4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:09:09.415388 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:09.415361 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:09:09.415388 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:09.415385 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qplm\" (UniqueName: \"kubernetes.io/projected/25432300-8ed3-40cb-ad35-e1d28157ec4c-kube-api-access-5qplm\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:09:09.415388 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:09.415395 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25432300-8ed3-40cb-ad35-e1d28157ec4c-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:09:10.030502 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:10.030477 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" Jun 13 02:09:10.030667 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:10.030508 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0698276" event={"ID":"25432300-8ed3-40cb-ad35-e1d28157ec4c","Type":"ContainerDied","Data":"95ee418a787a70c3a7b49e3f734a3c9bcbb813aee2e73f9763198be3a67b1b54"} Jun 13 02:09:10.030667 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:10.030555 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95ee418a787a70c3a7b49e3f734a3c9bcbb813aee2e73f9763198be3a67b1b54" Jun 13 02:09:15.867783 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.867744 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w"] Jun 13 02:09:15.868406 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.868297 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25432300-8ed3-40cb-ad35-e1d28157ec4c" containerName="pull" Jun 13 02:09:15.868406 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.868318 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="25432300-8ed3-40cb-ad35-e1d28157ec4c" containerName="pull" Jun 13 02:09:15.868406 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.868348 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25432300-8ed3-40cb-ad35-e1d28157ec4c" containerName="extract" Jun 13 02:09:15.868406 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.868358 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="25432300-8ed3-40cb-ad35-e1d28157ec4c" containerName="extract" Jun 13 02:09:15.868406 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.868373 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25432300-8ed3-40cb-ad35-e1d28157ec4c" containerName="util" Jun 13 02:09:15.868406 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.868382 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="25432300-8ed3-40cb-ad35-e1d28157ec4c" containerName="util" Jun 13 02:09:15.868758 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.868485 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="25432300-8ed3-40cb-ad35-e1d28157ec4c" containerName="extract" Jun 13 02:09:15.873064 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.873044 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:15.875657 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.875635 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bcfzp\"" Jun 13 02:09:15.875769 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.875635 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 02:09:15.876684 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.876670 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 02:09:15.882284 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.882262 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w"] Jun 13 02:09:15.975653 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.975622 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhfl5\" (UniqueName: \"kubernetes.io/projected/3b783e7e-d279-4fcf-b061-49ee1a9baef9-kube-api-access-hhfl5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:15.975819 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.975675 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:15.975819 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:15.975764 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:16.077091 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:16.077058 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhfl5\" (UniqueName: \"kubernetes.io/projected/3b783e7e-d279-4fcf-b061-49ee1a9baef9-kube-api-access-hhfl5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:16.077265 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:16.077107 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:16.077265 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:16.077154 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:16.077502 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:16.077487 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:16.077539 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:16.077513 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:16.095279 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:16.095247 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhfl5\" (UniqueName: \"kubernetes.io/projected/3b783e7e-d279-4fcf-b061-49ee1a9baef9-kube-api-access-hhfl5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:16.183691 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:16.183615 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:16.336772 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:16.336746 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w"] Jun 13 02:09:16.338391 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:09:16.338365 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b783e7e_d279_4fcf_b061_49ee1a9baef9.slice/crio-2973277d6036050889076ecb36a835abe61d33b47f67162dce8dd1dd3c82cbeb WatchSource:0}: Error finding container 2973277d6036050889076ecb36a835abe61d33b47f67162dce8dd1dd3c82cbeb: Status 404 returned error can't find the container with id 2973277d6036050889076ecb36a835abe61d33b47f67162dce8dd1dd3c82cbeb Jun 13 02:09:17.068886 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.068848 2557 generic.go:356] "Generic (PLEG): container finished" podID="3b783e7e-d279-4fcf-b061-49ee1a9baef9" containerID="84cfc4923848416bc6959874b2657910719e6c34d55a83edf225e1b44b4b63ad" exitCode=0 Jun 13 02:09:17.069282 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.068933 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" event={"ID":"3b783e7e-d279-4fcf-b061-49ee1a9baef9","Type":"ContainerDied","Data":"84cfc4923848416bc6959874b2657910719e6c34d55a83edf225e1b44b4b63ad"} Jun 13 02:09:17.069282 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.069001 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" event={"ID":"3b783e7e-d279-4fcf-b061-49ee1a9baef9","Type":"ContainerStarted","Data":"2973277d6036050889076ecb36a835abe61d33b47f67162dce8dd1dd3c82cbeb"} Jun 13 02:09:17.285575 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.285536 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf"] Jun 13 02:09:17.289058 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.289039 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" Jun 13 02:09:17.292205 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.292180 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 13 02:09:17.292287 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.292193 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-cldjt\"" Jun 13 02:09:17.292558 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.292544 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 13 02:09:17.307869 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.307844 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf"] Jun 13 02:09:17.386525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.386445 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc4m8\" (UniqueName: \"kubernetes.io/projected/91420348-8678-4360-8181-89a0d27af17e-kube-api-access-zc4m8\") pod \"servicemesh-operator3-57f65f65fb-bbgkf\" (UID: \"91420348-8678-4360-8181-89a0d27af17e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" Jun 13 02:09:17.386525 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.386488 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/91420348-8678-4360-8181-89a0d27af17e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-bbgkf\" (UID: \"91420348-8678-4360-8181-89a0d27af17e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" Jun 13 02:09:17.487324 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.487288 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc4m8\" (UniqueName: \"kubernetes.io/projected/91420348-8678-4360-8181-89a0d27af17e-kube-api-access-zc4m8\") pod \"servicemesh-operator3-57f65f65fb-bbgkf\" (UID: \"91420348-8678-4360-8181-89a0d27af17e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" Jun 13 02:09:17.487484 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.487333 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/91420348-8678-4360-8181-89a0d27af17e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-bbgkf\" (UID: \"91420348-8678-4360-8181-89a0d27af17e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" Jun 13 02:09:17.490023 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.489991 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/91420348-8678-4360-8181-89a0d27af17e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-bbgkf\" (UID: \"91420348-8678-4360-8181-89a0d27af17e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" Jun 13 02:09:17.497218 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.497184 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc4m8\" (UniqueName: \"kubernetes.io/projected/91420348-8678-4360-8181-89a0d27af17e-kube-api-access-zc4m8\") pod \"servicemesh-operator3-57f65f65fb-bbgkf\" (UID: \"91420348-8678-4360-8181-89a0d27af17e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" Jun 13 02:09:17.598721 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.598676 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" Jun 13 02:09:17.598894 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.598796 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8459cf648c-mnrbv"] Jun 13 02:09:17.602592 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.602577 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" Jun 13 02:09:17.605059 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.605040 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 13 02:09:17.605148 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.605045 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7wqr8\"" Jun 13 02:09:17.608922 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.608900 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8459cf648c-mnrbv"] Jun 13 02:09:17.688742 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.688705 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ce33c4db-2921-4916-9fdf-e5d908f64325-redirect-config\") pod \"dashboard-redirect-8459cf648c-mnrbv\" (UID: \"ce33c4db-2921-4916-9fdf-e5d908f64325\") " pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" Jun 13 02:09:17.688879 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.688777 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9zmk\" (UniqueName: \"kubernetes.io/projected/ce33c4db-2921-4916-9fdf-e5d908f64325-kube-api-access-n9zmk\") pod \"dashboard-redirect-8459cf648c-mnrbv\" (UID: \"ce33c4db-2921-4916-9fdf-e5d908f64325\") " pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" Jun 13 02:09:17.742013 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.741989 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf"] Jun 13 02:09:17.743706 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:09:17.743673 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91420348_8678_4360_8181_89a0d27af17e.slice/crio-e055397c3efa14daa0135e2595896e278be1ac95212df4d84cbb44c0ffa42f64 WatchSource:0}: Error finding container e055397c3efa14daa0135e2595896e278be1ac95212df4d84cbb44c0ffa42f64: Status 404 returned error can't find the container with id e055397c3efa14daa0135e2595896e278be1ac95212df4d84cbb44c0ffa42f64 Jun 13 02:09:17.789802 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.789773 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ce33c4db-2921-4916-9fdf-e5d908f64325-redirect-config\") pod \"dashboard-redirect-8459cf648c-mnrbv\" (UID: \"ce33c4db-2921-4916-9fdf-e5d908f64325\") " pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" Jun 13 02:09:17.789926 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.789830 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9zmk\" (UniqueName: \"kubernetes.io/projected/ce33c4db-2921-4916-9fdf-e5d908f64325-kube-api-access-n9zmk\") pod \"dashboard-redirect-8459cf648c-mnrbv\" (UID: \"ce33c4db-2921-4916-9fdf-e5d908f64325\") " pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" Jun 13 02:09:17.790545 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.790521 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ce33c4db-2921-4916-9fdf-e5d908f64325-redirect-config\") pod \"dashboard-redirect-8459cf648c-mnrbv\" (UID: \"ce33c4db-2921-4916-9fdf-e5d908f64325\") " pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" Jun 13 02:09:17.799804 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.799781 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9zmk\" (UniqueName: \"kubernetes.io/projected/ce33c4db-2921-4916-9fdf-e5d908f64325-kube-api-access-n9zmk\") pod \"dashboard-redirect-8459cf648c-mnrbv\" (UID: \"ce33c4db-2921-4916-9fdf-e5d908f64325\") " pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" Jun 13 02:09:17.932366 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:17.932274 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" Jun 13 02:09:18.069706 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:18.069657 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8459cf648c-mnrbv"] Jun 13 02:09:18.078034 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:18.078004 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" event={"ID":"91420348-8678-4360-8181-89a0d27af17e","Type":"ContainerStarted","Data":"e055397c3efa14daa0135e2595896e278be1ac95212df4d84cbb44c0ffa42f64"} Jun 13 02:09:18.104270 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:09:18.104238 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce33c4db_2921_4916_9fdf_e5d908f64325.slice/crio-7ad4e34196c2760a7224bf01ffc021d86b6eb85deffe95698a8782b80308b772 WatchSource:0}: Error finding container 7ad4e34196c2760a7224bf01ffc021d86b6eb85deffe95698a8782b80308b772: Status 404 returned error can't find the container with id 7ad4e34196c2760a7224bf01ffc021d86b6eb85deffe95698a8782b80308b772 Jun 13 02:09:19.092432 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:19.090682 2557 generic.go:356] "Generic (PLEG): container finished" podID="3b783e7e-d279-4fcf-b061-49ee1a9baef9" containerID="eb274c304964ff1c72ba6f8a439c8cc204c61a9cbe21611a06fc694a8bdb1010" exitCode=0 Jun 13 02:09:19.092432 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:19.090784 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" event={"ID":"3b783e7e-d279-4fcf-b061-49ee1a9baef9","Type":"ContainerDied","Data":"eb274c304964ff1c72ba6f8a439c8cc204c61a9cbe21611a06fc694a8bdb1010"} Jun 13 02:09:19.095844 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:19.095785 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" event={"ID":"ce33c4db-2921-4916-9fdf-e5d908f64325","Type":"ContainerStarted","Data":"7ad4e34196c2760a7224bf01ffc021d86b6eb85deffe95698a8782b80308b772"} Jun 13 02:09:20.105213 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:20.105175 2557 generic.go:356] "Generic (PLEG): container finished" podID="3b783e7e-d279-4fcf-b061-49ee1a9baef9" containerID="51e4985f610fa78897e5bafa8a6d26c2dabcd79687095b30d6944cb8ed5ab95f" exitCode=0 Jun 13 02:09:20.105733 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:20.105245 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" event={"ID":"3b783e7e-d279-4fcf-b061-49ee1a9baef9","Type":"ContainerDied","Data":"51e4985f610fa78897e5bafa8a6d26c2dabcd79687095b30d6944cb8ed5ab95f"} Jun 13 02:09:21.299057 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:21.299031 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:21.323508 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:21.323482 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhfl5\" (UniqueName: \"kubernetes.io/projected/3b783e7e-d279-4fcf-b061-49ee1a9baef9-kube-api-access-hhfl5\") pod \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " Jun 13 02:09:21.323641 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:21.323525 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-bundle\") pod \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " Jun 13 02:09:21.323700 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:21.323655 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-util\") pod \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\" (UID: \"3b783e7e-d279-4fcf-b061-49ee1a9baef9\") " Jun 13 02:09:21.324663 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:21.324639 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-bundle" (OuterVolumeSpecName: "bundle") pod "3b783e7e-d279-4fcf-b061-49ee1a9baef9" (UID: "3b783e7e-d279-4fcf-b061-49ee1a9baef9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:09:21.325758 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:21.325726 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b783e7e-d279-4fcf-b061-49ee1a9baef9-kube-api-access-hhfl5" (OuterVolumeSpecName: "kube-api-access-hhfl5") pod "3b783e7e-d279-4fcf-b061-49ee1a9baef9" (UID: "3b783e7e-d279-4fcf-b061-49ee1a9baef9"). InnerVolumeSpecName "kube-api-access-hhfl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:09:21.330982 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:21.330929 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-util" (OuterVolumeSpecName: "util") pod "3b783e7e-d279-4fcf-b061-49ee1a9baef9" (UID: "3b783e7e-d279-4fcf-b061-49ee1a9baef9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:09:21.424944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:21.424897 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhfl5\" (UniqueName: \"kubernetes.io/projected/3b783e7e-d279-4fcf-b061-49ee1a9baef9-kube-api-access-hhfl5\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:09:21.424944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:21.424936 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:09:21.425199 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:21.425007 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b783e7e-d279-4fcf-b061-49ee1a9baef9-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:09:22.118217 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:22.118188 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" Jun 13 02:09:22.118418 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:22.118182 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adc64w" event={"ID":"3b783e7e-d279-4fcf-b061-49ee1a9baef9","Type":"ContainerDied","Data":"2973277d6036050889076ecb36a835abe61d33b47f67162dce8dd1dd3c82cbeb"} Jun 13 02:09:22.118418 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:22.118310 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2973277d6036050889076ecb36a835abe61d33b47f67162dce8dd1dd3c82cbeb" Jun 13 02:09:22.119789 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:22.119754 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" event={"ID":"ce33c4db-2921-4916-9fdf-e5d908f64325","Type":"ContainerStarted","Data":"e270e352680fed7ed1bd0591526402701d95ac6f34167b7cc1cd5e2fc7e74c16"} Jun 13 02:09:22.121612 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:22.121587 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" event={"ID":"91420348-8678-4360-8181-89a0d27af17e","Type":"ContainerStarted","Data":"283fb09ce73316cd3d60b6008fc36aa46d1997023724b0941ff17f6cbd1157a7"} Jun 13 02:09:22.121775 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:22.121761 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" Jun 13 02:09:22.137818 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:22.137775 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8459cf648c-mnrbv" podStartSLOduration=1.919832049 podStartE2EDuration="5.13776111s" totalImagesPullingTime="3.217929061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:22.135639799 +0000 UTC m=+523.614790062" watchObservedRunningTime="2026-06-13 02:09:22.13776111 +0000 UTC m=+523.616911382" Jun 13 02:09:22.160835 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:22.160784 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" podStartSLOduration=1.5756261139999999 podStartE2EDuration="5.16076852s" totalImagesPullingTime="3.585142406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:22.157875969 +0000 UTC m=+523.637026264" watchObservedRunningTime="2026-06-13 02:09:22.16076852 +0000 UTC m=+523.639918792" Jun 13 02:09:33.129998 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.129969 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bbgkf" Jun 13 02:09:33.695068 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.695026 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z"] Jun 13 02:09:33.695928 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.695901 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b783e7e-d279-4fcf-b061-49ee1a9baef9" containerName="extract" Jun 13 02:09:33.695928 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.695927 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b783e7e-d279-4fcf-b061-49ee1a9baef9" containerName="extract" Jun 13 02:09:33.696128 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.695972 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b783e7e-d279-4fcf-b061-49ee1a9baef9" containerName="util" Jun 13 02:09:33.696128 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.695983 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b783e7e-d279-4fcf-b061-49ee1a9baef9" containerName="util" Jun 13 02:09:33.696128 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.695999 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b783e7e-d279-4fcf-b061-49ee1a9baef9" containerName="pull" Jun 13 02:09:33.696128 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.696008 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b783e7e-d279-4fcf-b061-49ee1a9baef9" containerName="pull" Jun 13 02:09:33.696312 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.696184 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b783e7e-d279-4fcf-b061-49ee1a9baef9" containerName="extract" Jun 13 02:09:33.703569 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.703545 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.706269 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.706245 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 13 02:09:33.706380 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.706245 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 13 02:09:33.706380 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.706304 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-472t2\"" Jun 13 02:09:33.706380 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.706254 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 13 02:09:33.706521 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.706252 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 13 02:09:33.712090 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.712063 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z"] Jun 13 02:09:33.734745 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.734716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.734910 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.734753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.734910 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.734773 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.735057 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.734944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.735057 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.735019 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.735139 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.735074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.735139 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.735097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlc9s\" (UniqueName: \"kubernetes.io/projected/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-kube-api-access-rlc9s\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.836417 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.836381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.836417 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.836418 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.836625 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.836444 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.836625 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.836512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlc9s\" (UniqueName: \"kubernetes.io/projected/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-kube-api-access-rlc9s\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.836625 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.836579 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.836625 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.836612 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.836814 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.836637 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.837218 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.837187 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.839118 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.839095 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.839215 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.839156 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.839215 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.839164 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.839289 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.839276 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.847747 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.847725 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlc9s\" (UniqueName: \"kubernetes.io/projected/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-kube-api-access-rlc9s\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:33.850208 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:33.850188 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b1c4ff2-f29e-4f21-8824-ce84affc9aeb-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2kw6z\" (UID: \"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:34.020935 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:34.020899 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:34.166174 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:34.166147 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z"] Jun 13 02:09:34.167625 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:09:34.167603 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1c4ff2_f29e_4f21_8824_ce84affc9aeb.slice/crio-50ff7495c56472fa11d61b2813dae2b056e6cabd9dafcc7e044bce686fdd6645 WatchSource:0}: Error finding container 50ff7495c56472fa11d61b2813dae2b056e6cabd9dafcc7e044bce686fdd6645: Status 404 returned error can't find the container with id 50ff7495c56472fa11d61b2813dae2b056e6cabd9dafcc7e044bce686fdd6645 Jun 13 02:09:34.186078 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:34.186044 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" event={"ID":"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb","Type":"ContainerStarted","Data":"50ff7495c56472fa11d61b2813dae2b056e6cabd9dafcc7e044bce686fdd6645"} Jun 13 02:09:36.618014 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:36.617945 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 02:09:36.618287 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:36.618049 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 02:09:37.205551 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:37.205517 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" event={"ID":"4b1c4ff2-f29e-4f21-8824-ce84affc9aeb","Type":"ContainerStarted","Data":"f49cac43d02c63f3e68d557236487a7606773fc981d0ab0eae3e8ec3212a018e"} Jun 13 02:09:37.205730 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:37.205579 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:09:37.207329 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:37.207302 2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-2kw6z container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 13 02:09:37.207449 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:37.207348 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" podUID="4b1c4ff2-f29e-4f21-8824-ce84affc9aeb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:09:37.225399 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:37.225355 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" podStartSLOduration=1.777205676 podStartE2EDuration="4.225335848s" totalImagesPullingTime="2.448130172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:37.223463478 +0000 UTC m=+538.702613777" watchObservedRunningTime="2026-06-13 02:09:37.225335848 +0000 UTC m=+538.704486121" Jun 13 02:09:38.020775 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:38.020736 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-bdxnj" Jun 13 02:09:38.024055 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:38.024026 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-nhbnh" Jun 13 02:09:38.218146 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:38.217702 2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-2kw6z container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 13 02:09:38.218146 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:38.217757 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" podUID="4b1c4ff2-f29e-4f21-8824-ce84affc9aeb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:09:41.213930 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:09:41.213899 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2kw6z" Jun 13 02:10:08.010082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.010046 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45"] Jun 13 02:10:08.025516 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.025485 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45"] Jun 13 02:10:08.025680 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.025611 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.028332 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.028302 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 02:10:08.028459 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.028353 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-46q98\"" Jun 13 02:10:08.028459 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.028403 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 02:10:08.040748 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.040614 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt5hl\" (UniqueName: \"kubernetes.io/projected/a48b0002-bb4f-4094-8330-06bf6eb46006-kube-api-access-zt5hl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.040748 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.040708 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.040748 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.040735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.142047 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.142011 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.142047 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.142043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.142239 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.142104 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5hl\" (UniqueName: \"kubernetes.io/projected/a48b0002-bb4f-4094-8330-06bf6eb46006-kube-api-access-zt5hl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.142403 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.142382 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.142445 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.142404 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.156051 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.156024 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt5hl\" (UniqueName: \"kubernetes.io/projected/a48b0002-bb4f-4094-8330-06bf6eb46006-kube-api-access-zt5hl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.335297 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.335215 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:08.465987 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.465961 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45"] Jun 13 02:10:08.468196 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:10:08.468167 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48b0002_bb4f_4094_8330_06bf6eb46006.slice/crio-6bd6e750a31f0835a00955e3561445bfcd9254bc74b151b57df00c081354cb6b WatchSource:0}: Error finding container 6bd6e750a31f0835a00955e3561445bfcd9254bc74b151b57df00c081354cb6b: Status 404 returned error can't find the container with id 6bd6e750a31f0835a00955e3561445bfcd9254bc74b151b57df00c081354cb6b Jun 13 02:10:08.803979 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.803927 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz"] Jun 13 02:10:08.807662 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.807644 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:08.816736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.816709 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz"] Jun 13 02:10:08.849329 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.849296 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn6fx\" (UniqueName: \"kubernetes.io/projected/36947535-25be-4aa2-aaa4-3392ebea1fa8-kube-api-access-qn6fx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:08.849462 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.849333 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:08.849504 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.849466 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:08.950430 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.950398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:08.950622 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.950454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn6fx\" (UniqueName: \"kubernetes.io/projected/36947535-25be-4aa2-aaa4-3392ebea1fa8-kube-api-access-qn6fx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:08.950622 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.950477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:08.950862 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.950839 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:08.950862 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.950857 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:08.958555 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:08.958537 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn6fx\" (UniqueName: \"kubernetes.io/projected/36947535-25be-4aa2-aaa4-3392ebea1fa8-kube-api-access-qn6fx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:09.117373 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.117294 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:09.251234 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.251208 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz"] Jun 13 02:10:09.253188 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:10:09.253161 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36947535_25be_4aa2_aaa4_3392ebea1fa8.slice/crio-e639a88b61eb213c64bb261922f71b294d542201ba18c8708f2ad9f4ab4d8d35 WatchSource:0}: Error finding container e639a88b61eb213c64bb261922f71b294d542201ba18c8708f2ad9f4ab4d8d35: Status 404 returned error can't find the container with id e639a88b61eb213c64bb261922f71b294d542201ba18c8708f2ad9f4ab4d8d35 Jun 13 02:10:09.382575 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.382515 2557 generic.go:356] "Generic (PLEG): container finished" podID="a48b0002-bb4f-4094-8330-06bf6eb46006" containerID="b9817d4184da91ea8599b6a86287c77059ffe20a713ba92d0324bf15bd183fc8" exitCode=0 Jun 13 02:10:09.382575 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.382550 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" event={"ID":"a48b0002-bb4f-4094-8330-06bf6eb46006","Type":"ContainerDied","Data":"b9817d4184da91ea8599b6a86287c77059ffe20a713ba92d0324bf15bd183fc8"} Jun 13 02:10:09.382718 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.382599 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" event={"ID":"a48b0002-bb4f-4094-8330-06bf6eb46006","Type":"ContainerStarted","Data":"6bd6e750a31f0835a00955e3561445bfcd9254bc74b151b57df00c081354cb6b"} Jun 13 02:10:09.384266 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.384246 2557 generic.go:356] "Generic (PLEG): container finished" podID="36947535-25be-4aa2-aaa4-3392ebea1fa8" containerID="83ce15db9395d0b4040444a0301b0b9006c86a9c3e562f6bac68536240ccd6d6" exitCode=0 Jun 13 02:10:09.384359 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.384330 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" event={"ID":"36947535-25be-4aa2-aaa4-3392ebea1fa8","Type":"ContainerDied","Data":"83ce15db9395d0b4040444a0301b0b9006c86a9c3e562f6bac68536240ccd6d6"} Jun 13 02:10:09.384402 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.384370 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" event={"ID":"36947535-25be-4aa2-aaa4-3392ebea1fa8","Type":"ContainerStarted","Data":"e639a88b61eb213c64bb261922f71b294d542201ba18c8708f2ad9f4ab4d8d35"} Jun 13 02:10:09.406182 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.406160 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn"] Jun 13 02:10:09.409974 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.409944 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.416563 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.416529 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn"] Jun 13 02:10:09.454465 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.454434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjkqf\" (UniqueName: \"kubernetes.io/projected/b10e3989-a484-4159-9b0f-e361b7271bb9-kube-api-access-bjkqf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.454575 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.454474 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.454627 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.454614 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.555328 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.555291 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjkqf\" (UniqueName: \"kubernetes.io/projected/b10e3989-a484-4159-9b0f-e361b7271bb9-kube-api-access-bjkqf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.555502 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.555336 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.555502 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.555408 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.555727 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.555712 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.555765 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.555747 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.563137 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.563108 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjkqf\" (UniqueName: \"kubernetes.io/projected/b10e3989-a484-4159-9b0f-e361b7271bb9-kube-api-access-bjkqf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.734421 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.734337 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:09.807600 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.807568 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h"] Jun 13 02:10:09.811610 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.811590 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:09.819224 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.819141 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h"] Jun 13 02:10:09.859006 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.858959 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:09.859194 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.859012 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5wd6\" (UniqueName: \"kubernetes.io/projected/bcf2b72a-9afd-481f-8827-9db6146017cc-kube-api-access-k5wd6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:09.859194 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.859045 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:09.879348 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.879320 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn"] Jun 13 02:10:09.879732 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:10:09.879706 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10e3989_a484_4159_9b0f_e361b7271bb9.slice/crio-48775a1766cfb545fb7e00e929f1fcb641b791ace2a50607e80d5b1df9cf2588 WatchSource:0}: Error finding container 48775a1766cfb545fb7e00e929f1fcb641b791ace2a50607e80d5b1df9cf2588: Status 404 returned error can't find the container with id 48775a1766cfb545fb7e00e929f1fcb641b791ace2a50607e80d5b1df9cf2588 Jun 13 02:10:09.959749 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.959723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:09.959884 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.959758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5wd6\" (UniqueName: \"kubernetes.io/projected/bcf2b72a-9afd-481f-8827-9db6146017cc-kube-api-access-k5wd6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:09.959884 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.959784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:09.960232 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.960213 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:09.960313 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.960215 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:09.967318 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:09.967286 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5wd6\" (UniqueName: \"kubernetes.io/projected/bcf2b72a-9afd-481f-8827-9db6146017cc-kube-api-access-k5wd6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:10.123248 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:10.123217 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:10.349065 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:10.349036 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h"] Jun 13 02:10:10.362544 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:10:10.362508 2557 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48b0002_bb4f_4094_8330_06bf6eb46006.slice/crio-conmon-091bd2496fae768b26432fd08242838d11c6a74dddb44a3302ac6e9d3bd2232b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48b0002_bb4f_4094_8330_06bf6eb46006.slice/crio-091bd2496fae768b26432fd08242838d11c6a74dddb44a3302ac6e9d3bd2232b.scope\": RecentStats: unable to find data in memory cache]" Jun 13 02:10:10.366999 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:10:10.366974 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf2b72a_9afd_481f_8827_9db6146017cc.slice/crio-88c139a04ef8409f482b400a296028bde02bc81451349f624caaf8de37aa7247 WatchSource:0}: Error finding container 88c139a04ef8409f482b400a296028bde02bc81451349f624caaf8de37aa7247: Status 404 returned error can't find the container with id 88c139a04ef8409f482b400a296028bde02bc81451349f624caaf8de37aa7247 Jun 13 02:10:10.392017 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:10.391991 2557 generic.go:356] "Generic (PLEG): container finished" podID="b10e3989-a484-4159-9b0f-e361b7271bb9" containerID="2cf975af9145e92ad92307c34322e5b3c99020ce599865f4fbce297e19b58cae" exitCode=0 Jun 13 02:10:10.392156 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:10.392070 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" event={"ID":"b10e3989-a484-4159-9b0f-e361b7271bb9","Type":"ContainerDied","Data":"2cf975af9145e92ad92307c34322e5b3c99020ce599865f4fbce297e19b58cae"} Jun 13 02:10:10.392156 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:10.392112 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" event={"ID":"b10e3989-a484-4159-9b0f-e361b7271bb9","Type":"ContainerStarted","Data":"48775a1766cfb545fb7e00e929f1fcb641b791ace2a50607e80d5b1df9cf2588"} Jun 13 02:10:10.393840 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:10.393819 2557 generic.go:356] "Generic (PLEG): container finished" podID="36947535-25be-4aa2-aaa4-3392ebea1fa8" containerID="01aeb319e977cd8b170479e9c72c4edf0137d2ffc7be66a6321dca2da0e68932" exitCode=0 Jun 13 02:10:10.393936 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:10.393908 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" event={"ID":"36947535-25be-4aa2-aaa4-3392ebea1fa8","Type":"ContainerDied","Data":"01aeb319e977cd8b170479e9c72c4edf0137d2ffc7be66a6321dca2da0e68932"} Jun 13 02:10:10.395908 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:10.395888 2557 generic.go:356] "Generic (PLEG): container finished" podID="a48b0002-bb4f-4094-8330-06bf6eb46006" containerID="091bd2496fae768b26432fd08242838d11c6a74dddb44a3302ac6e9d3bd2232b" exitCode=0 Jun 13 02:10:10.396005 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:10.395978 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" event={"ID":"a48b0002-bb4f-4094-8330-06bf6eb46006","Type":"ContainerDied","Data":"091bd2496fae768b26432fd08242838d11c6a74dddb44a3302ac6e9d3bd2232b"} Jun 13 02:10:10.397230 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:10.397185 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" event={"ID":"bcf2b72a-9afd-481f-8827-9db6146017cc","Type":"ContainerStarted","Data":"88c139a04ef8409f482b400a296028bde02bc81451349f624caaf8de37aa7247"} Jun 13 02:10:11.404825 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:11.404724 2557 generic.go:356] "Generic (PLEG): container finished" podID="a48b0002-bb4f-4094-8330-06bf6eb46006" containerID="779cc674aa4c9dc867c19619f8ba934a4e82ccf310a5f9f3723e83af75addd65" exitCode=0 Jun 13 02:10:11.404825 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:11.404808 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" event={"ID":"a48b0002-bb4f-4094-8330-06bf6eb46006","Type":"ContainerDied","Data":"779cc674aa4c9dc867c19619f8ba934a4e82ccf310a5f9f3723e83af75addd65"} Jun 13 02:10:11.406215 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:11.406187 2557 generic.go:356] "Generic (PLEG): container finished" podID="bcf2b72a-9afd-481f-8827-9db6146017cc" containerID="746faaae6f2eedf55b9711780d505a8ee8d0f9354c89e15a30d75369311e1e9f" exitCode=0 Jun 13 02:10:11.406320 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:11.406273 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" event={"ID":"bcf2b72a-9afd-481f-8827-9db6146017cc","Type":"ContainerDied","Data":"746faaae6f2eedf55b9711780d505a8ee8d0f9354c89e15a30d75369311e1e9f"} Jun 13 02:10:11.408227 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:11.408204 2557 generic.go:356] "Generic (PLEG): container finished" podID="b10e3989-a484-4159-9b0f-e361b7271bb9" containerID="26f7792fa35bf2b4108afdc340696a53734ac87e1debd4c4aef8c3ca5c50b384" exitCode=0 Jun 13 02:10:11.408329 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:11.408283 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" event={"ID":"b10e3989-a484-4159-9b0f-e361b7271bb9","Type":"ContainerDied","Data":"26f7792fa35bf2b4108afdc340696a53734ac87e1debd4c4aef8c3ca5c50b384"} Jun 13 02:10:11.410565 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:11.410543 2557 generic.go:356] "Generic (PLEG): container finished" podID="36947535-25be-4aa2-aaa4-3392ebea1fa8" containerID="479229c9fe6433ca95b7f9d0fe0bedccd87f4c694b32a276946808063b75e4ee" exitCode=0 Jun 13 02:10:11.410655 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:11.410623 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" event={"ID":"36947535-25be-4aa2-aaa4-3392ebea1fa8","Type":"ContainerDied","Data":"479229c9fe6433ca95b7f9d0fe0bedccd87f4c694b32a276946808063b75e4ee"} Jun 13 02:10:12.419273 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.419243 2557 generic.go:356] "Generic (PLEG): container finished" podID="bcf2b72a-9afd-481f-8827-9db6146017cc" containerID="c9e557bb4d7dda54c86f1cd440c21d03a8291255ae50031dcefad59ba1167de6" exitCode=0 Jun 13 02:10:12.419701 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.419332 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" event={"ID":"bcf2b72a-9afd-481f-8827-9db6146017cc","Type":"ContainerDied","Data":"c9e557bb4d7dda54c86f1cd440c21d03a8291255ae50031dcefad59ba1167de6"} Jun 13 02:10:12.421506 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.421480 2557 generic.go:356] "Generic (PLEG): container finished" podID="b10e3989-a484-4159-9b0f-e361b7271bb9" containerID="6306550b74f7f4b2d1c54675843b8d77e19802d7ada5794ab288379404a8062a" exitCode=0 Jun 13 02:10:12.421620 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.421560 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" event={"ID":"b10e3989-a484-4159-9b0f-e361b7271bb9","Type":"ContainerDied","Data":"6306550b74f7f4b2d1c54675843b8d77e19802d7ada5794ab288379404a8062a"} Jun 13 02:10:12.583533 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.583502 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:12.588196 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.588179 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:12.683291 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.683217 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-util\") pod \"a48b0002-bb4f-4094-8330-06bf6eb46006\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " Jun 13 02:10:12.683291 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.683244 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-util\") pod \"36947535-25be-4aa2-aaa4-3392ebea1fa8\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " Jun 13 02:10:12.683291 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.683278 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt5hl\" (UniqueName: \"kubernetes.io/projected/a48b0002-bb4f-4094-8330-06bf6eb46006-kube-api-access-zt5hl\") pod \"a48b0002-bb4f-4094-8330-06bf6eb46006\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " Jun 13 02:10:12.683552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.683307 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-bundle\") pod \"a48b0002-bb4f-4094-8330-06bf6eb46006\" (UID: \"a48b0002-bb4f-4094-8330-06bf6eb46006\") " Jun 13 02:10:12.683552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.683325 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn6fx\" (UniqueName: \"kubernetes.io/projected/36947535-25be-4aa2-aaa4-3392ebea1fa8-kube-api-access-qn6fx\") pod \"36947535-25be-4aa2-aaa4-3392ebea1fa8\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " Jun 13 02:10:12.683552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.683381 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-bundle\") pod \"36947535-25be-4aa2-aaa4-3392ebea1fa8\" (UID: \"36947535-25be-4aa2-aaa4-3392ebea1fa8\") " Jun 13 02:10:12.683836 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.683808 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-bundle" (OuterVolumeSpecName: "bundle") pod "a48b0002-bb4f-4094-8330-06bf6eb46006" (UID: "a48b0002-bb4f-4094-8330-06bf6eb46006"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:10:12.684088 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.684057 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-bundle" (OuterVolumeSpecName: "bundle") pod "36947535-25be-4aa2-aaa4-3392ebea1fa8" (UID: "36947535-25be-4aa2-aaa4-3392ebea1fa8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:10:12.685644 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.685619 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a48b0002-bb4f-4094-8330-06bf6eb46006-kube-api-access-zt5hl" (OuterVolumeSpecName: "kube-api-access-zt5hl") pod "a48b0002-bb4f-4094-8330-06bf6eb46006" (UID: "a48b0002-bb4f-4094-8330-06bf6eb46006"). InnerVolumeSpecName "kube-api-access-zt5hl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:10:12.685765 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.685750 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36947535-25be-4aa2-aaa4-3392ebea1fa8-kube-api-access-qn6fx" (OuterVolumeSpecName: "kube-api-access-qn6fx") pod "36947535-25be-4aa2-aaa4-3392ebea1fa8" (UID: "36947535-25be-4aa2-aaa4-3392ebea1fa8"). InnerVolumeSpecName "kube-api-access-qn6fx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:10:12.688363 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.688342 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-util" (OuterVolumeSpecName: "util") pod "a48b0002-bb4f-4094-8330-06bf6eb46006" (UID: "a48b0002-bb4f-4094-8330-06bf6eb46006"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:10:12.689554 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.689534 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-util" (OuterVolumeSpecName: "util") pod "36947535-25be-4aa2-aaa4-3392ebea1fa8" (UID: "36947535-25be-4aa2-aaa4-3392ebea1fa8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:10:12.784932 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.784899 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:12.784932 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.784929 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:12.784932 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.784938 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36947535-25be-4aa2-aaa4-3392ebea1fa8-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:12.785173 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.784962 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt5hl\" (UniqueName: \"kubernetes.io/projected/a48b0002-bb4f-4094-8330-06bf6eb46006-kube-api-access-zt5hl\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:12.785173 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.784973 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a48b0002-bb4f-4094-8330-06bf6eb46006-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:12.785173 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:12.784981 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn6fx\" (UniqueName: \"kubernetes.io/projected/36947535-25be-4aa2-aaa4-3392ebea1fa8-kube-api-access-qn6fx\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:13.429075 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.428991 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" Jun 13 02:10:13.429075 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.429004 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz" event={"ID":"36947535-25be-4aa2-aaa4-3392ebea1fa8","Type":"ContainerDied","Data":"e639a88b61eb213c64bb261922f71b294d542201ba18c8708f2ad9f4ab4d8d35"} Jun 13 02:10:13.429075 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.429053 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e639a88b61eb213c64bb261922f71b294d542201ba18c8708f2ad9f4ab4d8d35" Jun 13 02:10:13.431314 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.431288 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" event={"ID":"a48b0002-bb4f-4094-8330-06bf6eb46006","Type":"ContainerDied","Data":"6bd6e750a31f0835a00955e3561445bfcd9254bc74b151b57df00c081354cb6b"} Jun 13 02:10:13.431314 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.431305 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45" Jun 13 02:10:13.431494 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.431328 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bd6e750a31f0835a00955e3561445bfcd9254bc74b151b57df00c081354cb6b" Jun 13 02:10:13.433518 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.433494 2557 generic.go:356] "Generic (PLEG): container finished" podID="bcf2b72a-9afd-481f-8827-9db6146017cc" containerID="66ed78469a6375568a973ee841abdbe89dcac3e05a6b5d76f0ed99f26d2df2c7" exitCode=0 Jun 13 02:10:13.433617 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.433563 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" event={"ID":"bcf2b72a-9afd-481f-8827-9db6146017cc","Type":"ContainerDied","Data":"66ed78469a6375568a973ee841abdbe89dcac3e05a6b5d76f0ed99f26d2df2c7"} Jun 13 02:10:13.596019 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.595993 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:13.692454 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.692377 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-bundle\") pod \"b10e3989-a484-4159-9b0f-e361b7271bb9\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " Jun 13 02:10:13.692454 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.692416 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjkqf\" (UniqueName: \"kubernetes.io/projected/b10e3989-a484-4159-9b0f-e361b7271bb9-kube-api-access-bjkqf\") pod \"b10e3989-a484-4159-9b0f-e361b7271bb9\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " Jun 13 02:10:13.692623 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.692463 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-util\") pod \"b10e3989-a484-4159-9b0f-e361b7271bb9\" (UID: \"b10e3989-a484-4159-9b0f-e361b7271bb9\") " Jun 13 02:10:13.692853 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.692829 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-bundle" (OuterVolumeSpecName: "bundle") pod "b10e3989-a484-4159-9b0f-e361b7271bb9" (UID: "b10e3989-a484-4159-9b0f-e361b7271bb9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:10:13.694544 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.694514 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b10e3989-a484-4159-9b0f-e361b7271bb9-kube-api-access-bjkqf" (OuterVolumeSpecName: "kube-api-access-bjkqf") pod "b10e3989-a484-4159-9b0f-e361b7271bb9" (UID: "b10e3989-a484-4159-9b0f-e361b7271bb9"). InnerVolumeSpecName "kube-api-access-bjkqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:10:13.697907 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.697876 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-util" (OuterVolumeSpecName: "util") pod "b10e3989-a484-4159-9b0f-e361b7271bb9" (UID: "b10e3989-a484-4159-9b0f-e361b7271bb9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:10:13.793614 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.793583 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:13.793614 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.793608 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjkqf\" (UniqueName: \"kubernetes.io/projected/b10e3989-a484-4159-9b0f-e361b7271bb9-kube-api-access-bjkqf\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:13.793614 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:13.793619 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b10e3989-a484-4159-9b0f-e361b7271bb9-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:14.441110 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.441076 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" event={"ID":"b10e3989-a484-4159-9b0f-e361b7271bb9","Type":"ContainerDied","Data":"48775a1766cfb545fb7e00e929f1fcb641b791ace2a50607e80d5b1df9cf2588"} Jun 13 02:10:14.441110 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.441106 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn" Jun 13 02:10:14.441537 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.441129 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48775a1766cfb545fb7e00e929f1fcb641b791ace2a50607e80d5b1df9cf2588" Jun 13 02:10:14.580651 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.580624 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:14.600034 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.600006 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-util\") pod \"bcf2b72a-9afd-481f-8827-9db6146017cc\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " Jun 13 02:10:14.600175 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.600062 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-bundle\") pod \"bcf2b72a-9afd-481f-8827-9db6146017cc\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " Jun 13 02:10:14.600175 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.600144 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5wd6\" (UniqueName: \"kubernetes.io/projected/bcf2b72a-9afd-481f-8827-9db6146017cc-kube-api-access-k5wd6\") pod \"bcf2b72a-9afd-481f-8827-9db6146017cc\" (UID: \"bcf2b72a-9afd-481f-8827-9db6146017cc\") " Jun 13 02:10:14.600772 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.600730 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-bundle" (OuterVolumeSpecName: "bundle") pod "bcf2b72a-9afd-481f-8827-9db6146017cc" (UID: "bcf2b72a-9afd-481f-8827-9db6146017cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:10:14.602557 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.602529 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcf2b72a-9afd-481f-8827-9db6146017cc-kube-api-access-k5wd6" (OuterVolumeSpecName: "kube-api-access-k5wd6") pod "bcf2b72a-9afd-481f-8827-9db6146017cc" (UID: "bcf2b72a-9afd-481f-8827-9db6146017cc"). InnerVolumeSpecName "kube-api-access-k5wd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:10:14.606703 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.606648 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-util" (OuterVolumeSpecName: "util") pod "bcf2b72a-9afd-481f-8827-9db6146017cc" (UID: "bcf2b72a-9afd-481f-8827-9db6146017cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:10:14.701294 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.701219 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:14.701294 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.701242 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcf2b72a-9afd-481f-8827-9db6146017cc-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:14.701294 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:14.701252 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5wd6\" (UniqueName: \"kubernetes.io/projected/bcf2b72a-9afd-481f-8827-9db6146017cc-kube-api-access-k5wd6\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:10:15.449467 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:15.449381 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" event={"ID":"bcf2b72a-9afd-481f-8827-9db6146017cc","Type":"ContainerDied","Data":"88c139a04ef8409f482b400a296028bde02bc81451349f624caaf8de37aa7247"} Jun 13 02:10:15.449467 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:15.449408 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h" Jun 13 02:10:15.449467 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:15.449437 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88c139a04ef8409f482b400a296028bde02bc81451349f624caaf8de37aa7247" Jun 13 02:10:36.037926 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.037887 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97"] Jun 13 02:10:36.038494 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038450 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b10e3989-a484-4159-9b0f-e361b7271bb9" containerName="extract" Jun 13 02:10:36.038494 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038471 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b10e3989-a484-4159-9b0f-e361b7271bb9" containerName="extract" Jun 13 02:10:36.038494 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038489 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b10e3989-a484-4159-9b0f-e361b7271bb9" containerName="util" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038497 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b10e3989-a484-4159-9b0f-e361b7271bb9" containerName="util" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038507 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a48b0002-bb4f-4094-8330-06bf6eb46006" containerName="extract" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038516 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a48b0002-bb4f-4094-8330-06bf6eb46006" containerName="extract" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038527 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36947535-25be-4aa2-aaa4-3392ebea1fa8" containerName="util" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038535 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="36947535-25be-4aa2-aaa4-3392ebea1fa8" containerName="util" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038546 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36947535-25be-4aa2-aaa4-3392ebea1fa8" containerName="extract" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038555 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="36947535-25be-4aa2-aaa4-3392ebea1fa8" containerName="extract" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038569 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf2b72a-9afd-481f-8827-9db6146017cc" containerName="pull" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038578 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf2b72a-9afd-481f-8827-9db6146017cc" containerName="pull" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038595 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a48b0002-bb4f-4094-8330-06bf6eb46006" containerName="pull" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038603 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a48b0002-bb4f-4094-8330-06bf6eb46006" containerName="pull" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038613 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36947535-25be-4aa2-aaa4-3392ebea1fa8" containerName="pull" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038620 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="36947535-25be-4aa2-aaa4-3392ebea1fa8" containerName="pull" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038640 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a48b0002-bb4f-4094-8330-06bf6eb46006" containerName="util" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038648 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a48b0002-bb4f-4094-8330-06bf6eb46006" containerName="util" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038662 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf2b72a-9afd-481f-8827-9db6146017cc" containerName="util" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038669 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf2b72a-9afd-481f-8827-9db6146017cc" containerName="util" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038678 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b10e3989-a484-4159-9b0f-e361b7271bb9" containerName="pull" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038686 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b10e3989-a484-4159-9b0f-e361b7271bb9" containerName="pull" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038713 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf2b72a-9afd-481f-8827-9db6146017cc" containerName="extract" Jun 13 02:10:36.038732 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038721 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf2b72a-9afd-481f-8827-9db6146017cc" containerName="extract" Jun 13 02:10:36.039721 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038816 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a48b0002-bb4f-4094-8330-06bf6eb46006" containerName="extract" Jun 13 02:10:36.039721 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038830 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcf2b72a-9afd-481f-8827-9db6146017cc" containerName="extract" Jun 13 02:10:36.039721 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038845 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b10e3989-a484-4159-9b0f-e361b7271bb9" containerName="extract" Jun 13 02:10:36.039721 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.038854 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="36947535-25be-4aa2-aaa4-3392ebea1fa8" containerName="extract" Jun 13 02:10:36.042336 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.042316 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97" Jun 13 02:10:36.046369 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.046349 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 02:10:36.046469 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.046369 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 02:10:36.047368 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.047353 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 13 02:10:36.047432 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.047396 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cdcsf\"" Jun 13 02:10:36.056973 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.056937 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97"] Jun 13 02:10:36.190029 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.189998 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9mhn\" (UniqueName: \"kubernetes.io/projected/5a0bfee9-2034-4130-a7ea-258576e37581-kube-api-access-f9mhn\") pod \"dns-operator-controller-manager-864dd78c4c-p8j97\" (UID: \"5a0bfee9-2034-4130-a7ea-258576e37581\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97" Jun 13 02:10:36.290753 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.290664 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9mhn\" (UniqueName: \"kubernetes.io/projected/5a0bfee9-2034-4130-a7ea-258576e37581-kube-api-access-f9mhn\") pod \"dns-operator-controller-manager-864dd78c4c-p8j97\" (UID: \"5a0bfee9-2034-4130-a7ea-258576e37581\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97" Jun 13 02:10:36.298870 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.298842 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9mhn\" (UniqueName: \"kubernetes.io/projected/5a0bfee9-2034-4130-a7ea-258576e37581-kube-api-access-f9mhn\") pod \"dns-operator-controller-manager-864dd78c4c-p8j97\" (UID: \"5a0bfee9-2034-4130-a7ea-258576e37581\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97" Jun 13 02:10:36.352102 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.352069 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97" Jun 13 02:10:36.500990 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.500932 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97"] Jun 13 02:10:36.501347 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:10:36.501313 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0bfee9_2034_4130_a7ea_258576e37581.slice/crio-4fcaeeaf7c8bf5f03403dd1f214bfc516dd6ae90677fb8638ce53bedee06433d WatchSource:0}: Error finding container 4fcaeeaf7c8bf5f03403dd1f214bfc516dd6ae90677fb8638ce53bedee06433d: Status 404 returned error can't find the container with id 4fcaeeaf7c8bf5f03403dd1f214bfc516dd6ae90677fb8638ce53bedee06433d Jun 13 02:10:36.570761 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:36.570669 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97" event={"ID":"5a0bfee9-2034-4130-a7ea-258576e37581","Type":"ContainerStarted","Data":"4fcaeeaf7c8bf5f03403dd1f214bfc516dd6ae90677fb8638ce53bedee06433d"} Jun 13 02:10:38.585241 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:38.585139 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97" event={"ID":"5a0bfee9-2034-4130-a7ea-258576e37581","Type":"ContainerStarted","Data":"14e6b8b89845ac7077ea56434d6f41e2abcb013ceb462d277a005f52fceb4415"} Jun 13 02:10:38.585241 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:38.585200 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97" Jun 13 02:10:38.602920 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:38.602858 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97" podStartSLOduration=0.795218437 podStartE2EDuration="2.602837881s" totalImagesPullingTime="1.807619444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:10:38.599922721 +0000 UTC m=+600.079072994" watchObservedRunningTime="2026-06-13 02:10:38.602837881 +0000 UTC m=+600.081988155" Jun 13 02:10:43.146896 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.146858 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c6b5b6cf8-n5p9z"] Jun 13 02:10:43.150608 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.150590 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.160119 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.160089 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6b5b6cf8-n5p9z"] Jun 13 02:10:43.251744 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.251705 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f544682-4461-43bb-a659-f3b4446f0582-console-oauth-config\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.251744 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.251749 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-console-config\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.251984 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.251768 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-oauth-serving-cert\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.251984 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.251819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f544682-4461-43bb-a659-f3b4446f0582-console-serving-cert\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.251984 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.251842 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-service-ca\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.251984 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.251882 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-trusted-ca-bundle\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.251984 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.251897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf4xj\" (UniqueName: \"kubernetes.io/projected/7f544682-4461-43bb-a659-f3b4446f0582-kube-api-access-hf4xj\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.352575 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.352534 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-trusted-ca-bundle\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.352575 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.352573 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf4xj\" (UniqueName: \"kubernetes.io/projected/7f544682-4461-43bb-a659-f3b4446f0582-kube-api-access-hf4xj\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.352830 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.352641 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f544682-4461-43bb-a659-f3b4446f0582-console-oauth-config\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.352830 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.352669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-console-config\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.352830 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.352684 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-oauth-serving-cert\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.352830 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.352704 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f544682-4461-43bb-a659-f3b4446f0582-console-serving-cert\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.352830 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.352760 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-service-ca\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.353476 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.353449 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-trusted-ca-bundle\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.353600 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.353486 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-oauth-serving-cert\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.353600 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.353495 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-service-ca\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.353674 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.353614 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f544682-4461-43bb-a659-f3b4446f0582-console-config\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.355198 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.355167 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f544682-4461-43bb-a659-f3b4446f0582-console-oauth-config\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.355356 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.355338 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f544682-4461-43bb-a659-f3b4446f0582-console-serving-cert\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.360149 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.360130 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf4xj\" (UniqueName: \"kubernetes.io/projected/7f544682-4461-43bb-a659-f3b4446f0582-kube-api-access-hf4xj\") pod \"console-6c6b5b6cf8-n5p9z\" (UID: \"7f544682-4461-43bb-a659-f3b4446f0582\") " pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.461160 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.461058 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:43.598280 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:10:43.598240 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f544682_4461_43bb_a659_f3b4446f0582.slice/crio-9aa83514619c84cb6691d949d631854eee012bfb2b274589a3e9fdf4b64a2cbb WatchSource:0}: Error finding container 9aa83514619c84cb6691d949d631854eee012bfb2b274589a3e9fdf4b64a2cbb: Status 404 returned error can't find the container with id 9aa83514619c84cb6691d949d631854eee012bfb2b274589a3e9fdf4b64a2cbb Jun 13 02:10:43.599508 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.599481 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6b5b6cf8-n5p9z"] Jun 13 02:10:43.621074 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:43.621046 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6b5b6cf8-n5p9z" event={"ID":"7f544682-4461-43bb-a659-f3b4446f0582","Type":"ContainerStarted","Data":"9aa83514619c84cb6691d949d631854eee012bfb2b274589a3e9fdf4b64a2cbb"} Jun 13 02:10:44.630719 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:44.630669 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6b5b6cf8-n5p9z" event={"ID":"7f544682-4461-43bb-a659-f3b4446f0582","Type":"ContainerStarted","Data":"61b19c1e03aa260ada119cb2934465a6847c97af8782c75b1d24e6678d95f569"} Jun 13 02:10:44.649811 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:44.649759 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c6b5b6cf8-n5p9z" podStartSLOduration=1.649743944 podStartE2EDuration="1.649743944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:10:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:10:44.647343513 +0000 UTC m=+606.126493808" watchObservedRunningTime="2026-06-13 02:10:44.649743944 +0000 UTC m=+606.128894216" Jun 13 02:10:49.599326 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:49.599254 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p8j97" Jun 13 02:10:52.008432 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.008401 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt"] Jun 13 02:10:52.011908 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.011888 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:10:52.014543 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.014523 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pck82\"" Jun 13 02:10:52.027022 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.026990 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt"] Jun 13 02:10:52.038550 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.038526 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26601883-faa5-4e22-9859-d34e73dbe0c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pxvpt\" (UID: \"26601883-faa5-4e22-9859-d34e73dbe0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:10:52.038662 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.038558 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqfsn\" (UniqueName: \"kubernetes.io/projected/26601883-faa5-4e22-9859-d34e73dbe0c1-kube-api-access-fqfsn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pxvpt\" (UID: \"26601883-faa5-4e22-9859-d34e73dbe0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:10:52.139469 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.139385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26601883-faa5-4e22-9859-d34e73dbe0c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pxvpt\" (UID: \"26601883-faa5-4e22-9859-d34e73dbe0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:10:52.139640 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.139486 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqfsn\" (UniqueName: \"kubernetes.io/projected/26601883-faa5-4e22-9859-d34e73dbe0c1-kube-api-access-fqfsn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pxvpt\" (UID: \"26601883-faa5-4e22-9859-d34e73dbe0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:10:52.139807 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.139787 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26601883-faa5-4e22-9859-d34e73dbe0c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pxvpt\" (UID: \"26601883-faa5-4e22-9859-d34e73dbe0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:10:52.147317 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.147289 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqfsn\" (UniqueName: \"kubernetes.io/projected/26601883-faa5-4e22-9859-d34e73dbe0c1-kube-api-access-fqfsn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pxvpt\" (UID: \"26601883-faa5-4e22-9859-d34e73dbe0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:10:52.323084 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.322984 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:10:52.458907 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.458879 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt"] Jun 13 02:10:52.460642 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:10:52.460609 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26601883_faa5_4e22_9859_d34e73dbe0c1.slice/crio-34dc7f4ee7400149af7ceb5e69e755149a40813548b815d9d1852f139b6ff19c WatchSource:0}: Error finding container 34dc7f4ee7400149af7ceb5e69e755149a40813548b815d9d1852f139b6ff19c: Status 404 returned error can't find the container with id 34dc7f4ee7400149af7ceb5e69e755149a40813548b815d9d1852f139b6ff19c Jun 13 02:10:52.463074 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.463057 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:10:52.680657 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.680568 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" event={"ID":"26601883-faa5-4e22-9859-d34e73dbe0c1","Type":"ContainerStarted","Data":"34dc7f4ee7400149af7ceb5e69e755149a40813548b815d9d1852f139b6ff19c"} Jun 13 02:10:52.684453 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.684424 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt"] Jun 13 02:10:52.692756 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.692726 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt"] Jun 13 02:10:52.704276 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.704249 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5"] Jun 13 02:10:52.709428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.709403 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:10:52.723778 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.723752 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5"] Jun 13 02:10:52.743750 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.743723 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ffbt\" (UniqueName: \"kubernetes.io/projected/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-kube-api-access-8ffbt\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rvjg5\" (UID: \"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:10:52.743894 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.743767 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rvjg5\" (UID: \"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:10:52.844390 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.844360 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ffbt\" (UniqueName: \"kubernetes.io/projected/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-kube-api-access-8ffbt\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rvjg5\" (UID: \"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:10:52.844540 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.844414 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rvjg5\" (UID: \"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:10:52.844784 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.844765 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rvjg5\" (UID: \"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:10:52.853629 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:52.853607 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ffbt\" (UniqueName: \"kubernetes.io/projected/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-kube-api-access-8ffbt\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rvjg5\" (UID: \"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:10:53.021130 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:53.021091 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:10:53.188349 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:53.188318 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5"] Jun 13 02:10:53.424560 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:10:53.424485 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e9dbbc_b9ff_411e_8fc4_396df3e2c51d.slice/crio-bf2789bbea83c1513015c2f3b869794230c8cbd1ecbaa820222361276f37913b WatchSource:0}: Error finding container bf2789bbea83c1513015c2f3b869794230c8cbd1ecbaa820222361276f37913b: Status 404 returned error can't find the container with id bf2789bbea83c1513015c2f3b869794230c8cbd1ecbaa820222361276f37913b Jun 13 02:10:53.461353 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:53.461326 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:53.461629 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:53.461611 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:53.466206 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:53.466185 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:53.687580 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:53.687508 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" event={"ID":"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d","Type":"ContainerStarted","Data":"bf2789bbea83c1513015c2f3b869794230c8cbd1ecbaa820222361276f37913b"} Jun 13 02:10:53.691552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:53.691528 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c6b5b6cf8-n5p9z" Jun 13 02:10:53.743572 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:53.743536 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7754b57d-vzkl6"] Jun 13 02:10:59.733945 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:59.733902 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" event={"ID":"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d","Type":"ContainerStarted","Data":"c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2"} Jun 13 02:10:59.734350 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:59.734086 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:10:59.735694 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:59.735668 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" podUID="26601883-faa5-4e22-9859-d34e73dbe0c1" containerName="manager" containerID="cri-o://a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290" gracePeriod=2 Jun 13 02:10:59.752698 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:10:59.752663 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pxvpt\" is forbidden: User \"system:node:ip-10-0-141-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-22.ec2.internal' and this object" podUID="26601883-faa5-4e22-9859-d34e73dbe0c1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:10:59.752792 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:59.752760 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" podStartSLOduration=2.132575964 podStartE2EDuration="7.752746868s" totalImagesPullingTime="5.620170904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:10:59.750716391 +0000 UTC m=+621.229866666" watchObservedRunningTime="2026-06-13 02:10:59.752746868 +0000 UTC m=+621.231897138" Jun 13 02:10:59.984528 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:10:59.984464 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:10:59.986922 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:10:59.986894 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pxvpt\" is forbidden: User \"system:node:ip-10-0-141-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-22.ec2.internal' and this object" podUID="26601883-faa5-4e22-9859-d34e73dbe0c1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:11:00.007444 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.007418 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26601883-faa5-4e22-9859-d34e73dbe0c1-extensions-socket-volume\") pod \"26601883-faa5-4e22-9859-d34e73dbe0c1\" (UID: \"26601883-faa5-4e22-9859-d34e73dbe0c1\") " Jun 13 02:11:00.007574 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.007510 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqfsn\" (UniqueName: \"kubernetes.io/projected/26601883-faa5-4e22-9859-d34e73dbe0c1-kube-api-access-fqfsn\") pod \"26601883-faa5-4e22-9859-d34e73dbe0c1\" (UID: \"26601883-faa5-4e22-9859-d34e73dbe0c1\") " Jun 13 02:11:00.007737 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.007715 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26601883-faa5-4e22-9859-d34e73dbe0c1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "26601883-faa5-4e22-9859-d34e73dbe0c1" (UID: "26601883-faa5-4e22-9859-d34e73dbe0c1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:11:00.009489 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.009465 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26601883-faa5-4e22-9859-d34e73dbe0c1-kube-api-access-fqfsn" (OuterVolumeSpecName: "kube-api-access-fqfsn") pod "26601883-faa5-4e22-9859-d34e73dbe0c1" (UID: "26601883-faa5-4e22-9859-d34e73dbe0c1"). InnerVolumeSpecName "kube-api-access-fqfsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:11:00.109007 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.108942 2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26601883-faa5-4e22-9859-d34e73dbe0c1-extensions-socket-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:00.109007 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.109002 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqfsn\" (UniqueName: \"kubernetes.io/projected/26601883-faa5-4e22-9859-d34e73dbe0c1-kube-api-access-fqfsn\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:00.743016 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.742975 2557 generic.go:356] "Generic (PLEG): container finished" podID="26601883-faa5-4e22-9859-d34e73dbe0c1" containerID="a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290" exitCode=2 Jun 13 02:11:00.743016 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.743021 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:11:00.743486 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.743057 2557 scope.go:117] "RemoveContainer" containerID="a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290" Jun 13 02:11:00.745642 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:11:00.745613 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pxvpt\" is forbidden: User \"system:node:ip-10-0-141-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-22.ec2.internal' and this object" podUID="26601883-faa5-4e22-9859-d34e73dbe0c1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:11:00.753747 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.753729 2557 scope.go:117] "RemoveContainer" containerID="a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290" Jun 13 02:11:00.754046 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:11:00.754028 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290\": container with ID starting with a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290 not found: ID does not exist" containerID="a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290" Jun 13 02:11:00.754085 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:00.754056 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290"} err="failed to get container status \"a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290\": rpc error: code = NotFound desc = could not find container \"a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290\": container with ID starting with a631fa9c38cc664189181b6da472f545a345835e2340925141048cd445fd7290 not found: ID does not exist" Jun 13 02:11:00.754630 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:11:00.754611 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pxvpt\" is forbidden: User \"system:node:ip-10-0-141-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-22.ec2.internal' and this object" podUID="26601883-faa5-4e22-9859-d34e73dbe0c1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pxvpt" Jun 13 02:11:01.008756 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:01.008725 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26601883-faa5-4e22-9859-d34e73dbe0c1" path="/var/lib/kubelet/pods/26601883-faa5-4e22-9859-d34e73dbe0c1/volumes" Jun 13 02:11:10.745855 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:10.745824 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:11:18.770629 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:18.770564 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d7754b57d-vzkl6" podUID="e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" containerName="console" containerID="cri-o://3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563" gracePeriod=15 Jun 13 02:11:19.035615 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.035546 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:11:19.180116 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180083 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-service-ca\") pod \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " Jun 13 02:11:19.180116 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180120 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-trusted-ca-bundle\") pod \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " Jun 13 02:11:19.180387 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180139 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-config\") pod \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " Jun 13 02:11:19.180387 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180173 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-serving-cert\") pod \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " Jun 13 02:11:19.180387 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180249 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-oauth-config\") pod \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " Jun 13 02:11:19.180387 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180282 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68wtt\" (UniqueName: \"kubernetes.io/projected/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-kube-api-access-68wtt\") pod \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " Jun 13 02:11:19.180387 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180323 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-oauth-serving-cert\") pod \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\" (UID: \"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d\") " Jun 13 02:11:19.180653 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180535 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-service-ca" (OuterVolumeSpecName: "service-ca") pod "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" (UID: "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:11:19.180729 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180677 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-config" (OuterVolumeSpecName: "console-config") pod "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" (UID: "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:11:19.180780 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180736 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:19.180822 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180803 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" (UID: "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:11:19.180890 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.180859 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" (UID: "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:11:19.182473 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.182452 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" (UID: "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:11:19.182552 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.182502 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-kube-api-access-68wtt" (OuterVolumeSpecName: "kube-api-access-68wtt") pod "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" (UID: "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d"). InnerVolumeSpecName "kube-api-access-68wtt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:11:19.182595 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.182553 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" (UID: "e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:11:19.282266 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.282232 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-oauth-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:19.282266 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.282260 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68wtt\" (UniqueName: \"kubernetes.io/projected/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-kube-api-access-68wtt\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:19.282266 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.282269 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-oauth-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:19.282266 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.282277 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-trusted-ca-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:19.282535 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.282286 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:19.282535 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.282295 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d-console-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:19.861053 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.861017 2557 generic.go:356] "Generic (PLEG): container finished" podID="e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" containerID="3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563" exitCode=0 Jun 13 02:11:19.861471 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.861060 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7754b57d-vzkl6" Jun 13 02:11:19.861471 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.861096 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7754b57d-vzkl6" event={"ID":"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d","Type":"ContainerDied","Data":"3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563"} Jun 13 02:11:19.861471 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.861147 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7754b57d-vzkl6" event={"ID":"e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d","Type":"ContainerDied","Data":"b561d039b332b91d7d59fb2acb9d7b60910141ba7e2e369a4b975122d8b47357"} Jun 13 02:11:19.861471 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.861174 2557 scope.go:117] "RemoveContainer" containerID="3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563" Jun 13 02:11:19.870860 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.870844 2557 scope.go:117] "RemoveContainer" containerID="3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563" Jun 13 02:11:19.871139 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:11:19.871121 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563\": container with ID starting with 3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563 not found: ID does not exist" containerID="3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563" Jun 13 02:11:19.871194 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.871146 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563"} err="failed to get container status \"3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563\": rpc error: code = NotFound desc = could not find container \"3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563\": container with ID starting with 3a9afd2522f98f64b000b79bfd6b5a0d79bc127529a104cbb82ca237f8b6a563 not found: ID does not exist" Jun 13 02:11:19.883272 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.883245 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7754b57d-vzkl6"] Jun 13 02:11:19.887211 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:19.887187 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d7754b57d-vzkl6"] Jun 13 02:11:21.008288 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:21.008252 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" path="/var/lib/kubelet/pods/e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d/volumes" Jun 13 02:11:23.239084 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.239045 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5"] Jun 13 02:11:23.239460 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.239255 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" podUID="d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d" containerName="manager" containerID="cri-o://c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2" gracePeriod=10 Jun 13 02:11:23.495120 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.495058 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:11:23.623709 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.623667 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-extensions-socket-volume\") pod \"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d\" (UID: \"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d\") " Jun 13 02:11:23.623901 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.623766 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ffbt\" (UniqueName: \"kubernetes.io/projected/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-kube-api-access-8ffbt\") pod \"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d\" (UID: \"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d\") " Jun 13 02:11:23.624379 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.624347 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d" (UID: "d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:11:23.625918 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.625893 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-kube-api-access-8ffbt" (OuterVolumeSpecName: "kube-api-access-8ffbt") pod "d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d" (UID: "d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d"). InnerVolumeSpecName "kube-api-access-8ffbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:11:23.724840 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.724799 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ffbt\" (UniqueName: \"kubernetes.io/projected/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-kube-api-access-8ffbt\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:23.724840 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.724833 2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d-extensions-socket-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:23.885916 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.885882 2557 generic.go:356] "Generic (PLEG): container finished" podID="d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d" containerID="c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2" exitCode=0 Jun 13 02:11:23.886115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.885958 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" Jun 13 02:11:23.886115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.885987 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" event={"ID":"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d","Type":"ContainerDied","Data":"c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2"} Jun 13 02:11:23.886115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.886073 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5" event={"ID":"d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d","Type":"ContainerDied","Data":"bf2789bbea83c1513015c2f3b869794230c8cbd1ecbaa820222361276f37913b"} Jun 13 02:11:23.886115 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.886102 2557 scope.go:117] "RemoveContainer" containerID="c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2" Jun 13 02:11:23.896002 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.895984 2557 scope.go:117] "RemoveContainer" containerID="c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2" Jun 13 02:11:23.896320 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:11:23.896295 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2\": container with ID starting with c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2 not found: ID does not exist" containerID="c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2" Jun 13 02:11:23.896408 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.896331 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2"} err="failed to get container status \"c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2\": rpc error: code = NotFound desc = could not find container \"c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2\": container with ID starting with c39402ff98fa7011eed291a767dd632f43b0788f51259f894d64e2a61a4aaaa2 not found: ID does not exist" Jun 13 02:11:23.910089 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.910047 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5"] Jun 13 02:11:23.913245 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:23.913222 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rvjg5"] Jun 13 02:11:25.008848 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:25.008815 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d" path="/var/lib/kubelet/pods/d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d/volumes" Jun 13 02:11:29.685623 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.685576 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sb6jh"] Jun 13 02:11:29.686057 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.686043 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d" containerName="manager" Jun 13 02:11:29.686110 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.686059 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d" containerName="manager" Jun 13 02:11:29.686110 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.686072 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26601883-faa5-4e22-9859-d34e73dbe0c1" containerName="manager" Jun 13 02:11:29.686110 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.686078 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="26601883-faa5-4e22-9859-d34e73dbe0c1" containerName="manager" Jun 13 02:11:29.686110 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.686097 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" containerName="console" Jun 13 02:11:29.686110 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.686103 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" containerName="console" Jun 13 02:11:29.686264 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.686164 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0e9dbbc-b9ff-411e-8fc4-396df3e2c51d" containerName="manager" Jun 13 02:11:29.686264 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.686174 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="26601883-faa5-4e22-9859-d34e73dbe0c1" containerName="manager" Jun 13 02:11:29.686264 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.686182 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b9dc6e-4a8c-4856-b759-b54d8ac4bb8d" containerName="console" Jun 13 02:11:29.692763 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.692746 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:29.698834 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.698810 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 13 02:11:29.698987 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.698810 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-46q98\"" Jun 13 02:11:29.701212 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.701191 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sb6jh"] Jun 13 02:11:29.782670 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.782634 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/08d7e93b-b264-446c-97b0-8fe14bb26912-config-file\") pod \"limitador-limitador-64c94fd64f-sb6jh\" (UID: \"08d7e93b-b264-446c-97b0-8fe14bb26912\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:29.782861 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.782775 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57cd8\" (UniqueName: \"kubernetes.io/projected/08d7e93b-b264-446c-97b0-8fe14bb26912-kube-api-access-57cd8\") pod \"limitador-limitador-64c94fd64f-sb6jh\" (UID: \"08d7e93b-b264-446c-97b0-8fe14bb26912\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:29.784073 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.784053 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sb6jh"] Jun 13 02:11:29.883907 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.883868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57cd8\" (UniqueName: \"kubernetes.io/projected/08d7e93b-b264-446c-97b0-8fe14bb26912-kube-api-access-57cd8\") pod \"limitador-limitador-64c94fd64f-sb6jh\" (UID: \"08d7e93b-b264-446c-97b0-8fe14bb26912\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:29.884113 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.883938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/08d7e93b-b264-446c-97b0-8fe14bb26912-config-file\") pod \"limitador-limitador-64c94fd64f-sb6jh\" (UID: \"08d7e93b-b264-446c-97b0-8fe14bb26912\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:29.884627 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.884603 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/08d7e93b-b264-446c-97b0-8fe14bb26912-config-file\") pod \"limitador-limitador-64c94fd64f-sb6jh\" (UID: \"08d7e93b-b264-446c-97b0-8fe14bb26912\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:29.891892 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:29.891859 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57cd8\" (UniqueName: \"kubernetes.io/projected/08d7e93b-b264-446c-97b0-8fe14bb26912-kube-api-access-57cd8\") pod \"limitador-limitador-64c94fd64f-sb6jh\" (UID: \"08d7e93b-b264-446c-97b0-8fe14bb26912\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:30.004266 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:30.004242 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:30.137031 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:30.137001 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sb6jh"] Jun 13 02:11:30.138877 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:11:30.138845 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d7e93b_b264_446c_97b0_8fe14bb26912.slice/crio-e3fc6ba23f4f0b75eeeef15c329c2dae68c6bb98722fbb4ed113a4a62fa9f054 WatchSource:0}: Error finding container e3fc6ba23f4f0b75eeeef15c329c2dae68c6bb98722fbb4ed113a4a62fa9f054: Status 404 returned error can't find the container with id e3fc6ba23f4f0b75eeeef15c329c2dae68c6bb98722fbb4ed113a4a62fa9f054 Jun 13 02:11:30.933616 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:30.933537 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" event={"ID":"08d7e93b-b264-446c-97b0-8fe14bb26912","Type":"ContainerStarted","Data":"e3fc6ba23f4f0b75eeeef15c329c2dae68c6bb98722fbb4ed113a4a62fa9f054"} Jun 13 02:11:33.953828 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:33.953790 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" event={"ID":"08d7e93b-b264-446c-97b0-8fe14bb26912","Type":"ContainerStarted","Data":"76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2"} Jun 13 02:11:33.954304 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:33.953938 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:33.970910 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:33.970857 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" podStartSLOduration=1.98939633 podStartE2EDuration="4.970843403s" totalImagesPullingTime="2.981447073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:11:33.968666651 +0000 UTC m=+655.447816923" watchObservedRunningTime="2026-06-13 02:11:33.970843403 +0000 UTC m=+655.449993674" Jun 13 02:11:44.961624 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:44.961540 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:47.918594 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:47.918556 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sb6jh"] Jun 13 02:11:47.919050 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:47.918756 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" podUID="08d7e93b-b264-446c-97b0-8fe14bb26912" containerName="limitador" containerID="cri-o://76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2" gracePeriod=30 Jun 13 02:11:48.473065 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:48.473044 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:48.547483 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:48.547452 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/08d7e93b-b264-446c-97b0-8fe14bb26912-config-file\") pod \"08d7e93b-b264-446c-97b0-8fe14bb26912\" (UID: \"08d7e93b-b264-446c-97b0-8fe14bb26912\") " Jun 13 02:11:48.547645 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:48.547537 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57cd8\" (UniqueName: \"kubernetes.io/projected/08d7e93b-b264-446c-97b0-8fe14bb26912-kube-api-access-57cd8\") pod \"08d7e93b-b264-446c-97b0-8fe14bb26912\" (UID: \"08d7e93b-b264-446c-97b0-8fe14bb26912\") " Jun 13 02:11:48.547868 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:48.547844 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08d7e93b-b264-446c-97b0-8fe14bb26912-config-file" (OuterVolumeSpecName: "config-file") pod "08d7e93b-b264-446c-97b0-8fe14bb26912" (UID: "08d7e93b-b264-446c-97b0-8fe14bb26912"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:11:48.549556 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:48.549536 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d7e93b-b264-446c-97b0-8fe14bb26912-kube-api-access-57cd8" (OuterVolumeSpecName: "kube-api-access-57cd8") pod "08d7e93b-b264-446c-97b0-8fe14bb26912" (UID: "08d7e93b-b264-446c-97b0-8fe14bb26912"). InnerVolumeSpecName "kube-api-access-57cd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:11:48.648619 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:48.648588 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57cd8\" (UniqueName: \"kubernetes.io/projected/08d7e93b-b264-446c-97b0-8fe14bb26912-kube-api-access-57cd8\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:48.648619 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:48.648613 2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/08d7e93b-b264-446c-97b0-8fe14bb26912-config-file\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:11:49.047221 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:49.047183 2557 generic.go:356] "Generic (PLEG): container finished" podID="08d7e93b-b264-446c-97b0-8fe14bb26912" containerID="76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2" exitCode=0 Jun 13 02:11:49.047622 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:49.047225 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" event={"ID":"08d7e93b-b264-446c-97b0-8fe14bb26912","Type":"ContainerDied","Data":"76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2"} Jun 13 02:11:49.047622 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:49.047289 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" event={"ID":"08d7e93b-b264-446c-97b0-8fe14bb26912","Type":"ContainerDied","Data":"e3fc6ba23f4f0b75eeeef15c329c2dae68c6bb98722fbb4ed113a4a62fa9f054"} Jun 13 02:11:49.047622 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:49.047311 2557 scope.go:117] "RemoveContainer" containerID="76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2" Jun 13 02:11:49.047622 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:49.047242 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sb6jh" Jun 13 02:11:49.056864 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:49.056848 2557 scope.go:117] "RemoveContainer" containerID="76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2" Jun 13 02:11:49.057135 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:11:49.057112 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2\": container with ID starting with 76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2 not found: ID does not exist" containerID="76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2" Jun 13 02:11:49.057191 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:49.057144 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2"} err="failed to get container status \"76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2\": rpc error: code = NotFound desc = could not find container \"76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2\": container with ID starting with 76d25438a57798335de68ae4a6622fa782e6af247197ec22d39ad7c242f502b2 not found: ID does not exist" Jun 13 02:11:49.065016 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:49.064991 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sb6jh"] Jun 13 02:11:49.068124 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:49.068102 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sb6jh"] Jun 13 02:11:50.301661 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.301628 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-rxgmz"] Jun 13 02:11:50.302151 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.302051 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d7e93b-b264-446c-97b0-8fe14bb26912" containerName="limitador" Jun 13 02:11:50.302151 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.302063 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d7e93b-b264-446c-97b0-8fe14bb26912" containerName="limitador" Jun 13 02:11:50.302151 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.302147 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="08d7e93b-b264-446c-97b0-8fe14bb26912" containerName="limitador" Jun 13 02:11:50.306664 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.306644 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rxgmz" Jun 13 02:11:50.309197 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.309174 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 13 02:11:50.311874 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.311817 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rxgmz"] Jun 13 02:11:50.364337 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.364308 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/340646cf-0de1-4690-b217-5066162a6582-data\") pod \"postgres-69fb4594cf-rxgmz\" (UID: \"340646cf-0de1-4690-b217-5066162a6582\") " pod="opendatahub/postgres-69fb4594cf-rxgmz" Jun 13 02:11:50.364457 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.364338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fdn7\" (UniqueName: \"kubernetes.io/projected/340646cf-0de1-4690-b217-5066162a6582-kube-api-access-5fdn7\") pod \"postgres-69fb4594cf-rxgmz\" (UID: \"340646cf-0de1-4690-b217-5066162a6582\") " pod="opendatahub/postgres-69fb4594cf-rxgmz" Jun 13 02:11:50.464991 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.464939 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/340646cf-0de1-4690-b217-5066162a6582-data\") pod \"postgres-69fb4594cf-rxgmz\" (UID: \"340646cf-0de1-4690-b217-5066162a6582\") " pod="opendatahub/postgres-69fb4594cf-rxgmz" Jun 13 02:11:50.465137 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.465000 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fdn7\" (UniqueName: \"kubernetes.io/projected/340646cf-0de1-4690-b217-5066162a6582-kube-api-access-5fdn7\") pod \"postgres-69fb4594cf-rxgmz\" (UID: \"340646cf-0de1-4690-b217-5066162a6582\") " pod="opendatahub/postgres-69fb4594cf-rxgmz" Jun 13 02:11:50.465253 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.465236 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/340646cf-0de1-4690-b217-5066162a6582-data\") pod \"postgres-69fb4594cf-rxgmz\" (UID: \"340646cf-0de1-4690-b217-5066162a6582\") " pod="opendatahub/postgres-69fb4594cf-rxgmz" Jun 13 02:11:50.472312 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.472293 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fdn7\" (UniqueName: \"kubernetes.io/projected/340646cf-0de1-4690-b217-5066162a6582-kube-api-access-5fdn7\") pod \"postgres-69fb4594cf-rxgmz\" (UID: \"340646cf-0de1-4690-b217-5066162a6582\") " pod="opendatahub/postgres-69fb4594cf-rxgmz" Jun 13 02:11:50.618507 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.618419 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rxgmz" Jun 13 02:11:50.768492 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:50.768458 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rxgmz"] Jun 13 02:11:50.770014 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:11:50.769990 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340646cf_0de1_4690_b217_5066162a6582.slice/crio-8b693125de6a9089c9b7f3f5d8868e7cd5a69dd191882b7ae85459d92a137e9d WatchSource:0}: Error finding container 8b693125de6a9089c9b7f3f5d8868e7cd5a69dd191882b7ae85459d92a137e9d: Status 404 returned error can't find the container with id 8b693125de6a9089c9b7f3f5d8868e7cd5a69dd191882b7ae85459d92a137e9d Jun 13 02:11:51.008022 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:51.007994 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08d7e93b-b264-446c-97b0-8fe14bb26912" path="/var/lib/kubelet/pods/08d7e93b-b264-446c-97b0-8fe14bb26912/volumes" Jun 13 02:11:51.061485 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:51.061446 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rxgmz" event={"ID":"340646cf-0de1-4690-b217-5066162a6582","Type":"ContainerStarted","Data":"8b693125de6a9089c9b7f3f5d8868e7cd5a69dd191882b7ae85459d92a137e9d"} Jun 13 02:11:54.083244 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:54.083209 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rxgmz" event={"ID":"340646cf-0de1-4690-b217-5066162a6582","Type":"ContainerStarted","Data":"d78f6e8ae7e82554a63ba304701fcff6cc0e67c37d4a4e7c46711fd2d30e5e04"} Jun 13 02:11:54.083775 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:54.083342 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-rxgmz" Jun 13 02:11:54.100963 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:11:54.100899 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-rxgmz" podStartSLOduration=1.589604181 podStartE2EDuration="4.100886075s" totalImagesPullingTime="2.511281894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:11:54.09956275 +0000 UTC m=+675.578713022" watchObservedRunningTime="2026-06-13 02:11:54.100886075 +0000 UTC m=+675.580036346" Jun 13 02:12:00.123356 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:00.123328 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-rxgmz" Jun 13 02:12:01.488021 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.487992 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx"] Jun 13 02:12:01.495016 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.495000 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.497724 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.497699 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 02:12:01.497871 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.497699 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bcfzp\"" Jun 13 02:12:01.498895 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.498872 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 02:12:01.499342 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.499322 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx"] Jun 13 02:12:01.558425 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.558394 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt6kl\" (UniqueName: \"kubernetes.io/projected/edbe138c-844f-4df7-8dfa-8236f29cc7f2-kube-api-access-tt6kl\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.558593 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.558460 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.558593 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.558485 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.659849 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.659817 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.659849 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.659854 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.660083 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.659912 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt6kl\" (UniqueName: \"kubernetes.io/projected/edbe138c-844f-4df7-8dfa-8236f29cc7f2-kube-api-access-tt6kl\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.660245 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.660214 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.660287 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.660246 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.669448 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.669426 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt6kl\" (UniqueName: \"kubernetes.io/projected/edbe138c-844f-4df7-8dfa-8236f29cc7f2-kube-api-access-tt6kl\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.806262 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.806235 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:01.940426 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:01.940395 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx"] Jun 13 02:12:01.942314 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:12:01.942284 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedbe138c_844f_4df7_8dfa_8236f29cc7f2.slice/crio-f3783b20190bce0d7def4fe7f6dd16ac823a607085b0e763e624004a16dbddbd WatchSource:0}: Error finding container f3783b20190bce0d7def4fe7f6dd16ac823a607085b0e763e624004a16dbddbd: Status 404 returned error can't find the container with id f3783b20190bce0d7def4fe7f6dd16ac823a607085b0e763e624004a16dbddbd Jun 13 02:12:02.132873 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:02.132837 2557 generic.go:356] "Generic (PLEG): container finished" podID="edbe138c-844f-4df7-8dfa-8236f29cc7f2" containerID="c13e5d58260e2042cff724bb4914138e3e519faff0efa362745aadae959dd867" exitCode=0 Jun 13 02:12:02.133060 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:02.132923 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" event={"ID":"edbe138c-844f-4df7-8dfa-8236f29cc7f2","Type":"ContainerDied","Data":"c13e5d58260e2042cff724bb4914138e3e519faff0efa362745aadae959dd867"} Jun 13 02:12:02.133060 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:02.132994 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" event={"ID":"edbe138c-844f-4df7-8dfa-8236f29cc7f2","Type":"ContainerStarted","Data":"f3783b20190bce0d7def4fe7f6dd16ac823a607085b0e763e624004a16dbddbd"} Jun 13 02:12:03.140366 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:03.140332 2557 generic.go:356] "Generic (PLEG): container finished" podID="edbe138c-844f-4df7-8dfa-8236f29cc7f2" containerID="2b3f031aacf84dd3e01a0c68afe3d9891ebca2b61e2ebff8517ec16b134f392c" exitCode=0 Jun 13 02:12:03.140756 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:03.140398 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" event={"ID":"edbe138c-844f-4df7-8dfa-8236f29cc7f2","Type":"ContainerDied","Data":"2b3f031aacf84dd3e01a0c68afe3d9891ebca2b61e2ebff8517ec16b134f392c"} Jun 13 02:12:04.153583 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:04.153547 2557 generic.go:356] "Generic (PLEG): container finished" podID="edbe138c-844f-4df7-8dfa-8236f29cc7f2" containerID="519722ebff89379598dda697a105efbb27e0026cd84a00a69c8607adb41671ce" exitCode=0 Jun 13 02:12:04.154034 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:04.153633 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" event={"ID":"edbe138c-844f-4df7-8dfa-8236f29cc7f2","Type":"ContainerDied","Data":"519722ebff89379598dda697a105efbb27e0026cd84a00a69c8607adb41671ce"} Jun 13 02:12:05.301600 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:05.301574 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:05.395273 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:05.395243 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt6kl\" (UniqueName: \"kubernetes.io/projected/edbe138c-844f-4df7-8dfa-8236f29cc7f2-kube-api-access-tt6kl\") pod \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " Jun 13 02:12:05.395450 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:05.395353 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-bundle\") pod \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " Jun 13 02:12:05.395450 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:05.395391 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-util\") pod \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\" (UID: \"edbe138c-844f-4df7-8dfa-8236f29cc7f2\") " Jun 13 02:12:05.395891 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:05.395859 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-bundle" (OuterVolumeSpecName: "bundle") pod "edbe138c-844f-4df7-8dfa-8236f29cc7f2" (UID: "edbe138c-844f-4df7-8dfa-8236f29cc7f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:12:05.397339 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:05.397311 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edbe138c-844f-4df7-8dfa-8236f29cc7f2-kube-api-access-tt6kl" (OuterVolumeSpecName: "kube-api-access-tt6kl") pod "edbe138c-844f-4df7-8dfa-8236f29cc7f2" (UID: "edbe138c-844f-4df7-8dfa-8236f29cc7f2"). InnerVolumeSpecName "kube-api-access-tt6kl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:12:05.400872 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:05.400832 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-util" (OuterVolumeSpecName: "util") pod "edbe138c-844f-4df7-8dfa-8236f29cc7f2" (UID: "edbe138c-844f-4df7-8dfa-8236f29cc7f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:12:05.497084 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:05.497018 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:12:05.497084 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:05.497043 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edbe138c-844f-4df7-8dfa-8236f29cc7f2-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:12:05.497084 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:05.497052 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt6kl\" (UniqueName: \"kubernetes.io/projected/edbe138c-844f-4df7-8dfa-8236f29cc7f2-kube-api-access-tt6kl\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:12:06.167500 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:06.167471 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" event={"ID":"edbe138c-844f-4df7-8dfa-8236f29cc7f2","Type":"ContainerDied","Data":"f3783b20190bce0d7def4fe7f6dd16ac823a607085b0e763e624004a16dbddbd"} Jun 13 02:12:06.167658 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:06.167519 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3783b20190bce0d7def4fe7f6dd16ac823a607085b0e763e624004a16dbddbd" Jun 13 02:12:06.167658 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:06.167475 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74895lqx" Jun 13 02:12:09.019608 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.019580 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-fk2wx"] Jun 13 02:12:09.020011 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.019996 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edbe138c-844f-4df7-8dfa-8236f29cc7f2" containerName="extract" Jun 13 02:12:09.020011 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.020012 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="edbe138c-844f-4df7-8dfa-8236f29cc7f2" containerName="extract" Jun 13 02:12:09.020096 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.020022 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edbe138c-844f-4df7-8dfa-8236f29cc7f2" containerName="util" Jun 13 02:12:09.020096 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.020028 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="edbe138c-844f-4df7-8dfa-8236f29cc7f2" containerName="util" Jun 13 02:12:09.020096 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.020037 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edbe138c-844f-4df7-8dfa-8236f29cc7f2" containerName="pull" Jun 13 02:12:09.020096 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.020042 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="edbe138c-844f-4df7-8dfa-8236f29cc7f2" containerName="pull" Jun 13 02:12:09.020218 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.020103 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="edbe138c-844f-4df7-8dfa-8236f29cc7f2" containerName="extract" Jun 13 02:12:09.022482 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.022467 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-fk2wx" Jun 13 02:12:09.025143 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.025122 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 02:12:09.026188 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.026157 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-hs4mt\"" Jun 13 02:12:09.026310 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.026191 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 02:12:09.034771 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.034741 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-fk2wx"] Jun 13 02:12:09.131295 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.131257 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96zh7\" (UniqueName: \"kubernetes.io/projected/c6a102e4-5caf-47e3-ae2f-9dbfab7b6d59-kube-api-access-96zh7\") pod \"keycloak-operator-d67dbbb48-fk2wx\" (UID: \"c6a102e4-5caf-47e3-ae2f-9dbfab7b6d59\") " pod="keycloak-system/keycloak-operator-d67dbbb48-fk2wx" Jun 13 02:12:09.231847 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.231814 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96zh7\" (UniqueName: \"kubernetes.io/projected/c6a102e4-5caf-47e3-ae2f-9dbfab7b6d59-kube-api-access-96zh7\") pod \"keycloak-operator-d67dbbb48-fk2wx\" (UID: \"c6a102e4-5caf-47e3-ae2f-9dbfab7b6d59\") " pod="keycloak-system/keycloak-operator-d67dbbb48-fk2wx" Jun 13 02:12:09.242163 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.242134 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96zh7\" (UniqueName: \"kubernetes.io/projected/c6a102e4-5caf-47e3-ae2f-9dbfab7b6d59-kube-api-access-96zh7\") pod \"keycloak-operator-d67dbbb48-fk2wx\" (UID: \"c6a102e4-5caf-47e3-ae2f-9dbfab7b6d59\") " pod="keycloak-system/keycloak-operator-d67dbbb48-fk2wx" Jun 13 02:12:09.334893 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.334802 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-fk2wx" Jun 13 02:12:09.497429 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:09.497377 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-fk2wx"] Jun 13 02:12:09.498810 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:12:09.498777 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a102e4_5caf_47e3_ae2f_9dbfab7b6d59.slice/crio-996496600f999f53ba3d49a92197e779e8c1cdc1242d55fc57d525f03116dc4d WatchSource:0}: Error finding container 996496600f999f53ba3d49a92197e779e8c1cdc1242d55fc57d525f03116dc4d: Status 404 returned error can't find the container with id 996496600f999f53ba3d49a92197e779e8c1cdc1242d55fc57d525f03116dc4d Jun 13 02:12:10.197501 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:10.197453 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-fk2wx" event={"ID":"c6a102e4-5caf-47e3-ae2f-9dbfab7b6d59","Type":"ContainerStarted","Data":"996496600f999f53ba3d49a92197e779e8c1cdc1242d55fc57d525f03116dc4d"} Jun 13 02:12:17.245607 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:17.245564 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-fk2wx" event={"ID":"c6a102e4-5caf-47e3-ae2f-9dbfab7b6d59","Type":"ContainerStarted","Data":"dee44928d86e8063fb5ebd2d3d8bf46072bf0a3bac861a70c327c9156bcc056c"} Jun 13 02:12:17.264270 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:12:17.264223 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-fk2wx" podStartSLOduration=1.450191614 podStartE2EDuration="8.264209728s" totalImagesPullingTime="6.814018114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:12:17.261491145 +0000 UTC m=+698.740641416" watchObservedRunningTime="2026-06-13 02:12:17.264209728 +0000 UTC m=+698.743359999" Jun 13 02:13:03.668784 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.668744 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79f7cd65c5-nk4rj"] Jun 13 02:13:03.671563 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.671541 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:03.674337 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.674312 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 13 02:13:03.674467 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.674337 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 13 02:13:03.674467 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.674387 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-stxth\"" Jun 13 02:13:03.683890 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.683860 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79f7cd65c5-nk4rj"] Jun 13 02:13:03.830895 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.830851 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c931b9c-d554-44fb-b9fe-5f0cff43831e-webhook-cert\") pod \"maas-controller-79f7cd65c5-nk4rj\" (UID: \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\") " pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:03.831089 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.830915 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ndps\" (UniqueName: \"kubernetes.io/projected/6c931b9c-d554-44fb-b9fe-5f0cff43831e-kube-api-access-8ndps\") pod \"maas-controller-79f7cd65c5-nk4rj\" (UID: \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\") " pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:03.831601 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.831580 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-589fbdfdcc-xhfjf"] Jun 13 02:13:03.834558 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.834538 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:03.843775 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.843750 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-589fbdfdcc-xhfjf"] Jun 13 02:13:03.932256 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.932153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ndps\" (UniqueName: \"kubernetes.io/projected/6c931b9c-d554-44fb-b9fe-5f0cff43831e-kube-api-access-8ndps\") pod \"maas-controller-79f7cd65c5-nk4rj\" (UID: \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\") " pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:03.932421 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.932253 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-webhook-cert\") pod \"maas-controller-589fbdfdcc-xhfjf\" (UID: \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\") " pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:03.932421 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.932374 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c931b9c-d554-44fb-b9fe-5f0cff43831e-webhook-cert\") pod \"maas-controller-79f7cd65c5-nk4rj\" (UID: \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\") " pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:03.932421 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.932416 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrlm5\" (UniqueName: \"kubernetes.io/projected/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-kube-api-access-jrlm5\") pod \"maas-controller-589fbdfdcc-xhfjf\" (UID: \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\") " pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:03.932583 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:13:03.932542 2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 13 02:13:03.932638 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:13:03.932613 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c931b9c-d554-44fb-b9fe-5f0cff43831e-webhook-cert podName:6c931b9c-d554-44fb-b9fe-5f0cff43831e nodeName:}" failed. No retries permitted until 2026-06-13 02:13:04.432591011 +0000 UTC m=+745.911741280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6c931b9c-d554-44fb-b9fe-5f0cff43831e-webhook-cert") pod "maas-controller-79f7cd65c5-nk4rj" (UID: "6c931b9c-d554-44fb-b9fe-5f0cff43831e") : secret "maas-controller-webhook-cert" not found Jun 13 02:13:03.942935 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:03.942899 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ndps\" (UniqueName: \"kubernetes.io/projected/6c931b9c-d554-44fb-b9fe-5f0cff43831e-kube-api-access-8ndps\") pod \"maas-controller-79f7cd65c5-nk4rj\" (UID: \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\") " pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:04.033451 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.033416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-webhook-cert\") pod \"maas-controller-589fbdfdcc-xhfjf\" (UID: \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\") " pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:04.033657 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.033533 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrlm5\" (UniqueName: \"kubernetes.io/projected/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-kube-api-access-jrlm5\") pod \"maas-controller-589fbdfdcc-xhfjf\" (UID: \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\") " pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:04.033657 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:13:04.033567 2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 13 02:13:04.033657 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:13:04.033635 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-webhook-cert podName:8593e454-ac29-4fdd-88ed-a6cab8cc9e9d nodeName:}" failed. No retries permitted until 2026-06-13 02:13:04.533618305 +0000 UTC m=+746.012768576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-webhook-cert") pod "maas-controller-589fbdfdcc-xhfjf" (UID: "8593e454-ac29-4fdd-88ed-a6cab8cc9e9d") : secret "maas-controller-webhook-cert" not found Jun 13 02:13:04.042245 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.042215 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrlm5\" (UniqueName: \"kubernetes.io/projected/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-kube-api-access-jrlm5\") pod \"maas-controller-589fbdfdcc-xhfjf\" (UID: \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\") " pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:04.437728 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.437687 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c931b9c-d554-44fb-b9fe-5f0cff43831e-webhook-cert\") pod \"maas-controller-79f7cd65c5-nk4rj\" (UID: \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\") " pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:04.440178 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.440142 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c931b9c-d554-44fb-b9fe-5f0cff43831e-webhook-cert\") pod \"maas-controller-79f7cd65c5-nk4rj\" (UID: \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\") " pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:04.539161 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.539129 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-webhook-cert\") pod \"maas-controller-589fbdfdcc-xhfjf\" (UID: \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\") " pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:04.541545 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.541521 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-webhook-cert\") pod \"maas-controller-589fbdfdcc-xhfjf\" (UID: \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\") " pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:04.583660 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.583620 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:04.714839 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.714803 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79f7cd65c5-nk4rj"] Jun 13 02:13:04.715312 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:13:04.715291 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c931b9c_d554_44fb_b9fe_5f0cff43831e.slice/crio-256c976bd215073db6516f3a3c16f40edb1accf0bbfc2650e1a3c5b6a5289cc0 WatchSource:0}: Error finding container 256c976bd215073db6516f3a3c16f40edb1accf0bbfc2650e1a3c5b6a5289cc0: Status 404 returned error can't find the container with id 256c976bd215073db6516f3a3c16f40edb1accf0bbfc2650e1a3c5b6a5289cc0 Jun 13 02:13:04.745644 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.745613 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:04.878260 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:04.878220 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-589fbdfdcc-xhfjf"] Jun 13 02:13:04.878842 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:13:04.878817 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8593e454_ac29_4fdd_88ed_a6cab8cc9e9d.slice/crio-ad2b3b08d225944b1e75639fe8e9c2a87743810b1fa8296039d47afd362be24a WatchSource:0}: Error finding container ad2b3b08d225944b1e75639fe8e9c2a87743810b1fa8296039d47afd362be24a: Status 404 returned error can't find the container with id ad2b3b08d225944b1e75639fe8e9c2a87743810b1fa8296039d47afd362be24a Jun 13 02:13:05.547565 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:05.547520 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" event={"ID":"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d","Type":"ContainerStarted","Data":"ad2b3b08d225944b1e75639fe8e9c2a87743810b1fa8296039d47afd362be24a"} Jun 13 02:13:05.549917 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:05.549836 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" event={"ID":"6c931b9c-d554-44fb-b9fe-5f0cff43831e","Type":"ContainerStarted","Data":"256c976bd215073db6516f3a3c16f40edb1accf0bbfc2650e1a3c5b6a5289cc0"} Jun 13 02:13:07.564850 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:07.564810 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" event={"ID":"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d","Type":"ContainerStarted","Data":"222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3"} Jun 13 02:13:07.565331 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:07.564883 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:07.566533 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:07.566502 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" event={"ID":"6c931b9c-d554-44fb-b9fe-5f0cff43831e","Type":"ContainerStarted","Data":"f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1"} Jun 13 02:13:07.566628 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:07.566566 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:07.582660 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:07.582611 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" podStartSLOduration=2.040240798 podStartE2EDuration="4.582595029s" totalImagesPullingTime="2.542354231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:13:07.579836364 +0000 UTC m=+749.058986660" watchObservedRunningTime="2026-06-13 02:13:07.582595029 +0000 UTC m=+749.061745342" Jun 13 02:13:07.602044 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:07.601978 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" podStartSLOduration=1.885707902 podStartE2EDuration="4.601924288s" totalImagesPullingTime="2.716216386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:13:07.598857042 +0000 UTC m=+749.078007318" watchObservedRunningTime="2026-06-13 02:13:07.601924288 +0000 UTC m=+749.081074562" Jun 13 02:13:18.577808 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:18.577775 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:18.578388 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:18.577856 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:13:18.635714 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:18.635679 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79f7cd65c5-nk4rj"] Jun 13 02:13:18.635924 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:18.635896 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" podUID="6c931b9c-d554-44fb-b9fe-5f0cff43831e" containerName="manager" containerID="cri-o://f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1" gracePeriod=30 Jun 13 02:13:18.884384 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:18.884359 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:18.976607 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:18.976569 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c931b9c-d554-44fb-b9fe-5f0cff43831e-webhook-cert\") pod \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\" (UID: \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\") " Jun 13 02:13:18.976798 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:18.976675 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ndps\" (UniqueName: \"kubernetes.io/projected/6c931b9c-d554-44fb-b9fe-5f0cff43831e-kube-api-access-8ndps\") pod \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\" (UID: \"6c931b9c-d554-44fb-b9fe-5f0cff43831e\") " Jun 13 02:13:18.978826 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:18.978797 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c931b9c-d554-44fb-b9fe-5f0cff43831e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6c931b9c-d554-44fb-b9fe-5f0cff43831e" (UID: "6c931b9c-d554-44fb-b9fe-5f0cff43831e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:13:18.978945 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:18.978829 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c931b9c-d554-44fb-b9fe-5f0cff43831e-kube-api-access-8ndps" (OuterVolumeSpecName: "kube-api-access-8ndps") pod "6c931b9c-d554-44fb-b9fe-5f0cff43831e" (UID: "6c931b9c-d554-44fb-b9fe-5f0cff43831e"). InnerVolumeSpecName "kube-api-access-8ndps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:13:19.077368 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.077335 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ndps\" (UniqueName: \"kubernetes.io/projected/6c931b9c-d554-44fb-b9fe-5f0cff43831e-kube-api-access-8ndps\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:13:19.077368 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.077367 2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c931b9c-d554-44fb-b9fe-5f0cff43831e-webhook-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:13:19.641205 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.641170 2557 generic.go:356] "Generic (PLEG): container finished" podID="6c931b9c-d554-44fb-b9fe-5f0cff43831e" containerID="f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1" exitCode=0 Jun 13 02:13:19.641605 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.641222 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" Jun 13 02:13:19.641605 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.641235 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" event={"ID":"6c931b9c-d554-44fb-b9fe-5f0cff43831e","Type":"ContainerDied","Data":"f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1"} Jun 13 02:13:19.641605 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.641286 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f7cd65c5-nk4rj" event={"ID":"6c931b9c-d554-44fb-b9fe-5f0cff43831e","Type":"ContainerDied","Data":"256c976bd215073db6516f3a3c16f40edb1accf0bbfc2650e1a3c5b6a5289cc0"} Jun 13 02:13:19.641605 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.641318 2557 scope.go:117] "RemoveContainer" containerID="f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1" Jun 13 02:13:19.650583 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.650564 2557 scope.go:117] "RemoveContainer" containerID="f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1" Jun 13 02:13:19.650861 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:13:19.650837 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1\": container with ID starting with f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1 not found: ID does not exist" containerID="f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1" Jun 13 02:13:19.651027 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.650866 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1"} err="failed to get container status \"f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1\": rpc error: code = NotFound desc = could not find container \"f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1\": container with ID starting with f5127e137aacefc694ecad5388e327c291a5b0e33e9252e3604f25c8522c18d1 not found: ID does not exist" Jun 13 02:13:19.658515 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.658488 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79f7cd65c5-nk4rj"] Jun 13 02:13:19.661736 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:19.661703 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79f7cd65c5-nk4rj"] Jun 13 02:13:21.009783 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:21.009746 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c931b9c-d554-44fb-b9fe-5f0cff43831e" path="/var/lib/kubelet/pods/6c931b9c-d554-44fb-b9fe-5f0cff43831e/volumes" Jun 13 02:13:38.711357 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.711319 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-9cd5d7b8-6c5rd"] Jun 13 02:13:38.711843 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.711712 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c931b9c-d554-44fb-b9fe-5f0cff43831e" containerName="manager" Jun 13 02:13:38.711843 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.711723 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c931b9c-d554-44fb-b9fe-5f0cff43831e" containerName="manager" Jun 13 02:13:38.711843 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.711822 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c931b9c-d554-44fb-b9fe-5f0cff43831e" containerName="manager" Jun 13 02:13:38.715082 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.715066 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:38.717627 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.717605 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 13 02:13:38.717746 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.717653 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hkjhn\"" Jun 13 02:13:38.724030 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.724006 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-9cd5d7b8-6c5rd"] Jun 13 02:13:38.861039 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.861001 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk64g\" (UniqueName: \"kubernetes.io/projected/a1f5adba-13f9-4b2d-be73-2d427ac5d6f0-kube-api-access-jk64g\") pod \"maas-api-9cd5d7b8-6c5rd\" (UID: \"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0\") " pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:38.861222 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.861076 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1f5adba-13f9-4b2d-be73-2d427ac5d6f0-maas-api-tls\") pod \"maas-api-9cd5d7b8-6c5rd\" (UID: \"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0\") " pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:38.861222 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.861109 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1f5adba-13f9-4b2d-be73-2d427ac5d6f0-openshift-service-ca\") pod \"maas-api-9cd5d7b8-6c5rd\" (UID: \"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0\") " pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:38.962075 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.962002 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk64g\" (UniqueName: \"kubernetes.io/projected/a1f5adba-13f9-4b2d-be73-2d427ac5d6f0-kube-api-access-jk64g\") pod \"maas-api-9cd5d7b8-6c5rd\" (UID: \"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0\") " pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:38.962075 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.962058 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1f5adba-13f9-4b2d-be73-2d427ac5d6f0-maas-api-tls\") pod \"maas-api-9cd5d7b8-6c5rd\" (UID: \"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0\") " pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:38.962275 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.962081 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1f5adba-13f9-4b2d-be73-2d427ac5d6f0-openshift-service-ca\") pod \"maas-api-9cd5d7b8-6c5rd\" (UID: \"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0\") " pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:38.962722 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.962704 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1f5adba-13f9-4b2d-be73-2d427ac5d6f0-openshift-service-ca\") pod \"maas-api-9cd5d7b8-6c5rd\" (UID: \"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0\") " pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:38.964433 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.964419 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 13 02:13:38.971093 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.971071 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk64g\" (UniqueName: \"kubernetes.io/projected/a1f5adba-13f9-4b2d-be73-2d427ac5d6f0-kube-api-access-jk64g\") pod \"maas-api-9cd5d7b8-6c5rd\" (UID: \"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0\") " pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:38.974994 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:38.974935 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1f5adba-13f9-4b2d-be73-2d427ac5d6f0-maas-api-tls\") pod \"maas-api-9cd5d7b8-6c5rd\" (UID: \"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0\") " pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:39.029079 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.029055 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hkjhn\"" Jun 13 02:13:39.037090 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.037069 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:39.188005 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.187977 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-9cd5d7b8-6c5rd"] Jun 13 02:13:39.189791 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:13:39.189749 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f5adba_13f9_4b2d_be73_2d427ac5d6f0.slice/crio-7b9f3d1da9fc1ac363a62deceac511807e4d5ef924f6048774dd226fbb17957c WatchSource:0}: Error finding container 7b9f3d1da9fc1ac363a62deceac511807e4d5ef924f6048774dd226fbb17957c: Status 404 returned error can't find the container with id 7b9f3d1da9fc1ac363a62deceac511807e4d5ef924f6048774dd226fbb17957c Jun 13 02:13:39.330585 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.330551 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-77lbq"] Jun 13 02:13:39.335500 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.335478 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-77lbq" Jun 13 02:13:39.339773 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.339749 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 13 02:13:39.340002 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.339985 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-94rgb\"" Jun 13 02:13:39.349999 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.349974 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-77lbq"] Jun 13 02:13:39.468147 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.468114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r8mv\" (UniqueName: \"kubernetes.io/projected/ecde154d-470c-444e-a505-8cb7e3afdeef-kube-api-access-6r8mv\") pod \"payload-pre-processing-579785bc64-77lbq\" (UID: \"ecde154d-470c-444e-a505-8cb7e3afdeef\") " pod="openshift-ingress/payload-pre-processing-579785bc64-77lbq" Jun 13 02:13:39.569704 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.569665 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r8mv\" (UniqueName: \"kubernetes.io/projected/ecde154d-470c-444e-a505-8cb7e3afdeef-kube-api-access-6r8mv\") pod \"payload-pre-processing-579785bc64-77lbq\" (UID: \"ecde154d-470c-444e-a505-8cb7e3afdeef\") " pod="openshift-ingress/payload-pre-processing-579785bc64-77lbq" Jun 13 02:13:39.577602 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.577573 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r8mv\" (UniqueName: \"kubernetes.io/projected/ecde154d-470c-444e-a505-8cb7e3afdeef-kube-api-access-6r8mv\") pod \"payload-pre-processing-579785bc64-77lbq\" (UID: \"ecde154d-470c-444e-a505-8cb7e3afdeef\") " pod="openshift-ingress/payload-pre-processing-579785bc64-77lbq" Jun 13 02:13:39.647559 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.647485 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-77lbq" Jun 13 02:13:39.770270 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.770217 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-9cd5d7b8-6c5rd" event={"ID":"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0","Type":"ContainerStarted","Data":"7b9f3d1da9fc1ac363a62deceac511807e4d5ef924f6048774dd226fbb17957c"} Jun 13 02:13:39.790092 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:39.790063 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-77lbq"] Jun 13 02:13:39.791122 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:13:39.791094 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecde154d_470c_444e_a505_8cb7e3afdeef.slice/crio-cfe77423c39a71510148574ad2d9ddf4fa25432206efd6a0223d2adefb1404a3 WatchSource:0}: Error finding container cfe77423c39a71510148574ad2d9ddf4fa25432206efd6a0223d2adefb1404a3: Status 404 returned error can't find the container with id cfe77423c39a71510148574ad2d9ddf4fa25432206efd6a0223d2adefb1404a3 Jun 13 02:13:40.782536 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:40.782388 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-77lbq" event={"ID":"ecde154d-470c-444e-a505-8cb7e3afdeef","Type":"ContainerStarted","Data":"cfe77423c39a71510148574ad2d9ddf4fa25432206efd6a0223d2adefb1404a3"} Jun 13 02:13:42.797104 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:42.797068 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-77lbq" event={"ID":"ecde154d-470c-444e-a505-8cb7e3afdeef","Type":"ContainerStarted","Data":"5fa3dba7ade654c031189425efb76e5554abaeb7dc24260dbd9adc21ce5e3f93"} Jun 13 02:13:42.797529 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:42.797180 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-77lbq" Jun 13 02:13:42.798743 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:42.798723 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-9cd5d7b8-6c5rd" event={"ID":"a1f5adba-13f9-4b2d-be73-2d427ac5d6f0","Type":"ContainerStarted","Data":"db82ea4d8fcd0d99f53d7075d0f9aaf767a9c6180a25cbc356d116698777f825"} Jun 13 02:13:42.798858 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:42.798847 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:42.814086 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:42.814042 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-77lbq" podStartSLOduration=1.317549271 podStartE2EDuration="3.814020902s" totalImagesPullingTime="2.496471631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:13:42.811430036 +0000 UTC m=+784.290580308" watchObservedRunningTime="2026-06-13 02:13:42.814020902 +0000 UTC m=+784.293171174" Jun 13 02:13:42.828376 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:42.828331 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-9cd5d7b8-6c5rd" podStartSLOduration=1.7304132810000001 podStartE2EDuration="4.828318697s" totalImagesPullingTime="3.097905416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:13:42.825594602 +0000 UTC m=+784.304744876" watchObservedRunningTime="2026-06-13 02:13:42.828318697 +0000 UTC m=+784.307468968" Jun 13 02:13:48.810421 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:48.810389 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-9cd5d7b8-6c5rd" Jun 13 02:13:53.807554 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:13:53.807524 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-77lbq" Jun 13 02:15:00.130302 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:00.130272 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688615-75fwg"] Jun 13 02:15:00.133937 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:00.133921 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" Jun 13 02:15:00.139782 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:00.139760 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688615-75fwg"] Jun 13 02:15:00.301869 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:00.301834 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72tqh\" (UniqueName: \"kubernetes.io/projected/20ea5b4f-8ba0-4c54-ae62-331a14fb7517-kube-api-access-72tqh\") pod \"maas-api-key-cleanup-29688615-75fwg\" (UID: \"20ea5b4f-8ba0-4c54-ae62-331a14fb7517\") " pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" Jun 13 02:15:00.402394 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:00.402317 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72tqh\" (UniqueName: \"kubernetes.io/projected/20ea5b4f-8ba0-4c54-ae62-331a14fb7517-kube-api-access-72tqh\") pod \"maas-api-key-cleanup-29688615-75fwg\" (UID: \"20ea5b4f-8ba0-4c54-ae62-331a14fb7517\") " pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" Jun 13 02:15:00.410263 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:00.410231 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72tqh\" (UniqueName: \"kubernetes.io/projected/20ea5b4f-8ba0-4c54-ae62-331a14fb7517-kube-api-access-72tqh\") pod \"maas-api-key-cleanup-29688615-75fwg\" (UID: \"20ea5b4f-8ba0-4c54-ae62-331a14fb7517\") " pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" Jun 13 02:15:00.445691 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:00.445649 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" Jun 13 02:15:00.583483 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:00.583423 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688615-75fwg"] Jun 13 02:15:00.584099 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:15:00.584066 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ea5b4f_8ba0_4c54_ae62_331a14fb7517.slice/crio-3898ee50a7f5aac20d4be7afeaf4f31566b626d36781d7990047f1d30906983d WatchSource:0}: Error finding container 3898ee50a7f5aac20d4be7afeaf4f31566b626d36781d7990047f1d30906983d: Status 404 returned error can't find the container with id 3898ee50a7f5aac20d4be7afeaf4f31566b626d36781d7990047f1d30906983d Jun 13 02:15:01.279038 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:01.278996 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" event={"ID":"20ea5b4f-8ba0-4c54-ae62-331a14fb7517","Type":"ContainerStarted","Data":"3898ee50a7f5aac20d4be7afeaf4f31566b626d36781d7990047f1d30906983d"} Jun 13 02:15:03.296613 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:03.296580 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" event={"ID":"20ea5b4f-8ba0-4c54-ae62-331a14fb7517","Type":"ContainerStarted","Data":"16753acd75cece7261ee1a48d4ff2cbff5bb5ad3b800a05aa62674b71d4a4f8f"} Jun 13 02:15:03.314175 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:03.314119 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" podStartSLOduration=1.324283246 podStartE2EDuration="3.314103964s" totalImagesPullingTime="1.989820718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:15:03.311074129 +0000 UTC m=+864.790224401" watchObservedRunningTime="2026-06-13 02:15:03.314103964 +0000 UTC m=+864.793254237" Jun 13 02:15:04.304306 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:04.304272 2557 generic.go:356] "Generic (PLEG): container finished" podID="20ea5b4f-8ba0-4c54-ae62-331a14fb7517" containerID="16753acd75cece7261ee1a48d4ff2cbff5bb5ad3b800a05aa62674b71d4a4f8f" exitCode=0 Jun 13 02:15:04.304696 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:04.304371 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" event={"ID":"20ea5b4f-8ba0-4c54-ae62-331a14fb7517","Type":"ContainerDied","Data":"16753acd75cece7261ee1a48d4ff2cbff5bb5ad3b800a05aa62674b71d4a4f8f"} Jun 13 02:15:05.465758 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:05.465734 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" Jun 13 02:15:05.548906 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:05.548853 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72tqh\" (UniqueName: \"kubernetes.io/projected/20ea5b4f-8ba0-4c54-ae62-331a14fb7517-kube-api-access-72tqh\") pod \"20ea5b4f-8ba0-4c54-ae62-331a14fb7517\" (UID: \"20ea5b4f-8ba0-4c54-ae62-331a14fb7517\") " Jun 13 02:15:05.550936 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:05.550907 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ea5b4f-8ba0-4c54-ae62-331a14fb7517-kube-api-access-72tqh" (OuterVolumeSpecName: "kube-api-access-72tqh") pod "20ea5b4f-8ba0-4c54-ae62-331a14fb7517" (UID: "20ea5b4f-8ba0-4c54-ae62-331a14fb7517"). InnerVolumeSpecName "kube-api-access-72tqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:15:05.649654 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:05.649557 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72tqh\" (UniqueName: \"kubernetes.io/projected/20ea5b4f-8ba0-4c54-ae62-331a14fb7517-kube-api-access-72tqh\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:15:06.317627 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:06.317592 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" Jun 13 02:15:06.317627 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:06.317621 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688615-75fwg" event={"ID":"20ea5b4f-8ba0-4c54-ae62-331a14fb7517","Type":"ContainerDied","Data":"3898ee50a7f5aac20d4be7afeaf4f31566b626d36781d7990047f1d30906983d"} Jun 13 02:15:06.317827 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:15:06.317666 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3898ee50a7f5aac20d4be7afeaf4f31566b626d36781d7990047f1d30906983d" Jun 13 02:18:02.336073 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:02.336016 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-589fbdfdcc-xhfjf"] Jun 13 02:18:02.336569 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:02.336282 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" podUID="8593e454-ac29-4fdd-88ed-a6cab8cc9e9d" containerName="manager" containerID="cri-o://222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3" gracePeriod=30 Jun 13 02:18:02.596049 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:02.595983 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:18:02.641609 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:02.641578 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-webhook-cert\") pod \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\" (UID: \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\") " Jun 13 02:18:02.641793 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:02.641717 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrlm5\" (UniqueName: \"kubernetes.io/projected/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-kube-api-access-jrlm5\") pod \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\" (UID: \"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d\") " Jun 13 02:18:02.643795 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:02.643763 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8593e454-ac29-4fdd-88ed-a6cab8cc9e9d" (UID: "8593e454-ac29-4fdd-88ed-a6cab8cc9e9d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:18:02.644239 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:02.644213 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-kube-api-access-jrlm5" (OuterVolumeSpecName: "kube-api-access-jrlm5") pod "8593e454-ac29-4fdd-88ed-a6cab8cc9e9d" (UID: "8593e454-ac29-4fdd-88ed-a6cab8cc9e9d"). InnerVolumeSpecName "kube-api-access-jrlm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:18:02.743075 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:02.743034 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrlm5\" (UniqueName: \"kubernetes.io/projected/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-kube-api-access-jrlm5\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:18:02.743075 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:02.743071 2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d-webhook-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\"" Jun 13 02:18:03.414614 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:03.414510 2557 generic.go:356] "Generic (PLEG): container finished" podID="8593e454-ac29-4fdd-88ed-a6cab8cc9e9d" containerID="222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3" exitCode=0 Jun 13 02:18:03.414614 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:03.414555 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" Jun 13 02:18:03.414614 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:03.414589 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" event={"ID":"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d","Type":"ContainerDied","Data":"222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3"} Jun 13 02:18:03.415223 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:03.414654 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-589fbdfdcc-xhfjf" event={"ID":"8593e454-ac29-4fdd-88ed-a6cab8cc9e9d","Type":"ContainerDied","Data":"ad2b3b08d225944b1e75639fe8e9c2a87743810b1fa8296039d47afd362be24a"} Jun 13 02:18:03.415223 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:03.414686 2557 scope.go:117] "RemoveContainer" containerID="222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3" Jun 13 02:18:03.424593 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:03.424577 2557 scope.go:117] "RemoveContainer" containerID="222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3" Jun 13 02:18:03.424838 ip-10-0-141-22 kubenswrapper[2557]: E0613 02:18:03.424820 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3\": container with ID starting with 222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3 not found: ID does not exist" containerID="222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3" Jun 13 02:18:03.424896 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:03.424850 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3"} err="failed to get container status \"222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3\": rpc error: code = NotFound desc = could not find container \"222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3\": container with ID starting with 222e55d94b3e02c90880e85b0e1d05a1dc562fa6ad62159d05b7264d07c545b3 not found: ID does not exist" Jun 13 02:18:03.431408 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:03.431384 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-589fbdfdcc-xhfjf"] Jun 13 02:18:03.434035 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:03.434014 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-589fbdfdcc-xhfjf"] Jun 13 02:18:04.184287 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.184241 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-589fbdfdcc-gnds7"] Jun 13 02:18:04.184684 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.184670 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ea5b4f-8ba0-4c54-ae62-331a14fb7517" containerName="cleanup" Jun 13 02:18:04.184731 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.184686 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ea5b4f-8ba0-4c54-ae62-331a14fb7517" containerName="cleanup" Jun 13 02:18:04.184731 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.184707 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8593e454-ac29-4fdd-88ed-a6cab8cc9e9d" containerName="manager" Jun 13 02:18:04.184731 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.184714 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8593e454-ac29-4fdd-88ed-a6cab8cc9e9d" containerName="manager" Jun 13 02:18:04.184842 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.184772 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8593e454-ac29-4fdd-88ed-a6cab8cc9e9d" containerName="manager" Jun 13 02:18:04.184842 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.184779 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="20ea5b4f-8ba0-4c54-ae62-331a14fb7517" containerName="cleanup" Jun 13 02:18:04.189275 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.189257 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-589fbdfdcc-gnds7" Jun 13 02:18:04.193081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.193052 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 13 02:18:04.193232 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.193125 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-stxth\"" Jun 13 02:18:04.193232 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.193177 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 13 02:18:04.196820 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.196792 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-589fbdfdcc-gnds7"] Jun 13 02:18:04.258614 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.258579 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxblg\" (UniqueName: \"kubernetes.io/projected/ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c-kube-api-access-zxblg\") pod \"maas-controller-589fbdfdcc-gnds7\" (UID: \"ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c\") " pod="opendatahub/maas-controller-589fbdfdcc-gnds7" Jun 13 02:18:04.258824 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.258735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c-webhook-cert\") pod \"maas-controller-589fbdfdcc-gnds7\" (UID: \"ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c\") " pod="opendatahub/maas-controller-589fbdfdcc-gnds7" Jun 13 02:18:04.359538 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.359503 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxblg\" (UniqueName: \"kubernetes.io/projected/ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c-kube-api-access-zxblg\") pod \"maas-controller-589fbdfdcc-gnds7\" (UID: \"ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c\") " pod="opendatahub/maas-controller-589fbdfdcc-gnds7" Jun 13 02:18:04.359724 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.359615 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c-webhook-cert\") pod \"maas-controller-589fbdfdcc-gnds7\" (UID: \"ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c\") " pod="opendatahub/maas-controller-589fbdfdcc-gnds7" Jun 13 02:18:04.362102 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.362078 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c-webhook-cert\") pod \"maas-controller-589fbdfdcc-gnds7\" (UID: \"ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c\") " pod="opendatahub/maas-controller-589fbdfdcc-gnds7" Jun 13 02:18:04.367864 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.367840 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxblg\" (UniqueName: \"kubernetes.io/projected/ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c-kube-api-access-zxblg\") pod \"maas-controller-589fbdfdcc-gnds7\" (UID: \"ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c\") " pod="opendatahub/maas-controller-589fbdfdcc-gnds7" Jun 13 02:18:04.502251 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.502219 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-589fbdfdcc-gnds7" Jun 13 02:18:04.643811 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.643779 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-589fbdfdcc-gnds7"] Jun 13 02:18:04.644811 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:18:04.644785 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6d7d74_fd67_45c4_b0d6_4966af4e9c5c.slice/crio-ab301297ac218920c7971e99e857569d65759428460e0ed7f40ec15c6446c090 WatchSource:0}: Error finding container ab301297ac218920c7971e99e857569d65759428460e0ed7f40ec15c6446c090: Status 404 returned error can't find the container with id ab301297ac218920c7971e99e857569d65759428460e0ed7f40ec15c6446c090 Jun 13 02:18:04.646343 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:04.646323 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:18:05.008719 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:05.008680 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8593e454-ac29-4fdd-88ed-a6cab8cc9e9d" path="/var/lib/kubelet/pods/8593e454-ac29-4fdd-88ed-a6cab8cc9e9d/volumes" Jun 13 02:18:05.429999 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:05.429866 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-589fbdfdcc-gnds7" event={"ID":"ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c","Type":"ContainerStarted","Data":"5a4a109238a529cd34d3decd07264e959549f9d1eeae269c7ac665e7dc847c22"} Jun 13 02:18:05.429999 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:05.429925 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-589fbdfdcc-gnds7" event={"ID":"ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c","Type":"ContainerStarted","Data":"ab301297ac218920c7971e99e857569d65759428460e0ed7f40ec15c6446c090"} Jun 13 02:18:05.429999 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:05.429979 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-589fbdfdcc-gnds7" Jun 13 02:18:05.447965 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:05.447893 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-589fbdfdcc-gnds7" podStartSLOduration=1.031388129 podStartE2EDuration="1.447873006s" totalImagesPullingTime="416.484877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:18:05.44543961 +0000 UTC m=+1046.924589883" watchObservedRunningTime="2026-06-13 02:18:05.447873006 +0000 UTC m=+1046.927023277" Jun 13 02:18:16.444554 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:18:16.444516 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-589fbdfdcc-gnds7" Jun 13 02:29:10.420267 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.420228 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz"] Jun 13 02:29:10.423887 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.423868 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" Jun 13 02:29:10.426320 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.426302 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pck82\"" Jun 13 02:29:10.436974 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.436920 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz"] Jun 13 02:29:10.459542 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.459510 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdg5r\" (UniqueName: \"kubernetes.io/projected/597f778a-5b74-4092-bcd1-d72a71a74251-kube-api-access-mdg5r\") pod \"kuadrant-operator-controller-manager-86878c769f-6v2sz\" (UID: \"597f778a-5b74-4092-bcd1-d72a71a74251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" Jun 13 02:29:10.459677 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.459599 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/597f778a-5b74-4092-bcd1-d72a71a74251-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6v2sz\" (UID: \"597f778a-5b74-4092-bcd1-d72a71a74251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" Jun 13 02:29:10.561073 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.561038 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/597f778a-5b74-4092-bcd1-d72a71a74251-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6v2sz\" (UID: \"597f778a-5b74-4092-bcd1-d72a71a74251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" Jun 13 02:29:10.561241 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.561090 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdg5r\" (UniqueName: \"kubernetes.io/projected/597f778a-5b74-4092-bcd1-d72a71a74251-kube-api-access-mdg5r\") pod \"kuadrant-operator-controller-manager-86878c769f-6v2sz\" (UID: \"597f778a-5b74-4092-bcd1-d72a71a74251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" Jun 13 02:29:10.561494 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.561472 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/597f778a-5b74-4092-bcd1-d72a71a74251-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6v2sz\" (UID: \"597f778a-5b74-4092-bcd1-d72a71a74251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" Jun 13 02:29:10.569453 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.569423 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdg5r\" (UniqueName: \"kubernetes.io/projected/597f778a-5b74-4092-bcd1-d72a71a74251-kube-api-access-mdg5r\") pod \"kuadrant-operator-controller-manager-86878c769f-6v2sz\" (UID: \"597f778a-5b74-4092-bcd1-d72a71a74251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" Jun 13 02:29:10.735013 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.734895 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" Jun 13 02:29:10.876795 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:10.876763 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz"] Jun 13 02:29:10.877025 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:29:10.877003 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597f778a_5b74_4092_bcd1_d72a71a74251.slice/crio-e0b8671756b05b4d7d71bc47fdf21ded32052fe336d22e33ffc2b19ddc1c6507 WatchSource:0}: Error finding container e0b8671756b05b4d7d71bc47fdf21ded32052fe336d22e33ffc2b19ddc1c6507: Status 404 returned error can't find the container with id e0b8671756b05b4d7d71bc47fdf21ded32052fe336d22e33ffc2b19ddc1c6507 Jun 13 02:29:11.590794 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:11.590753 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" event={"ID":"597f778a-5b74-4092-bcd1-d72a71a74251","Type":"ContainerStarted","Data":"ccfdcc3e65c4958dbdbedfb6a573e3f7df8cfa35b5d4097a957e84bda61fae46"} Jun 13 02:29:11.591206 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:11.590818 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" event={"ID":"597f778a-5b74-4092-bcd1-d72a71a74251","Type":"ContainerStarted","Data":"e0b8671756b05b4d7d71bc47fdf21ded32052fe336d22e33ffc2b19ddc1c6507"} Jun 13 02:29:11.591206 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:11.590846 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" Jun 13 02:29:11.615065 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:11.615010 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" podStartSLOduration=1.614993285 podStartE2EDuration="1.614993285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:29:11.61254329 +0000 UTC m=+1713.091693557" watchObservedRunningTime="2026-06-13 02:29:11.614993285 +0000 UTC m=+1713.094143556" Jun 13 02:29:22.599809 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:29:22.599774 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6v2sz" Jun 13 02:39:00.977823 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:00.977783 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8459cf648c-mnrbv_ce33c4db-2921-4916-9fdf-e5d908f64325/nginx/0.log" Jun 13 02:39:01.091429 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:01.091398 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-nhbnh_1e2dfb58-2bdf-4768-8662-a697a7a72f4b/manager/0.log" Jun 13 02:39:01.229737 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:01.229656 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-bdxnj_d193ca2a-e5e6-4e4e-8df0-c16a06f5c486/manager/0.log" Jun 13 02:39:01.355649 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:01.355620 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-9cd5d7b8-6c5rd_a1f5adba-13f9-4b2d-be73-2d427ac5d6f0/maas-api/0.log" Jun 13 02:39:01.708175 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:01.708142 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688615-75fwg_20ea5b4f-8ba0-4c54-ae62-331a14fb7517/cleanup/0.log" Jun 13 02:39:01.943538 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:01.943503 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-589fbdfdcc-gnds7_ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c/manager/0.log" Jun 13 02:39:02.058369 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:02.058342 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-z52qc_94c479f1-1b38-4d6e-825c-5171ca376357/server/0.log" Jun 13 02:39:02.180073 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:02.180036 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-thgkp_777a005d-6303-4ab9-a8f1-bb1cc73c47aa/manager/0.log" Jun 13 02:39:02.541614 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:02.541589 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-z2vfs_a69cb4ec-5941-426d-81db-3405738f196d/copy-manifests/0.log" Jun 13 02:39:02.549058 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:02.549028 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-z2vfs_a69cb4ec-5941-426d-81db-3405738f196d/manager/0.log" Jun 13 02:39:02.660015 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:02.659986 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rxgmz_340646cf-0de1-4690-b217-5066162a6582/postgres/0.log" Jun 13 02:39:03.398967 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.398928 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45_a48b0002-bb4f-4094-8330-06bf6eb46006/util/0.log" Jun 13 02:39:03.405927 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.405904 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45_a48b0002-bb4f-4094-8330-06bf6eb46006/pull/0.log" Jun 13 02:39:03.412615 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.412593 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45_a48b0002-bb4f-4094-8330-06bf6eb46006/extract/0.log" Jun 13 02:39:03.522494 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.522460 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn_b10e3989-a484-4159-9b0f-e361b7271bb9/util/0.log" Jun 13 02:39:03.531130 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.531103 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn_b10e3989-a484-4159-9b0f-e361b7271bb9/pull/0.log" Jun 13 02:39:03.539364 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.539338 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn_b10e3989-a484-4159-9b0f-e361b7271bb9/extract/0.log" Jun 13 02:39:03.644127 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.644097 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h_bcf2b72a-9afd-481f-8827-9db6146017cc/util/0.log" Jun 13 02:39:03.651081 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.650995 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h_bcf2b72a-9afd-481f-8827-9db6146017cc/pull/0.log" Jun 13 02:39:03.657514 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.657490 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h_bcf2b72a-9afd-481f-8827-9db6146017cc/extract/0.log" Jun 13 02:39:03.769542 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.769516 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz_36947535-25be-4aa2-aaa4-3392ebea1fa8/extract/0.log" Jun 13 02:39:03.776775 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.776753 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz_36947535-25be-4aa2-aaa4-3392ebea1fa8/util/0.log" Jun 13 02:39:03.786042 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:03.786016 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz_36947535-25be-4aa2-aaa4-3392ebea1fa8/pull/0.log" Jun 13 02:39:04.143558 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:04.143526 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-p8j97_5a0bfee9-2034-4130-a7ea-258576e37581/manager/0.log" Jun 13 02:39:04.503616 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:04.503576 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6v2sz_597f778a-5b74-4092-bcd1-d72a71a74251/manager/0.log" Jun 13 02:39:05.208227 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:05.208199 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2kw6z_4b1c4ff2-f29e-4f21-8824-ce84affc9aeb/discovery/0.log" Jun 13 02:39:05.319441 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:05.319413 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f59d458f8-chrb4_4e82d15e-c6cf-49c8-aef0-84d85b43f138/kube-auth-proxy/0.log" Jun 13 02:39:05.671670 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:05.671642 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-77lbq_ecde154d-470c-444e-a505-8cb7e3afdeef/payload-pre-processing/0.log" Jun 13 02:39:05.895727 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:05.895678 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b48dc66b-725zw_79d3ca1c-dd15-46e6-b97e-ab817f52c686/router/0.log" Jun 13 02:39:13.329901 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:13.329864 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kjxpz_8f629165-2355-472e-990b-37bf4c1c13a7/global-pull-secret-syncer/0.log" Jun 13 02:39:13.445087 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:13.445061 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qwmt8_9f8c7669-65bb-4d98-9e2d-01b933948394/konnectivity-agent/0.log" Jun 13 02:39:13.537669 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:13.537643 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-22.ec2.internal_7071f2b508a5b112d7ba4951ff65924d/haproxy/0.log" Jun 13 02:39:16.138136 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:16.138110 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-bbgkf_91420348-8678-4360-8181-89a0d27af17e/sail-operator/0.log" Jun 13 02:39:17.410617 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.410583 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45_a48b0002-bb4f-4094-8330-06bf6eb46006/extract/0.log" Jun 13 02:39:17.430784 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.430756 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45_a48b0002-bb4f-4094-8330-06bf6eb46006/util/0.log" Jun 13 02:39:17.449813 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.449787 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75977h45_a48b0002-bb4f-4094-8330-06bf6eb46006/pull/0.log" Jun 13 02:39:17.473879 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.473855 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn_b10e3989-a484-4159-9b0f-e361b7271bb9/extract/0.log" Jun 13 02:39:17.498386 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.498358 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn_b10e3989-a484-4159-9b0f-e361b7271bb9/util/0.log" Jun 13 02:39:17.518818 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.518792 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hwpsn_b10e3989-a484-4159-9b0f-e361b7271bb9/pull/0.log" Jun 13 02:39:17.549328 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.549301 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h_bcf2b72a-9afd-481f-8827-9db6146017cc/extract/0.log" Jun 13 02:39:17.567677 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.567655 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h_bcf2b72a-9afd-481f-8827-9db6146017cc/util/0.log" Jun 13 02:39:17.586445 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.586421 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736vn6h_bcf2b72a-9afd-481f-8827-9db6146017cc/pull/0.log" Jun 13 02:39:17.614632 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.614611 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz_36947535-25be-4aa2-aaa4-3392ebea1fa8/extract/0.log" Jun 13 02:39:17.634683 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.634660 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz_36947535-25be-4aa2-aaa4-3392ebea1fa8/util/0.log" Jun 13 02:39:17.660756 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:17.660694 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bd5rz_36947535-25be-4aa2-aaa4-3392ebea1fa8/pull/0.log" Jun 13 02:39:18.082208 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:18.082166 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-p8j97_5a0bfee9-2034-4130-a7ea-258576e37581/manager/0.log" Jun 13 02:39:18.268859 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:18.268824 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6v2sz_597f778a-5b74-4092-bcd1-d72a71a74251/manager/0.log" Jun 13 02:39:20.092635 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.092521 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5765c04-6407-4933-a93f-086de1a64fe8/alertmanager/0.log" Jun 13 02:39:20.120439 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.120407 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5765c04-6407-4933-a93f-086de1a64fe8/config-reloader/0.log" Jun 13 02:39:20.145428 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.145397 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5765c04-6407-4933-a93f-086de1a64fe8/kube-rbac-proxy-web/0.log" Jun 13 02:39:20.164615 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.164593 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5765c04-6407-4933-a93f-086de1a64fe8/kube-rbac-proxy/0.log" Jun 13 02:39:20.188344 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.188316 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5765c04-6407-4933-a93f-086de1a64fe8/kube-rbac-proxy-metric/0.log" Jun 13 02:39:20.208559 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.208534 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5765c04-6407-4933-a93f-086de1a64fe8/prom-label-proxy/0.log" Jun 13 02:39:20.227876 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.227847 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e5765c04-6407-4933-a93f-086de1a64fe8/init-config-reloader/0.log" Jun 13 02:39:20.291258 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.291225 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-7tj6m_8c3252ae-c97a-44da-9c3d-a7c6c8867574/kube-state-metrics/0.log" Jun 13 02:39:20.306103 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.306076 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-7tj6m_8c3252ae-c97a-44da-9c3d-a7c6c8867574/kube-rbac-proxy-main/0.log" Jun 13 02:39:20.325997 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.325975 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-7tj6m_8c3252ae-c97a-44da-9c3d-a7c6c8867574/kube-rbac-proxy-self/0.log" Jun 13 02:39:20.350442 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.350379 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-647467fc44-d7grc_8588be49-aa7d-4dca-9405-2516b273ef86/metrics-server/0.log" Jun 13 02:39:20.578382 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.578349 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2kkx_c5038f21-bf61-4ed4-9d5a-e56c8936af2a/node-exporter/0.log" Jun 13 02:39:20.599277 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.599241 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2kkx_c5038f21-bf61-4ed4-9d5a-e56c8936af2a/kube-rbac-proxy/0.log" Jun 13 02:39:20.618006 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.617922 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2kkx_c5038f21-bf61-4ed4-9d5a-e56c8936af2a/init-textfile/0.log" Jun 13 02:39:20.645145 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.645116 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-rchpw_e7a850ff-3894-437a-86b1-48b1d1235d8a/kube-rbac-proxy-main/0.log" Jun 13 02:39:20.663421 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.663396 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-rchpw_e7a850ff-3894-437a-86b1-48b1d1235d8a/kube-rbac-proxy-self/0.log" Jun 13 02:39:20.682762 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.682742 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-rchpw_e7a850ff-3894-437a-86b1-48b1d1235d8a/openshift-state-metrics/0.log" Jun 13 02:39:20.927707 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:20.927621 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-qlpjt_5bcd7ef4-1a57-427e-8927-9d37604863a8/prometheus-operator-admission-webhook/0.log" Jun 13 02:39:22.776004 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:22.775939 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-hh6pd_bb14295a-9e1b-483c-8171-c427c3bedaad/networking-console-plugin/0.log" Jun 13 02:39:23.963446 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:23.963394 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c6b5b6cf8-n5p9z_7f544682-4461-43bb-a659-f3b4446f0582/console/0.log" Jun 13 02:39:23.998201 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:23.998169 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-xmjm4_fffe19d4-087b-4d0a-812e-16525e5d6f60/download-server/0.log" Jun 13 02:39:24.681821 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:24.681790 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-fs55x_7daaef1d-38d0-4c25-a802-d920e657f398/volume-data-source-validator/0.log" Jun 13 02:39:25.316048 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.316014 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4"] Jun 13 02:39:25.320004 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.319985 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.322621 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.322597 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc5tz\"/\"openshift-service-ca.crt\"" Jun 13 02:39:25.323071 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.323051 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc5tz\"/\"kube-root-ca.crt\"" Jun 13 02:39:25.323190 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.323095 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bc5tz\"/\"default-dockercfg-hn2ct\"" Jun 13 02:39:25.325196 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.325166 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4"] Jun 13 02:39:25.461906 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.461872 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-lib-modules\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.461906 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.461911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm5bt\" (UniqueName: \"kubernetes.io/projected/7b919bd6-3fa3-467d-a44c-d259e931b2ab-kube-api-access-lm5bt\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.462147 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.461936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-sys\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.462147 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.462055 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-podres\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.462226 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.462156 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-proc\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.562890 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.562853 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-lib-modules\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.562890 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.562894 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm5bt\" (UniqueName: \"kubernetes.io/projected/7b919bd6-3fa3-467d-a44c-d259e931b2ab-kube-api-access-lm5bt\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.563147 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.562920 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-sys\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.563147 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.562995 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-podres\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.563147 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.563023 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-sys\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.563147 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.563051 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-lib-modules\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.563147 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.563083 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-proc\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.563355 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.563153 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-podres\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.563355 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.563161 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b919bd6-3fa3-467d-a44c-d259e931b2ab-proc\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.570969 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.570901 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm5bt\" (UniqueName: \"kubernetes.io/projected/7b919bd6-3fa3-467d-a44c-d259e931b2ab-kube-api-access-lm5bt\") pod \"perf-node-gather-daemonset-7d5x4\" (UID: \"7b919bd6-3fa3-467d-a44c-d259e931b2ab\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.631076 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.631049 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:25.770510 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.770484 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4"] Jun 13 02:39:25.771822 ip-10-0-141-22 kubenswrapper[2557]: W0613 02:39:25.771795 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7b919bd6_3fa3_467d_a44c_d259e931b2ab.slice/crio-94a3ff545908ebf9bbe8878ddcc1721ba05a96b7253be4ba6af1338b95f71cf6 WatchSource:0}: Error finding container 94a3ff545908ebf9bbe8878ddcc1721ba05a96b7253be4ba6af1338b95f71cf6: Status 404 returned error can't find the container with id 94a3ff545908ebf9bbe8878ddcc1721ba05a96b7253be4ba6af1338b95f71cf6 Jun 13 02:39:25.908864 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.908842 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kmq5z_44ad9c9f-e870-462a-bb6b-4eee24c316e2/dns/0.log" Jun 13 02:39:25.927626 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:25.927599 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kmq5z_44ad9c9f-e870-462a-bb6b-4eee24c316e2/kube-rbac-proxy/0.log" Jun 13 02:39:26.035734 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:26.035698 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q9k7s_aa14882d-ac61-40d0-94f3-22037f5816ce/dns-node-resolver/0.log" Jun 13 02:39:26.500882 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:26.500851 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" event={"ID":"7b919bd6-3fa3-467d-a44c-d259e931b2ab","Type":"ContainerStarted","Data":"5f764a348ec3153d5640a54f45830e97e0e8e8bf6dc6fa598e570b578c09c102"} Jun 13 02:39:26.501344 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:26.500908 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" event={"ID":"7b919bd6-3fa3-467d-a44c-d259e931b2ab","Type":"ContainerStarted","Data":"94a3ff545908ebf9bbe8878ddcc1721ba05a96b7253be4ba6af1338b95f71cf6"} Jun 13 02:39:26.501344 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:26.500998 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:26.517379 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:26.517336 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" podStartSLOduration=1.517322608 podStartE2EDuration="1.517322608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:39:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:39:26.51466359 +0000 UTC m=+2327.993813874" watchObservedRunningTime="2026-06-13 02:39:26.517322608 +0000 UTC m=+2327.996472917" Jun 13 02:39:26.556944 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:26.556912 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5np24_6180dba6-1f27-479e-9a60-2e77d9399dbf/node-ca/0.log" Jun 13 02:39:27.549857 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:27.549819 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2kw6z_4b1c4ff2-f29e-4f21-8824-ce84affc9aeb/discovery/0.log" Jun 13 02:39:27.567688 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:27.567663 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f59d458f8-chrb4_4e82d15e-c6cf-49c8-aef0-84d85b43f138/kube-auth-proxy/0.log" Jun 13 02:39:27.700169 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:27.700130 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-77lbq_ecde154d-470c-444e-a505-8cb7e3afdeef/payload-pre-processing/0.log" Jun 13 02:39:27.780394 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:27.780358 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b48dc66b-725zw_79d3ca1c-dd15-46e6-b97e-ab817f52c686/router/0.log" Jun 13 02:39:28.372188 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:28.372155 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4qqmb_2303d56d-2e9a-4ff7-ba2e-a07b453a4c91/serve-healthcheck-canary/0.log" Jun 13 02:39:28.911974 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:28.911921 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-5jtnr_45293b1c-6b4f-4abd-a2cf-2d30a52103c0/insights-operator/0.log" Jun 13 02:39:28.915367 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:28.915337 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-5jtnr_45293b1c-6b4f-4abd-a2cf-2d30a52103c0/insights-operator/1.log" Jun 13 02:39:29.066431 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:29.066402 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z9svn_e32d4329-4112-4718-9e8b-f83b37c84559/kube-rbac-proxy/0.log" Jun 13 02:39:29.084622 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:29.084597 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z9svn_e32d4329-4112-4718-9e8b-f83b37c84559/exporter/0.log" Jun 13 02:39:29.108048 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:29.108021 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z9svn_e32d4329-4112-4718-9e8b-f83b37c84559/extractor/0.log" Jun 13 02:39:31.266278 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:31.266253 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8459cf648c-mnrbv_ce33c4db-2921-4916-9fdf-e5d908f64325/nginx/0.log" Jun 13 02:39:31.291376 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:31.291344 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-nhbnh_1e2dfb58-2bdf-4768-8662-a697a7a72f4b/manager/0.log" Jun 13 02:39:31.427876 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:31.427849 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-bdxnj_d193ca2a-e5e6-4e4e-8df0-c16a06f5c486/manager/0.log" Jun 13 02:39:31.472971 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:31.472920 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-9cd5d7b8-6c5rd_a1f5adba-13f9-4b2d-be73-2d427ac5d6f0/maas-api/0.log" Jun 13 02:39:31.534616 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:31.534533 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688615-75fwg_20ea5b4f-8ba0-4c54-ae62-331a14fb7517/cleanup/0.log" Jun 13 02:39:31.671724 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:31.671691 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-589fbdfdcc-gnds7_ad6d7d74-fd67-45c4-b0d6-4966af4e9c5c/manager/0.log" Jun 13 02:39:31.690881 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:31.690860 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-z52qc_94c479f1-1b38-4d6e-825c-5171ca376357/server/0.log" Jun 13 02:39:31.764517 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:31.764484 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-thgkp_777a005d-6303-4ab9-a8f1-bb1cc73c47aa/manager/0.log" Jun 13 02:39:31.965592 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:31.965509 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-z2vfs_a69cb4ec-5941-426d-81db-3405738f196d/manager/0.log" Jun 13 02:39:31.984359 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:31.984331 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-z2vfs_a69cb4ec-5941-426d-81db-3405738f196d/copy-manifests/0.log" Jun 13 02:39:32.009047 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:32.009021 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rxgmz_340646cf-0de1-4690-b217-5066162a6582/postgres/0.log" Jun 13 02:39:32.519280 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:32.519256 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-7d5x4" Jun 13 02:39:33.555201 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:33.555168 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-thkhh_77082ad2-9e27-45ab-b583-7c44d803b836/openshift-lws-operator/0.log" Jun 13 02:39:38.035654 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:38.035621 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2kw6z_4b1c4ff2-f29e-4f21-8824-ce84affc9aeb/discovery/0.log" Jun 13 02:39:38.045526 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:38.045501 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f59d458f8-chrb4_4e82d15e-c6cf-49c8-aef0-84d85b43f138/kube-auth-proxy/0.log" Jun 13 02:39:38.164328 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:38.164297 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-77lbq_ecde154d-470c-444e-a505-8cb7e3afdeef/payload-pre-processing/0.log" Jun 13 02:39:38.281065 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:38.281020 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b48dc66b-725zw_79d3ca1c-dd15-46e6-b97e-ab817f52c686/router/0.log" Jun 13 02:39:39.151448 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:39.151411 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-kkstz_b9f9a144-91b4-4b93-aa8e-b83432e8ce41/kube-storage-version-migrator-operator/1.log" Jun 13 02:39:39.152717 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:39.152688 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-kkstz_b9f9a144-91b4-4b93-aa8e-b83432e8ce41/kube-storage-version-migrator-operator/0.log" Jun 13 02:39:39.533393 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:39.533360 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2kw6z_4b1c4ff2-f29e-4f21-8824-ce84affc9aeb/discovery/0.log" Jun 13 02:39:39.548531 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:39.548503 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f59d458f8-chrb4_4e82d15e-c6cf-49c8-aef0-84d85b43f138/kube-auth-proxy/0.log" Jun 13 02:39:39.659234 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:39.659203 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-77lbq_ecde154d-470c-444e-a505-8cb7e3afdeef/payload-pre-processing/0.log" Jun 13 02:39:39.718243 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:39.718212 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b48dc66b-725zw_79d3ca1c-dd15-46e6-b97e-ab817f52c686/router/0.log" Jun 13 02:39:40.254389 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:40.254361 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8ckbb_6fa59b85-a03f-4aae-b8de-bffcf5f45275/kube-multus/0.log" Jun 13 02:39:40.564411 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:40.564339 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9phd_13cd278d-3a38-407f-8232-12187088b070/kube-multus-additional-cni-plugins/0.log" Jun 13 02:39:40.582402 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:40.582378 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9phd_13cd278d-3a38-407f-8232-12187088b070/egress-router-binary-copy/0.log" Jun 13 02:39:40.600098 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:40.600070 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9phd_13cd278d-3a38-407f-8232-12187088b070/cni-plugins/0.log" Jun 13 02:39:40.620073 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:40.620047 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9phd_13cd278d-3a38-407f-8232-12187088b070/bond-cni-plugin/0.log" Jun 13 02:39:40.638726 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:40.638702 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9phd_13cd278d-3a38-407f-8232-12187088b070/routeoverride-cni/0.log" Jun 13 02:39:40.656867 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:40.656848 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9phd_13cd278d-3a38-407f-8232-12187088b070/whereabouts-cni-bincopy/0.log" Jun 13 02:39:40.674096 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:40.674068 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9phd_13cd278d-3a38-407f-8232-12187088b070/whereabouts-cni/0.log" Jun 13 02:39:40.749577 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:40.749552 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5977q_c0366e70-4c1a-496c-9928-ac65525e6b37/network-metrics-daemon/0.log" Jun 13 02:39:40.764154 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:40.764127 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5977q_c0366e70-4c1a-496c-9928-ac65525e6b37/kube-rbac-proxy/0.log" Jun 13 02:39:41.336046 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.336015 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2kw6z_4b1c4ff2-f29e-4f21-8824-ce84affc9aeb/discovery/0.log" Jun 13 02:39:41.347002 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.346975 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f59d458f8-chrb4_4e82d15e-c6cf-49c8-aef0-84d85b43f138/kube-auth-proxy/0.log" Jun 13 02:39:41.457856 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.457824 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-77lbq_ecde154d-470c-444e-a505-8cb7e3afdeef/payload-pre-processing/0.log" Jun 13 02:39:41.519764 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.519726 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b48dc66b-725zw_79d3ca1c-dd15-46e6-b97e-ab817f52c686/router/0.log" Jun 13 02:39:41.810062 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.810030 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hg7w_91af975a-6f6a-42a4-89a1-5515884b1ff8/ovn-controller/0.log" Jun 13 02:39:41.825328 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.825305 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hg7w_91af975a-6f6a-42a4-89a1-5515884b1ff8/ovn-acl-logging/0.log" Jun 13 02:39:41.855607 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.855583 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hg7w_91af975a-6f6a-42a4-89a1-5515884b1ff8/kube-rbac-proxy-node/0.log" Jun 13 02:39:41.884155 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.884128 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hg7w_91af975a-6f6a-42a4-89a1-5515884b1ff8/kube-rbac-proxy-ovn-metrics/0.log" Jun 13 02:39:41.903805 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.903778 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hg7w_91af975a-6f6a-42a4-89a1-5515884b1ff8/northd/0.log" Jun 13 02:39:41.928345 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.928321 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hg7w_91af975a-6f6a-42a4-89a1-5515884b1ff8/nbdb/0.log" Jun 13 02:39:41.947887 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:41.947866 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hg7w_91af975a-6f6a-42a4-89a1-5515884b1ff8/sbdb/0.log" Jun 13 02:39:42.015656 ip-10-0-141-22 kubenswrapper[2557]: I0613 02:39:42.015623 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hg7w_91af975a-6f6a-42a4-89a1-5515884b1ff8/ovnkube-controller/0.log"